2024-08-17T02:12:11.006 INFO:root:teuthology version: 1.2.0 2024-08-17T02:12:11.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:12:11.114 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858255' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:12:11.114 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:12:11.115 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:12:11.115 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:12:11.117 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:12:11.138 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:12:11.138 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:12:11.138 INFO:teuthology.packaging:ref: None 2024-08-17T02:12:11.138 INFO:teuthology.packaging:tag: None 2024-08-17T02:12:11.138 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:12:11.138 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:12:11.138 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:12:11.283 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375-g2577e813-1focal 2024-08-17T02:12:11.285 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:12:11.292 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:12:11.292 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:12:11.300 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:12:11.316 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:12:11.323 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:12:11.349 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:49.981956', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:12:11.372 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:49.983281', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-08-17T02:12:11.373 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:12:11.379 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:12:11.379 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:12:11.380 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:12:11.439 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f36f8587ac0>, signals=[15]) 2024-08-17T02:12:11.439 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:12:11.445 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:12:11.446 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:12:11.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:11.535 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:12:11.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:11.624 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:12:11.630 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-08-17T02:12:11.637 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-08-17T02:12:11.638 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-08-17T02:12:11.687 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2024-08-17T02:12:11.687 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:12:11.687 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2024-08-17T02:12:11.687 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2024-08-17T02:12:11.687 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:12:11.687 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="20.04" 2024-08-17T02:12:11.688 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:12:11.688 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:12:11.688 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:12:11.688 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:12:11.688 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=focal 2024-08-17T02:12:11.688 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:12:11.689 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-08-17T02:12:11.711 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-08-17T02:12:11.718 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-08-17T02:12:11.718 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-08-17T02:12:11.766 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Ubuntu" 2024-08-17T02:12:11.766 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-08-17T02:12:11.766 INFO:teuthology.orchestra.run.smithi092.stdout:ID=ubuntu 2024-08-17T02:12:11.766 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE=debian 2024-08-17T02:12:11.766 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-08-17T02:12:11.766 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="20.04" 2024-08-17T02:12:11.766 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-17T02:12:11.767 INFO:teuthology.orchestra.run.smithi092.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-17T02:12:11.767 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-17T02:12:11.767 INFO:teuthology.orchestra.run.smithi092.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-17T02:12:11.767 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_CODENAME=focal 2024-08-17T02:12:11.767 INFO:teuthology.orchestra.run.smithi092.stdout:UBUNTU_CODENAME=focal 2024-08-17T02:12:11.767 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-08-17T02:12:11.785 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:12:11.795 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:12:11.805 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:12:11.805 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:12:11.807 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:12:11.813 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:12:11.819 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:12:11.819 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:12:11.822 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:12:11.844 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:12:11.891 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:12:11.904 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:12:11.904 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-17T02:12:11.904 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:12:11.905 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:12:11.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:12:11.910 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-08-17T02:12:11.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:12:11.911 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-08-17T02:12:11.917 INFO:teuthology.orchestra.run.smithi031.stdout:5.4.0-124-generic 2024-08-17T02:12:11.917 INFO:teuthology.task.kernel:Running kernel on smithi031: 5.4.0-124-generic 2024-08-17T02:12:11.917 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get clean 2024-08-17T02:12:11.918 INFO:teuthology.orchestra.run.smithi092.stdout:5.4.0-124-generic 2024-08-17T02:12:11.919 INFO:teuthology.task.kernel:Running kernel on smithi092: 5.4.0-124-generic 2024-08-17T02:12:11.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo apt-get clean 2024-08-17T02:12:12.032 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2024-08-17T02:12:12.042 DEBUG:teuthology.orchestra.run.smithi092:> sudo apt-get update 2024-08-17T02:12:12.213 INFO:teuthology.orchestra.run.smithi092.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:12:12.213 INFO:teuthology.orchestra.run.smithi092.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:12:12.213 INFO:teuthology.orchestra.run.smithi092.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:12:12.285 INFO:teuthology.orchestra.run.smithi092.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:12:12.329 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:12:12.330 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-08-17T02:12:12.386 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-08-17T02:12:12.599 INFO:teuthology.orchestra.run.smithi092.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:12:12.684 INFO:teuthology.orchestra.run.smithi092.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:12:12.729 INFO:teuthology.orchestra.run.smithi092.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:12:12.730 INFO:teuthology.orchestra.run.smithi092.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:12:12.735 INFO:teuthology.orchestra.run.smithi092.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:12:12.735 INFO:teuthology.orchestra.run.smithi092.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:12:12.736 INFO:teuthology.orchestra.run.smithi092.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:12:12.744 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-08-17T02:12:12.769 INFO:teuthology.orchestra.run.smithi092.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:12:12.774 INFO:teuthology.orchestra.run.smithi092.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:12:12.774 INFO:teuthology.orchestra.run.smithi092.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:12:12.782 INFO:teuthology.orchestra.run.smithi092.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:12:12.792 INFO:teuthology.orchestra.run.smithi092.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:12:12.795 INFO:teuthology.orchestra.run.smithi092.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:12:12.795 INFO:teuthology.orchestra.run.smithi092.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:12:12.796 INFO:teuthology.orchestra.run.smithi092.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:12:12.796 INFO:teuthology.orchestra.run.smithi092.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:12:12.796 INFO:teuthology.orchestra.run.smithi092.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:12:12.798 INFO:teuthology.orchestra.run.smithi092.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:12:12.826 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,126 kB] 2024-08-17T02:12:12.842 INFO:teuthology.orchestra.run.smithi092.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:12:12.842 INFO:teuthology.orchestra.run.smithi092.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:12:12.842 INFO:teuthology.orchestra.run.smithi092.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:12:12.842 INFO:teuthology.orchestra.run.smithi092.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:12:12.859 INFO:teuthology.orchestra.run.smithi092.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:12:12.863 INFO:teuthology.orchestra.run.smithi092.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:12:12.863 INFO:teuthology.orchestra.run.smithi092.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:12:12.868 INFO:teuthology.orchestra.run.smithi092.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:12:12.875 INFO:teuthology.orchestra.run.smithi092.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:12:12.878 INFO:teuthology.orchestra.run.smithi092.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:12:12.878 INFO:teuthology.orchestra.run.smithi092.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:12:12.878 INFO:teuthology.orchestra.run.smithi092.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:12:12.878 INFO:teuthology.orchestra.run.smithi092.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:12:12.893 INFO:teuthology.orchestra.run.smithi092.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:12:12.893 INFO:teuthology.orchestra.run.smithi092.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:12:12.894 INFO:teuthology.orchestra.run.smithi092.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:12:12.894 INFO:teuthology.orchestra.run.smithi092.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:12:12.895 INFO:teuthology.orchestra.run.smithi092.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:12:12.911 INFO:teuthology.orchestra.run.smithi092.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:12:12.912 INFO:teuthology.orchestra.run.smithi092.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:12:12.972 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,017 kB] 2024-08-17T02:12:13.312 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,496 kB] 2024-08-17T02:12:13.314 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [797 kB] 2024-08-17T02:12:13.329 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [464 kB] 2024-08-17T02:12:13.336 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.2 kB] 2024-08-17T02:12:13.336 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.1 kB] 2024-08-17T02:12:13.337 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,034 kB] 2024-08-17T02:12:13.425 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [425 kB] 2024-08-17T02:12:13.432 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [544 B] 2024-08-17T02:12:13.432 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [999 kB] 2024-08-17T02:12:13.482 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [674 kB] 2024-08-17T02:12:13.491 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [212 kB] 2024-08-17T02:12:13.496 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.0 kB] 2024-08-17T02:12:13.496 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-08-17T02:12:13.496 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-08-17T02:12:13.496 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-08-17T02:12:13.516 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [543 kB] 2024-08-17T02:12:13.529 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-08-17T02:12:13.530 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.4 kB] 2024-08-17T02:12:13.531 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,152 kB] 2024-08-17T02:12:13.575 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-08-17T02:12:13.623 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [442 kB] 2024-08-17T02:12:13.645 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [540 B] 2024-08-17T02:12:13.646 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,219 kB] 2024-08-17T02:12:13.674 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [801 kB] 2024-08-17T02:12:13.693 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [294 kB] 2024-08-17T02:12:13.699 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [27.8 kB] 2024-08-17T02:12:13.700 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-08-17T02:12:13.701 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-08-17T02:12:13.701 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-08-17T02:12:13.761 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-08-17T02:12:13.761 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-08-17T02:12:13.761 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-08-17T02:12:13.762 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-08-17T02:12:13.842 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-08-17T02:12:13.843 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-08-17T02:12:13.843 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-08-17T02:12:16.946 INFO:teuthology.orchestra.run.smithi092.stdout:Fetched 21.4 MB in 3s (7,224 kB/s) 2024-08-17T02:12:17.709 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 21.4 MB in 4s (5,889 kB/s) 2024-08-17T02:12:18.522 INFO:teuthology.orchestra.run.smithi092.stdout:Reading package lists... 2024-08-17T02:12:18.550 DEBUG:teuthology.orchestra.run.smithi092:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:12:18.652 INFO:teuthology.orchestra.run.smithi092.stdout:Reading package lists... 2024-08-17T02:12:18.871 INFO:teuthology.orchestra.run.smithi092.stdout:Building dependency tree... 2024-08-17T02:12:18.872 INFO:teuthology.orchestra.run.smithi092.stdout:Reading state information... 2024-08-17T02:12:19.084 INFO:teuthology.orchestra.run.smithi092.stdout:The following additional packages will be installed: 2024-08-17T02:12:19.084 INFO:teuthology.orchestra.run.smithi092.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:12:19.084 INFO:teuthology.orchestra.run.smithi092.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:12:19.084 INFO:teuthology.orchestra.run.smithi092.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:12:19.085 INFO:teuthology.orchestra.run.smithi092.stdout:Suggested packages: 2024-08-17T02:12:19.085 INFO:teuthology.orchestra.run.smithi092.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:12:19.086 INFO:teuthology.orchestra.run.smithi092.stdout:Recommended packages: 2024-08-17T02:12:19.086 INFO:teuthology.orchestra.run.smithi092.stdout: thermald 2024-08-17T02:12:19.147 INFO:teuthology.orchestra.run.smithi092.stdout:The following NEW packages will be installed: 2024-08-17T02:12:19.147 INFO:teuthology.orchestra.run.smithi092.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:12:19.147 INFO:teuthology.orchestra.run.smithi092.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:12:19.147 INFO:teuthology.orchestra.run.smithi092.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:12:19.148 INFO:teuthology.orchestra.run.smithi092.stdout:The following packages will be upgraded: 2024-08-17T02:12:19.149 INFO:teuthology.orchestra.run.smithi092.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:12:19.225 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-08-17T02:12:19.253 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:12:19.325 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-08-17T02:12:19.329 INFO:teuthology.orchestra.run.smithi092.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:12:19.329 INFO:teuthology.orchestra.run.smithi092.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:12:19.330 INFO:teuthology.orchestra.run.smithi092.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:12:19.330 INFO:teuthology.orchestra.run.smithi092.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:12:19.545 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-08-17T02:12:19.545 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-08-17T02:12:19.753 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2024-08-17T02:12:19.753 INFO:teuthology.orchestra.run.smithi031.stdout: linux-generic linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:12:19.753 INFO:teuthology.orchestra.run.smithi031.stdout: linux-headers-generic linux-image-5.4.0-192-generic 2024-08-17T02:12:19.753 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-5.4.0-192-generic linux-modules-extra-5.4.0-192-generic 2024-08-17T02:12:19.754 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2024-08-17T02:12:19.754 INFO:teuthology.orchestra.run.smithi031.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-08-17T02:12:19.754 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2024-08-17T02:12:19.754 INFO:teuthology.orchestra.run.smithi031.stdout: thermald 2024-08-17T02:12:19.814 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2024-08-17T02:12:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: linux-headers-5.4.0-192 linux-headers-5.4.0-192-generic 2024-08-17T02:12:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-192-generic linux-modules-5.4.0-192-generic 2024-08-17T02:12:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: linux-modules-extra-5.4.0-192-generic 2024-08-17T02:12:19.816 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2024-08-17T02:12:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-17T02:12:19.997 INFO:teuthology.orchestra.run.smithi031.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:12:19.997 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 77.2 MB of archives. 2024-08-17T02:12:19.997 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 381 MB of additional disk space will be used. 2024-08-17T02:12:19.998 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-192-generic amd64 5.4.0-192.212 [15.0 MB] 2024-08-17T02:12:20.508 INFO:teuthology.orchestra.run.smithi092.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:12:20.829 INFO:teuthology.orchestra.run.smithi092.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:12:21.139 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-192-generic amd64 5.4.0-192.212 [10.5 MB] 2024-08-17T02:12:21.461 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-192-generic amd64 5.4.0-192.212 [39.2 MB] 2024-08-17T02:12:22.123 INFO:teuthology.orchestra.run.smithi092.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:12:22.123 INFO:teuthology.orchestra.run.smithi092.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:12:22.123 INFO:teuthology.orchestra.run.smithi092.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:12:22.455 INFO:teuthology.orchestra.run.smithi092.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:12:22.475 INFO:teuthology.orchestra.run.smithi092.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:12:22.759 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.192.190 [1,900 B] 2024-08-17T02:12:22.759 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.192.190 [2,588 B] 2024-08-17T02:12:22.760 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192 all 5.4.0-192.212 [11.0 MB] 2024-08-17T02:12:23.041 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-192-generic amd64 5.4.0-192.212 [1,398 kB] 2024-08-17T02:12:23.086 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.192.190 [2,456 B] 2024-08-17T02:12:23.202 INFO:teuthology.orchestra.run.smithi092.stdout:Fetched 77.2 MB in 3s (23.3 MB/s) 2024-08-17T02:12:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:12:23.782 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 77.2 MB in 3s (23.7 MB/s) 2024-08-17T02:12:23.947 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-modules-5.4.0-192-generic. 2024-08-17T02:12:25.284 INFO:teuthology.orchestra.run.smithi092.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:12:25.289 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:25.433 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:25.600 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-08-17T02:12:25.606 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../0-linux-modules-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:25.669 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:27.300 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:12:27.314 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:27.410 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:27.436 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-image-5.4.0-192-generic. 2024-08-17T02:12:27.450 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../1-linux-image-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:27.535 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:28.470 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:12:28.484 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:28.519 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:28.625 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-192-generic. 2024-08-17T02:12:28.638 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:28.683 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:33.319 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:12:33.409 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../3-linux-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:12:33.435 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:12:33.534 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking linux-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:12:33.746 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:12:33.872 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:12:33.901 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:12:34.030 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking linux-image-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:12:34.225 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:12:34.239 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:12:34.283 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:12:34.391 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package linux-headers-5.4.0-192. 2024-08-17T02:12:34.405 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../5-linux-headers-5.4.0-192_5.4.0-192.212_all.deb ... 2024-08-17T02:12:34.449 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:12:39.880 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:12:39.900 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:39.933 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-headers-5.4.0-192-generic. 2024-08-17T02:12:39.937 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:39.953 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../6-linux-headers-5.4.0-192-generic_5.4.0-192.212_amd64.deb ... 2024-08-17T02:12:39.991 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:42.563 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:12:42.676 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:12:42.931 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.192.190_amd64.deb ... 2024-08-17T02:12:43.027 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:12:43.043 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-headers-generic (5.4.0.192.190) over (5.4.0.124.125) ... 2024-08-17T02:12:43.147 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:43.387 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-5.4.0-192 (5.4.0-192.212) ... 2024-08-17T02:12:43.515 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-modules-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:44.758 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:45.216 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:45.938 INFO:teuthology.orchestra.run.smithi031.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:12:45.938 INFO:teuthology.orchestra.run.smithi031.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:12:46.094 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:46.220 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:46.360 INFO:teuthology.orchestra.run.smithi092.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:12:46.360 INFO:teuthology.orchestra.run.smithi092.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-192-generic 2024-08-17T02:12:46.501 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up linux-headers-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:46.627 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up linux-modules-extra-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:47.812 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:12:47.946 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:12:48.072 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:12:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-generic (5.4.0.192.190) ... 2024-08-17T02:12:48.199 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:48.264 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-headers-generic (5.4.0.192.190) ... 2024-08-17T02:12:48.265 INFO:teuthology.orchestra.run.smithi092.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:12:48.265 INFO:teuthology.orchestra.run.smithi092.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:12:48.391 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-generic (5.4.0.192.190) ... 2024-08-17T02:12:48.518 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for linux-image-5.4.0-192-generic (5.4.0-192.212) ... 2024-08-17T02:12:48.588 INFO:teuthology.orchestra.run.smithi031.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-17T02:12:48.588 INFO:teuthology.orchestra.run.smithi031.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:10.204 INFO:teuthology.orchestra.run.smithi092.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:13:10.205 INFO:teuthology.orchestra.run.smithi092.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:13:10.223 INFO:teuthology.orchestra.run.smithi092.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:13:10.246 INFO:teuthology.orchestra.run.smithi092.stdout:Generating grub configuration file ... 2024-08-17T02:13:10.536 INFO:teuthology.orchestra.run.smithi031.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-17T02:13:10.536 INFO:teuthology.orchestra.run.smithi031.stdout:Sourcing file `/etc/default/grub' 2024-08-17T02:13:10.558 INFO:teuthology.orchestra.run.smithi031.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:13:10.575 INFO:teuthology.orchestra.run.smithi031.stdout:Generating grub configuration file ... 2024-08-17T02:13:10.577 INFO:teuthology.orchestra.run.smithi092.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:10.604 INFO:teuthology.orchestra.run.smithi092.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:10.860 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:10.884 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:10.972 INFO:teuthology.orchestra.run.smithi092.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:13:10.984 INFO:teuthology.orchestra.run.smithi092.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:13:11.259 INFO:teuthology.orchestra.run.smithi031.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:13:11.271 INFO:teuthology.orchestra.run.smithi031.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:13:12.714 INFO:teuthology.orchestra.run.smithi092.stdout:done 2024-08-17T02:13:13.168 DEBUG:teuthology.orchestra.run.smithi092:> dpkg -s linux-image-generic 2024-08-17T02:13:13.219 INFO:teuthology.orchestra.run.smithi092.stdout:Package: linux-image-generic 2024-08-17T02:13:13.219 INFO:teuthology.orchestra.run.smithi092.stdout:Status: install ok installed 2024-08-17T02:13:13.219 INFO:teuthology.orchestra.run.smithi092.stdout:Priority: optional 2024-08-17T02:13:13.219 INFO:teuthology.orchestra.run.smithi092.stdout:Section: kernel 2024-08-17T02:13:13.219 INFO:teuthology.orchestra.run.smithi092.stdout:Installed-Size: 20 2024-08-17T02:13:13.219 INFO:teuthology.orchestra.run.smithi092.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:13:13.219 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: amd64 2024-08-17T02:13:13.220 INFO:teuthology.orchestra.run.smithi092.stdout:Source: linux-meta 2024-08-17T02:13:13.220 INFO:teuthology.orchestra.run.smithi092.stdout:Version: 5.4.0.192.190 2024-08-17T02:13:13.220 INFO:teuthology.orchestra.run.smithi092.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:13:13.220 INFO:teuthology.orchestra.run.smithi092.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:13:13.220 INFO:teuthology.orchestra.run.smithi092.stdout:Recommends: thermald 2024-08-17T02:13:13.220 INFO:teuthology.orchestra.run.smithi092.stdout:Description: Generic Linux kernel image 2024-08-17T02:13:13.220 INFO:teuthology.orchestra.run.smithi092.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:13:13.220 INFO:teuthology.orchestra.run.smithi092.stdout: available. 2024-08-17T02:13:13.220 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:13:13.221 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:13:13.221 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:13:13.221 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-08-17T02:13:13.221 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:13:13.221 DEBUG:teuthology.orchestra.run.smithi092:> sudo apt-get clean 2024-08-17T02:13:13.279 INFO:teuthology.orchestra.run.smithi031.stdout:done 2024-08-17T02:13:13.303 DEBUG:teuthology.orchestra.run.smithi092:> sudo apt-get update 2024-08-17T02:13:13.438 INFO:teuthology.orchestra.run.smithi092.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:13:13.439 INFO:teuthology.orchestra.run.smithi092.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:13:13.444 INFO:teuthology.orchestra.run.smithi092.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:13:13.462 INFO:teuthology.orchestra.run.smithi092.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:13:13.719 DEBUG:teuthology.orchestra.run.smithi031:> dpkg -s linux-image-generic 2024-08-17T02:13:13.768 INFO:teuthology.orchestra.run.smithi031.stdout:Package: linux-image-generic 2024-08-17T02:13:13.768 INFO:teuthology.orchestra.run.smithi031.stdout:Status: install ok installed 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Priority: optional 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Section: kernel 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Installed-Size: 20 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: amd64 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Source: linux-meta 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Version: 5.4.0.192.190 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Recommends: thermald 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout:Description: Generic Linux kernel image 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:13:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: available. 2024-08-17T02:13:13.770 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-192-generic 2024-08-17T02:13:13.770 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-17T02:13:13.770 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-17T02:13:13.770 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-08-17T02:13:13.770 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=None, version=distro) 2024-08-17T02:13:13.770 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get clean 2024-08-17T02:13:13.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2024-08-17T02:13:13.998 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:13:14.006 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:13:14.023 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:13:14.118 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:13:15.264 INFO:teuthology.orchestra.run.smithi092.stdout:Reading package lists... 2024-08-17T02:13:15.291 DEBUG:teuthology.orchestra.run.smithi092:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:13:15.362 INFO:teuthology.orchestra.run.smithi092.stdout:Reading package lists... 2024-08-17T02:13:15.577 INFO:teuthology.orchestra.run.smithi092.stdout:Building dependency tree... 2024-08-17T02:13:15.578 INFO:teuthology.orchestra.run.smithi092.stdout:Reading state information... 2024-08-17T02:13:15.811 INFO:teuthology.orchestra.run.smithi092.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:13:15.811 INFO:teuthology.orchestra.run.smithi092.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:13:15.813 DEBUG:teuthology.orchestra.run.smithi092:> dpkg -s linux-image-generic 2024-08-17T02:13:15.829 INFO:teuthology.orchestra.run.smithi092.stdout:Package: linux-image-generic 2024-08-17T02:13:15.829 INFO:teuthology.orchestra.run.smithi092.stdout:Status: install ok installed 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Priority: optional 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Section: kernel 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Installed-Size: 20 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: amd64 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Source: linux-meta 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Version: 5.4.0.192.190 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Recommends: thermald 2024-08-17T02:13:15.830 INFO:teuthology.orchestra.run.smithi092.stdout:Description: Generic Linux kernel image 2024-08-17T02:13:15.831 INFO:teuthology.orchestra.run.smithi092.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:13:15.831 INFO:teuthology.orchestra.run.smithi092.stdout: available. 2024-08-17T02:13:15.831 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-08-17T02:13:15.836 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.JIUpAm9NAs 2024-08-17T02:13:15.836 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub/grub.cfg /tmp/tmp.JIUpAm9NAs 2024-08-17T02:13:15.846 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.JIUpAm9NAs 2024-08-17T02:13:15.891 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-08-17T02:13:15.918 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-17T02:13:15.922 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.JIUpAm9NAs is 9KB 2024-08-17T02:13:15.936 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.JIUpAm9NAs 2024-08-17T02:13:15.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:13:15.988 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-08-17T02:13:15.996 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:13:15.996 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:13:15.997 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:13:16.027 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:13:16.028 DEBUG:teuthology.orchestra.run.smithi092:> sudo update-grub 2024-08-17T02:13:16.209 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-08-17T02:13:16.210 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-08-17T02:13:16.454 INFO:teuthology.orchestra.run.smithi031.stdout:linux-image-generic is already the newest version (5.4.0.192.190). 2024-08-17T02:13:16.454 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-08-17T02:13:16.456 DEBUG:teuthology.orchestra.run.smithi031:> dpkg -s linux-image-generic 2024-08-17T02:13:16.473 INFO:teuthology.orchestra.run.smithi031.stdout:Package: linux-image-generic 2024-08-17T02:13:16.473 INFO:teuthology.orchestra.run.smithi031.stdout:Status: install ok installed 2024-08-17T02:13:16.473 INFO:teuthology.orchestra.run.smithi031.stdout:Priority: optional 2024-08-17T02:13:16.473 INFO:teuthology.orchestra.run.smithi031.stdout:Section: kernel 2024-08-17T02:13:16.473 INFO:teuthology.orchestra.run.smithi031.stdout:Installed-Size: 20 2024-08-17T02:13:16.474 INFO:teuthology.orchestra.run.smithi031.stdout:Maintainer: Ubuntu Kernel Team 2024-08-17T02:13:16.474 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: amd64 2024-08-17T02:13:16.474 INFO:teuthology.orchestra.run.smithi031.stdout:Source: linux-meta 2024-08-17T02:13:16.474 INFO:teuthology.orchestra.run.smithi031.stdout:Version: 5.4.0.192.190 2024-08-17T02:13:16.474 INFO:teuthology.orchestra.run.smithi031.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-08-17T02:13:16.474 INFO:teuthology.orchestra.run.smithi031.stdout:Depends: linux-image-5.4.0-192-generic, linux-modules-extra-5.4.0-192-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-17T02:13:16.474 INFO:teuthology.orchestra.run.smithi031.stdout:Recommends: thermald 2024-08-17T02:13:16.474 INFO:teuthology.orchestra.run.smithi031.stdout:Description: Generic Linux kernel image 2024-08-17T02:13:16.474 INFO:teuthology.orchestra.run.smithi031.stdout: This package will always depend on the latest generic kernel image 2024-08-17T02:13:16.474 INFO:teuthology.orchestra.run.smithi031.stdout: available. 2024-08-17T02:13:16.475 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-08-17T02:13:16.479 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.59c2g0iqPI 2024-08-17T02:13:16.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub/grub.cfg /tmp/tmp.59c2g0iqPI 2024-08-17T02:13:16.492 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.59c2g0iqPI 2024-08-17T02:13:16.574 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.59c2g0iqPI is 9KB 2024-08-17T02:13:16.587 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.59c2g0iqPI 2024-08-17T02:13:16.593 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-17T02:13:16.652 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:13:16.653 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-17T02:13:16.653 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-17T02:13:16.686 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-192-generic 2024-08-17T02:13:16.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo update-grub 2024-08-17T02:13:17.353 INFO:teuthology.orchestra.run.smithi092.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:13:17.363 INFO:teuthology.orchestra.run.smithi092.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:13:17.372 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2024-08-17T02:13:17.635 INFO:teuthology.orchestra.run.smithi092.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:17.646 INFO:teuthology.orchestra.run.smithi092.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:17.981 INFO:teuthology.orchestra.run.smithi092.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:13:17.992 INFO:teuthology.orchestra.run.smithi092.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:13:18.005 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub' 2024-08-17T02:13:18.014 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-17T02:13:18.032 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-08-17T02:13:18.277 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-192-generic 2024-08-17T02:13:18.289 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-192-generic 2024-08-17T02:13:18.636 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-08-17T02:13:18.646 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-08-17T02:13:18.731 INFO:teuthology.orchestra.run.smithi092.stderr:done 2024-08-17T02:13:18.733 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2024-08-17T02:13:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-08-17T02:13:19.675 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2024-08-17T02:13:48.762 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-08-17T02:13:48.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-08-17T02:13:48.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:49.679 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-08-17T02:13:49.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-08-17T02:13:49.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:07.327 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-08-17T02:14:08.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-08-17T02:14:16.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-08-17T02:14:16.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:17.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-08-17T02:14:17.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:19.390 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-08-17T02:14:31.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-08-17T02:14:31.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:48.979 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-08-17T02:14:49.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-08-17T02:14:49.711 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-192-generic"... 2024-08-17T02:14:49.711 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-08-17T02:14:49.718 INFO:teuthology.orchestra.run.smithi031.stdout:5.4.0-192-generic 2024-08-17T02:14:49.718 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:14:49.718 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:14:49.718 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:14:49.822 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-08-17T02:14:50.720 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-17T02:14:50.720 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:14:50.814 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2024-08-17T02:14:50.850 DEBUG:teuthology.parallel:result is None 2024-08-17T02:15:04.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-08-17T02:15:04.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:04.995 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-08-17T02:15:05.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-08-17T02:15:05.570 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-192-generic"... 2024-08-17T02:15:05.570 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-08-17T02:15:05.576 INFO:teuthology.orchestra.run.smithi092.stdout:5.4.0-192-generic 2024-08-17T02:15:05.577 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-192-generic vs 5.4.0-192-generic 2024-08-17T02:15:05.577 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:15:05.577 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-17T02:15:06.578 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-17T02:15:06.578 DEBUG:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-17T02:15:06.666 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2024-08-17T02:15:06.692 DEBUG:teuthology.parallel:result is None 2024-08-17T02:15:06.692 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:15:06.702 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:15:06.702 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:15:06.705 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:15:06.712 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:15:06.724 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:15:06.734 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:15:06.734 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:15:06.754 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:15:06.773 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:15:06.780 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:15:06.780 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:15:06.782 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:15:06.805 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:06.816 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:06.839 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:06.850 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:15:06.852 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:15:06.859 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:15:06.859 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:15:06.861 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:15:06.876 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:15:06.888 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:15:06.888 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:15:06.922 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:15:06.929 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:15:06.935 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:15:06.940 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:15:06.941 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:15:07.009 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:15:07.016 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:15:07.023 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:15:07.023 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:15:07.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-08-17T02:15:07.056 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-08-17T02:15:07.106 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:15:07.113 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:15:07.114 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:15:07.125 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:15:07.133 DEBUG:teuthology.task.selinux:Excluding smithi031: OS 'ubuntu' does not support SELinux 2024-08-17T02:15:07.133 DEBUG:teuthology.task.selinux:Excluding smithi092: OS 'ubuntu' does not support SELinux 2024-08-17T02:15:07.134 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:15:07.134 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-17T02:15:07.134 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:15:07.134 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:15:07.142 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:15:07.153 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:15:07.154 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi092.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:20:48.779 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com')] 2024-08-17T02:20:48.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-08-17T02:20:48.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:20:48.891 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-08-17T02:20:49.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-08-17T02:20:49.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-08-17T02:20:49.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:20:49.106 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-08-17T02:20:49.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-08-17T02:20:49.232 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:20:49.243 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:20:49.243 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:20:49.244 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:20:49.247 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:20:49.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:20:49.277 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:20:49.278 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: Command line: ntpd -gq 2024-08-17T02:20:49.279 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: proto: precision = 0.090 usec (-23) 2024-08-17T02:20:49.279 INFO:teuthology.orchestra.run.smithi031.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:20:49.279 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:20:49.280 INFO:teuthology.orchestra.run.smithi031.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:20:49.281 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:20:49.281 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:20:49.281 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:20:49.281 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:20:49.281 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: Listen normally on 3 ens1f0 172.21.15.31:123 2024-08-17T02:20:49.281 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: Listen normally on 4 lo [::1]:123 2024-08-17T02:20:49.281 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:caba%4]:123 2024-08-17T02:20:49.281 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:49 ntpd[13512]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:20:49.282 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-08-17T02:20:49.282 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: Command line: ntpd -gq 2024-08-17T02:20:49.282 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: proto: precision = 0.061 usec (-24) 2024-08-17T02:20:49.282 INFO:teuthology.orchestra.run.smithi092.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:20:49.283 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-17T02:20:49.283 INFO:teuthology.orchestra.run.smithi092.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:20:49.284 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: restrict ::: KOD does nothing without LIMITED. 2024-08-17T02:20:49.284 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: Listen and drop on 0 v6wildcard [::]:123 2024-08-17T02:20:49.284 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-17T02:20:49.284 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: Listen normally on 2 lo 127.0.0.1:123 2024-08-17T02:20:49.284 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: Listen normally on 3 enp3s0f1 172.21.15.92:123 2024-08-17T02:20:49.284 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: Listen normally on 4 lo [::1]:123 2024-08-17T02:20:49.284 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cd45%5]:123 2024-08-17T02:20:49.284 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:49 ntpd[13604]: Listening on routing socket on fd #22 for interface updates 2024-08-17T02:20:50.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:50.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:50.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:50.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:50.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:50.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:50.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:50.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:50.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:50.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:50.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:50.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:50 ntpd[13512]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:51.278 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:51 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:51.278 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:51 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:51.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:51 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:51.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:51 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:51.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:51 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:51.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:51 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:51.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:51 ntpd[13604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:51.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:51 ntpd[13604]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:52.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:52.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:52 ntpd[13512]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:52.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:52 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:52.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:52 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:52.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:52 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:52.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:52 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:52.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:52 ntpd[13604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:52.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:52 ntpd[13604]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:53.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:53 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:53.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:53 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:53.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:53 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:53.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:53 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:53.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:53 ntpd[13512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:53.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:53 ntpd[13512]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:53.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:53.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:53 ntpd[13604]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:54.282 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:54.282 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:54.283 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:54.284 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:54 ntpd[13512]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:54.284 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:54 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:54.284 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:54 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:54.285 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:54 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:54.285 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:54 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:54.285 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:54 ntpd[13604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:54.285 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:54 ntpd[13604]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:55.278 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:55 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:55.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:55 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:55.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:55 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:55.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:55 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:55.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:55 ntpd[13512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:55.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:55 ntpd[13512]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:55.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:55.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:55 ntpd[13604]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:56 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:56 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:56.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:56 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:56.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:56 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:56.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:56 ntpd[13512]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:56.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:56 ntpd[13512]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:56.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:56 ntpd[13512]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:56.280 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:56 ntpd[13512]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:56.281 INFO:teuthology.orchestra.run.smithi031.stdout:17 Aug 02:20:56 ntpd[13512]: ntpd: time slew +0.001714 s 2024-08-17T02:20:56.281 INFO:teuthology.orchestra.run.smithi031.stdout:ntpd: time slew +0.001714s 2024-08-17T02:20:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:56 ntpd[13512]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:20:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:17 Aug 02:20:56 ntpd[13512]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:20:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:56 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:56 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:56 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:56 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:56 ntpd[13604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:56 ntpd[13604]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2024-08-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi031.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi031.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi031.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:20:56.366 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: can't open /var/log/ntpstats/rawstats.20240817: Permission denied 2024-08-17T02:20:57.283 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-17T02:20:57.284 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: can't open /var/log/ntpstats/peerstats.20240817: Permission denied 2024-08-17T02:20:57.284 INFO:teuthology.orchestra.run.smithi092.stdout:17 Aug 02:20:57 ntpd[13604]: ntpd: time slew -0.000882 s 2024-08-17T02:20:57.284 INFO:teuthology.orchestra.run.smithi092.stdout:ntpd: time slew -0.000882s 2024-08-17T02:20:57.284 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-17T02:20:57.284 INFO:teuthology.orchestra.run.smithi092.stderr:17 Aug 02:20:57 ntpd[13604]: can't open /var/log/ntpstats/loopstats.20240817: Permission denied 2024-08-17T02:20:57.373 INFO:teuthology.orchestra.run.smithi092.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:20:57.373 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================== 2024-08-17T02:20:57.373 INFO:teuthology.orchestra.run.smithi092.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:20:57.374 INFO:teuthology.orchestra.run.smithi092.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:20:57.374 INFO:teuthology.orchestra.run.smithi092.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:20:57.374 INFO:teuthology.orchestra.run.smithi092.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:20:57.375 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:20:57.385 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:20:57.385 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:20:57.385 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:20:57.385 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:20:57.391 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:20:57.391 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:20:57.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-key list | grep Ceph 2024-08-17T02:20:57.392 DEBUG:teuthology.orchestra.run.smithi092:> sudo apt-key list | grep Ceph 2024-08-17T02:20:57.489 INFO:teuthology.orchestra.run.smithi092.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:20:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-08-17T02:20:57.549 INFO:teuthology.orchestra.run.smithi092.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:20:57.549 INFO:teuthology.orchestra.run.smithi092.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:20:57.550 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:20:57.550 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:20:57.551 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:20:57.566 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-17T02:20:57.566 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph.com (release key) 2024-08-17T02:20:57.567 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-08-17T02:20:57.567 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-08-17T02:20:57.567 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:20:57.698 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:20:57.698 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:20:57.706 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default/ 2024-08-17T02:20:57.706 INFO:teuthology.task.install.deb:Package version is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:20:57.810 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:20:57.810 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:20:57.822 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:20:57.822 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-17T02:20:57.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo apt-get update 2024-08-17T02:20:57.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2024-08-17T02:20:57.985 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:20:57.986 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:20:57.991 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:20:58.008 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:20:58.013 INFO:teuthology.orchestra.run.smithi092.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-08-17T02:20:58.021 INFO:teuthology.orchestra.run.smithi092.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-08-17T02:20:58.038 INFO:teuthology.orchestra.run.smithi092.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-08-17T02:20:58.039 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:20:58.060 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:20:58.066 INFO:teuthology.orchestra.run.smithi092.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal InRelease 2024-08-17T02:20:58.084 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:20:58.088 INFO:teuthology.orchestra.run.smithi092.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-08-17T02:20:58.105 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:20:58.111 INFO:teuthology.orchestra.run.smithi092.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal Release.gpg 2024-08-17T02:20:58.131 INFO:teuthology.orchestra.run.smithi092.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-08-17T02:20:58.133 INFO:teuthology.orchestra.run.smithi092.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:20:58.138 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-08-17T02:20:58.166 INFO:teuthology.orchestra.run.smithi092.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main i386 Packages [3,382 B] 2024-08-17T02:20:58.662 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 28.5 kB in 1s (43.6 kB/s) 2024-08-17T02:20:58.668 INFO:teuthology.orchestra.run.smithi092.stdout:Fetched 28.5 kB in 1s (45.1 kB/s) 2024-08-17T02:20:59.802 INFO:teuthology.orchestra.run.smithi092.stdout:Reading package lists... 2024-08-17T02:20:59.830 DEBUG:teuthology.orchestra.run.smithi092:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:20:59.844 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-08-17T02:20:59.871 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1375-g2577e813-1focal cephadm=17.2.7-1375-g2577e813-1focal ceph-mds=17.2.7-1375-g2577e813-1focal ceph-mgr=17.2.7-1375-g2577e813-1focal ceph-common=17.2.7-1375-g2577e813-1focal ceph-fuse=17.2.7-1375-g2577e813-1focal ceph-test=17.2.7-1375-g2577e813-1focal ceph-volume=17.2.7-1375-g2577e813-1focal radosgw=17.2.7-1375-g2577e813-1focal python3-rados=17.2.7-1375-g2577e813-1focal python3-rgw=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal python3-rbd=17.2.7-1375-g2577e813-1focal libcephfs2=17.2.7-1375-g2577e813-1focal libcephfs-dev=17.2.7-1375-g2577e813-1focal librados2=17.2.7-1375-g2577e813-1focal librbd1=17.2.7-1375-g2577e813-1focal rbd-fuse=17.2.7-1375-g2577e813-1focal python3-cephfs=17.2.7-1375-g2577e813-1focal cephfs-shell=17.2.7-1375-g2577e813-1focal cephfs-top=17.2.7-1375-g2577e813-1focal cephfs-mirror=17.2.7-1375-g2577e813-1focal 2024-08-17T02:20:59.900 INFO:teuthology.orchestra.run.smithi092.stdout:Reading package lists... 2024-08-17T02:20:59.946 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-08-17T02:21:00.117 INFO:teuthology.orchestra.run.smithi092.stdout:Building dependency tree... 2024-08-17T02:21:00.118 INFO:teuthology.orchestra.run.smithi092.stdout:Reading state information... 2024-08-17T02:21:00.178 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-08-17T02:21:00.179 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-08-17T02:21:00.315 INFO:teuthology.orchestra.run.smithi092.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:21:00.316 INFO:teuthology.orchestra.run.smithi092.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:21:00.316 INFO:teuthology.orchestra.run.smithi092.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:21:00.316 INFO:teuthology.orchestra.run.smithi092.stdout:The following additional packages will be installed: 2024-08-17T02:21:00.316 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:21:00.316 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:21:00.317 INFO:teuthology.orchestra.run.smithi092.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:21:00.317 INFO:teuthology.orchestra.run.smithi092.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:21:00.317 INFO:teuthology.orchestra.run.smithi092.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:21:00.317 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:21:00.317 INFO:teuthology.orchestra.run.smithi092.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:21:00.317 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:21:00.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:21:00.319 INFO:teuthology.orchestra.run.smithi092.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:21:00.319 INFO:teuthology.orchestra.run.smithi092.stdout:Suggested packages: 2024-08-17T02:21:00.319 INFO:teuthology.orchestra.run.smithi092.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:21:00.319 INFO:teuthology.orchestra.run.smithi092.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:21:00.319 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:21:00.319 INFO:teuthology.orchestra.run.smithi092.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:21:00.319 INFO:teuthology.orchestra.run.smithi092.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:21:00.319 INFO:teuthology.orchestra.run.smithi092.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:21:00.319 INFO:teuthology.orchestra.run.smithi092.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:21:00.319 INFO:teuthology.orchestra.run.smithi092.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:21:00.320 INFO:teuthology.orchestra.run.smithi092.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:21:00.320 INFO:teuthology.orchestra.run.smithi092.stdout:Recommended packages: 2024-08-17T02:21:00.320 INFO:teuthology.orchestra.run.smithi092.stdout: btrfs-tools 2024-08-17T02:21:00.392 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:21:00.394 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:21:00.394 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:21:00.394 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2024-08-17T02:21:00.394 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-17T02:21:00.394 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-08-17T02:21:00.394 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-08-17T02:21:00.394 INFO:teuthology.orchestra.run.smithi031.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-08-17T02:21:00.394 INFO:teuthology.orchestra.run.smithi031.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-08-17T02:21:00.395 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-08-17T02:21:00.395 INFO:teuthology.orchestra.run.smithi031.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-08-17T02:21:00.396 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:21:00.396 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2024-08-17T02:21:00.396 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-08-17T02:21:00.396 INFO:teuthology.orchestra.run.smithi031.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-08-17T02:21:00.396 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:21:00.396 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:21:00.396 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:21:00.397 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:21:00.397 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:21:00.397 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2024-08-17T02:21:00.397 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:21:00.397 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:21:00.397 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:21:00.397 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:21:00.397 INFO:teuthology.orchestra.run.smithi031.stdout: qttranslations5-l10n socat xmlstarlet 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2024-08-17T02:21:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: btrfs-tools 2024-08-17T02:21:00.443 INFO:teuthology.orchestra.run.smithi092.stdout:The following NEW packages will be installed: 2024-08-17T02:21:00.443 INFO:teuthology.orchestra.run.smithi092.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:21:00.443 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:21:00.443 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:21:00.443 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:21:00.443 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:21:00.443 INFO:teuthology.orchestra.run.smithi092.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:21:00.443 INFO:teuthology.orchestra.run.smithi092.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:21:00.444 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:21:00.444 INFO:teuthology.orchestra.run.smithi092.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:21:00.444 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:21:00.444 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:21:00.444 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:21:00.445 INFO:teuthology.orchestra.run.smithi092.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:21:00.446 INFO:teuthology.orchestra.run.smithi092.stdout:The following packages will be upgraded: 2024-08-17T02:21:00.446 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 librbd1 2024-08-17T02:21:00.526 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2024-08-17T02:21:00.526 INFO:teuthology.orchestra.run.smithi031.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-17T02:21:00.526 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-17T02:21:00.526 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-08-17T02:21:00.526 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-08-17T02:21:00.526 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-08-17T02:21:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-08-17T02:21:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-08-17T02:21:00.527 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-08-17T02:21:00.528 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-08-17T02:21:00.529 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-08-17T02:21:00.529 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-08-17T02:21:00.529 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-08-17T02:21:00.529 INFO:teuthology.orchestra.run.smithi031.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-08-17T02:21:00.529 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2024-08-17T02:21:00.530 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 librbd1 2024-08-17T02:21:00.593 INFO:teuthology.orchestra.run.smithi031.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:21:00.593 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 201 MB of archives. 2024-08-17T02:21:00.594 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:21:00.594 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:21:00.596 INFO:teuthology.orchestra.run.smithi092.stdout:2 upgraded, 114 newly installed, 0 to remove and 295 not upgraded. 2024-08-17T02:21:00.596 INFO:teuthology.orchestra.run.smithi092.stdout:Need to get 201 MB of archives. 2024-08-17T02:21:00.596 INFO:teuthology.orchestra.run.smithi092.stdout:After this operation, 938 MB of additional disk space will be used. 2024-08-17T02:21:00.596 INFO:teuthology.orchestra.run.smithi092.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:21:00.612 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:21:00.619 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:21:00.642 INFO:teuthology.orchestra.run.smithi092.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-08-17T02:21:00.645 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:21:00.674 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:21:00.675 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:21:00.678 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1375-g2577e813-1focal [3,506 kB] 2024-08-17T02:21:00.685 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:21:00.687 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:21:00.705 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:21:00.706 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:21:00.711 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:21:00.724 INFO:teuthology.orchestra.run.smithi092.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-08-17T02:21:00.741 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:21:00.743 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:21:00.751 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:21:00.751 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:21:00.751 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:21:00.753 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:21:00.753 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:21:00.754 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:21:00.754 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:21:00.758 INFO:teuthology.orchestra.run.smithi092.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-08-17T02:21:00.763 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:21:00.763 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:21:00.779 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:21:00.781 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:21:00.782 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:21:00.783 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:21:00.784 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:21:00.786 INFO:teuthology.orchestra.run.smithi092.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:21:00.795 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:21:00.798 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:21:00.812 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:21:00.818 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:21:00.818 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:21:00.819 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:21:00.819 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:21:00.821 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:21:00.824 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:21:00.825 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:21:00.829 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:21:00.830 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:21:00.851 INFO:teuthology.orchestra.run.smithi031.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:21:00.852 INFO:teuthology.orchestra.run.smithi031.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:21:00.852 INFO:teuthology.orchestra.run.smithi031.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:21:00.852 INFO:teuthology.orchestra.run.smithi031.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:21:00.870 INFO:teuthology.orchestra.run.smithi092.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:21:00.885 INFO:teuthology.orchestra.run.smithi092.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-08-17T02:21:00.896 INFO:teuthology.orchestra.run.smithi092.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:21:00.904 INFO:teuthology.orchestra.run.smithi092.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:21:00.904 INFO:teuthology.orchestra.run.smithi092.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:21:00.906 INFO:teuthology.orchestra.run.smithi092.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:21:00.907 INFO:teuthology.orchestra.run.smithi092.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:21:00.912 INFO:teuthology.orchestra.run.smithi031.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1375-g2577e813-1focal [3,560 kB] 2024-08-17T02:21:00.916 INFO:teuthology.orchestra.run.smithi092.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:21:00.932 INFO:teuthology.orchestra.run.smithi031.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:21:00.948 INFO:teuthology.orchestra.run.smithi031.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:21:00.949 INFO:teuthology.orchestra.run.smithi031.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:21:00.961 INFO:teuthology.orchestra.run.smithi031.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:21:00.961 INFO:teuthology.orchestra.run.smithi031.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:21:00.961 INFO:teuthology.orchestra.run.smithi031.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:21:01.016 INFO:teuthology.orchestra.run.smithi092.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-08-17T02:21:01.025 INFO:teuthology.orchestra.run.smithi092.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-08-17T02:21:01.039 INFO:teuthology.orchestra.run.smithi031.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:21:01.039 INFO:teuthology.orchestra.run.smithi031.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1375-g2577e813-1focal [761 kB] 2024-08-17T02:21:01.039 INFO:teuthology.orchestra.run.smithi031.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:21:01.039 INFO:teuthology.orchestra.run.smithi031.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:21:01.040 INFO:teuthology.orchestra.run.smithi031.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:21:01.041 INFO:teuthology.orchestra.run.smithi031.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:21:01.041 INFO:teuthology.orchestra.run.smithi031.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:21:01.042 INFO:teuthology.orchestra.run.smithi031.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:21:01.046 INFO:teuthology.orchestra.run.smithi031.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:21:01.058 INFO:teuthology.orchestra.run.smithi031.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:21:01.060 INFO:teuthology.orchestra.run.smithi031.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1375-g2577e813-1focal [414 kB] 2024-08-17T02:21:01.065 INFO:teuthology.orchestra.run.smithi031.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:21:01.066 INFO:teuthology.orchestra.run.smithi031.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:21:01.067 INFO:teuthology.orchestra.run.smithi031.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1375-g2577e813-1focal [22.6 kB] 2024-08-17T02:21:01.067 INFO:teuthology.orchestra.run.smithi031.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1375-g2577e813-1focal [200 kB] 2024-08-17T02:21:01.070 INFO:teuthology.orchestra.run.smithi092.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-08-17T02:21:01.071 INFO:teuthology.orchestra.run.smithi031.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:21:01.075 INFO:teuthology.orchestra.run.smithi031.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:21:01.076 INFO:teuthology.orchestra.run.smithi031.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:21:01.080 INFO:teuthology.orchestra.run.smithi092.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-08-17T02:21:01.086 INFO:teuthology.orchestra.run.smithi092.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:21:01.088 INFO:teuthology.orchestra.run.smithi031.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1375-g2577e813-1focal [49.1 kB] 2024-08-17T02:21:01.088 INFO:teuthology.orchestra.run.smithi092.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:21:01.091 INFO:teuthology.orchestra.run.smithi031.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:21:01.094 INFO:teuthology.orchestra.run.smithi031.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:21:01.096 INFO:teuthology.orchestra.run.smithi031.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1375-g2577e813-1focal [389 kB] 2024-08-17T02:21:01.104 INFO:teuthology.orchestra.run.smithi031.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1375-g2577e813-1focal [5,612 kB] 2024-08-17T02:21:01.109 INFO:teuthology.orchestra.run.smithi092.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:21:01.131 INFO:teuthology.orchestra.run.smithi031.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:21:01.132 INFO:teuthology.orchestra.run.smithi031.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:21:01.132 INFO:teuthology.orchestra.run.smithi031.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:21:01.132 INFO:teuthology.orchestra.run.smithi031.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:21:01.133 INFO:teuthology.orchestra.run.smithi031.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:21:01.133 INFO:teuthology.orchestra.run.smithi031.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:21:01.145 INFO:teuthology.orchestra.run.smithi031.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:21:01.146 INFO:teuthology.orchestra.run.smithi031.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:21:01.146 INFO:teuthology.orchestra.run.smithi031.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:21:01.148 INFO:teuthology.orchestra.run.smithi031.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:21:01.160 INFO:teuthology.orchestra.run.smithi092.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-08-17T02:21:01.165 INFO:teuthology.orchestra.run.smithi031.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:21:01.165 INFO:teuthology.orchestra.run.smithi092.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-08-17T02:21:01.166 INFO:teuthology.orchestra.run.smithi031.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:21:01.168 INFO:teuthology.orchestra.run.smithi031.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:21:01.170 INFO:teuthology.orchestra.run.smithi031.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:21:01.189 INFO:teuthology.orchestra.run.smithi092.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-08-17T02:21:01.309 INFO:teuthology.orchestra.run.smithi031.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1375-g2577e813-1focal [116 kB] 2024-08-17T02:21:01.314 INFO:teuthology.orchestra.run.smithi092.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-08-17T02:21:01.319 INFO:teuthology.orchestra.run.smithi031.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1375-g2577e813-1focal [478 kB] 2024-08-17T02:21:01.322 INFO:teuthology.orchestra.run.smithi092.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-08-17T02:21:01.329 INFO:teuthology.orchestra.run.smithi031.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1375-g2577e813-1focal [26.9 MB] 2024-08-17T02:21:01.344 INFO:teuthology.orchestra.run.smithi092.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-08-17T02:21:01.352 INFO:teuthology.orchestra.run.smithi092.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-08-17T02:21:01.352 INFO:teuthology.orchestra.run.smithi092.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-08-17T02:21:01.358 INFO:teuthology.orchestra.run.smithi092.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-08-17T02:21:01.361 INFO:teuthology.orchestra.run.smithi092.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-08-17T02:21:01.361 INFO:teuthology.orchestra.run.smithi092.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-08-17T02:21:01.361 INFO:teuthology.orchestra.run.smithi092.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-08-17T02:21:01.422 INFO:teuthology.orchestra.run.smithi092.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-08-17T02:21:01.423 INFO:teuthology.orchestra.run.smithi092.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-08-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi092.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-08-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi092.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-08-17T02:21:01.505 INFO:teuthology.orchestra.run.smithi092.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-08-17T02:21:01.507 INFO:teuthology.orchestra.run.smithi092.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-17T02:21:01.508 INFO:teuthology.orchestra.run.smithi092.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-08-17T02:21:01.509 INFO:teuthology.orchestra.run.smithi092.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-08-17T02:21:01.511 INFO:teuthology.orchestra.run.smithi092.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-08-17T02:21:01.512 INFO:teuthology.orchestra.run.smithi092.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-08-17T02:21:01.585 INFO:teuthology.orchestra.run.smithi092.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-08-17T02:21:01.588 INFO:teuthology.orchestra.run.smithi092.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-08-17T02:21:01.671 INFO:teuthology.orchestra.run.smithi092.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-08-17T02:21:01.675 INFO:teuthology.orchestra.run.smithi092.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-08-17T02:21:01.676 INFO:teuthology.orchestra.run.smithi092.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-08-17T02:21:01.676 INFO:teuthology.orchestra.run.smithi092.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-08-17T02:21:01.677 INFO:teuthology.orchestra.run.smithi092.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-08-17T02:21:01.680 INFO:teuthology.orchestra.run.smithi092.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-08-17T02:21:01.683 INFO:teuthology.orchestra.run.smithi092.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-08-17T02:21:01.684 INFO:teuthology.orchestra.run.smithi092.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-17T02:21:01.748 INFO:teuthology.orchestra.run.smithi092.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-08-17T02:21:01.751 INFO:teuthology.orchestra.run.smithi092.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-08-17T02:21:01.830 INFO:teuthology.orchestra.run.smithi092.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-08-17T02:21:01.832 INFO:teuthology.orchestra.run.smithi092.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-08-17T02:21:01.832 INFO:teuthology.orchestra.run.smithi092.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-08-17T02:21:01.833 INFO:teuthology.orchestra.run.smithi092.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-08-17T02:21:02.171 INFO:teuthology.orchestra.run.smithi092.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:21:02.197 INFO:teuthology.orchestra.run.smithi031.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1375-g2577e813-1focal [5,173 kB] 2024-08-17T02:21:02.241 INFO:teuthology.orchestra.run.smithi092.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-08-17T02:21:02.242 INFO:teuthology.orchestra.run.smithi092.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:21:02.245 INFO:teuthology.orchestra.run.smithi092.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:21:02.260 INFO:teuthology.orchestra.run.smithi092.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:21:02.265 INFO:teuthology.orchestra.run.smithi092.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-08-17T02:21:02.266 INFO:teuthology.orchestra.run.smithi092.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-08-17T02:21:02.270 INFO:teuthology.orchestra.run.smithi031.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1375-g2577e813-1focal [223 kB] 2024-08-17T02:21:02.273 INFO:teuthology.orchestra.run.smithi031.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1375-g2577e813-1focal [157 kB] 2024-08-17T02:21:02.275 INFO:teuthology.orchestra.run.smithi031.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1375-g2577e813-1focal [1,594 kB] 2024-08-17T02:21:02.310 INFO:teuthology.orchestra.run.smithi031.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:21:02.339 INFO:teuthology.orchestra.run.smithi092.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1375-g2577e813-1focal [4,686 kB] 2024-08-17T02:21:02.347 INFO:teuthology.orchestra.run.smithi092.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-08-17T02:21:02.348 INFO:teuthology.orchestra.run.smithi092.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-08-17T02:21:02.349 INFO:teuthology.orchestra.run.smithi092.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-08-17T02:21:02.350 INFO:teuthology.orchestra.run.smithi092.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-08-17T02:21:02.351 INFO:teuthology.orchestra.run.smithi092.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-08-17T02:21:02.352 INFO:teuthology.orchestra.run.smithi092.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-08-17T02:21:02.353 INFO:teuthology.orchestra.run.smithi092.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-08-17T02:21:02.406 INFO:teuthology.orchestra.run.smithi092.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-08-17T02:21:02.407 INFO:teuthology.orchestra.run.smithi092.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-08-17T02:21:02.431 INFO:teuthology.orchestra.run.smithi031.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:21:02.488 INFO:teuthology.orchestra.run.smithi092.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-08-17T02:21:02.493 INFO:teuthology.orchestra.run.smithi092.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-08-17T02:21:02.495 INFO:teuthology.orchestra.run.smithi092.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-08-17T02:21:02.497 INFO:teuthology.orchestra.run.smithi092.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-08-17T02:21:02.498 INFO:teuthology.orchestra.run.smithi092.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-08-17T02:21:02.501 INFO:teuthology.orchestra.run.smithi092.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-08-17T02:21:02.504 INFO:teuthology.orchestra.run.smithi092.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-08-17T02:21:02.504 INFO:teuthology.orchestra.run.smithi092.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-08-17T02:21:02.581 INFO:teuthology.orchestra.run.smithi092.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-08-17T02:21:02.585 INFO:teuthology.orchestra.run.smithi092.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-08-17T02:21:02.597 INFO:teuthology.orchestra.run.smithi092.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1375-g2577e813-1focal [23.1 MB] 2024-08-17T02:21:02.744 INFO:teuthology.orchestra.run.smithi092.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-08-17T02:21:02.746 INFO:teuthology.orchestra.run.smithi092.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-08-17T02:21:02.746 INFO:teuthology.orchestra.run.smithi092.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-08-17T02:21:02.746 INFO:teuthology.orchestra.run.smithi092.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-08-17T02:21:02.747 INFO:teuthology.orchestra.run.smithi092.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-08-17T02:21:02.747 INFO:teuthology.orchestra.run.smithi092.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-08-17T02:21:02.761 INFO:teuthology.orchestra.run.smithi092.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-17T02:21:02.762 INFO:teuthology.orchestra.run.smithi092.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-08-17T02:21:02.788 INFO:teuthology.orchestra.run.smithi092.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-08-17T02:21:02.827 INFO:teuthology.orchestra.run.smithi092.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-08-17T02:21:02.909 INFO:teuthology.orchestra.run.smithi092.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-08-17T02:21:02.909 INFO:teuthology.orchestra.run.smithi092.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-08-17T02:21:02.913 INFO:teuthology.orchestra.run.smithi092.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-08-17T02:21:02.914 INFO:teuthology.orchestra.run.smithi092.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-08-17T02:21:03.109 INFO:teuthology.orchestra.run.smithi031.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:21:03.109 INFO:teuthology.orchestra.run.smithi031.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:21:03.122 INFO:teuthology.orchestra.run.smithi031.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:21:03.139 INFO:teuthology.orchestra.run.smithi031.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:21:03.140 INFO:teuthology.orchestra.run.smithi031.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:21:03.141 INFO:teuthology.orchestra.run.smithi031.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:21:03.290 INFO:teuthology.orchestra.run.smithi031.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:21:03.478 INFO:teuthology.orchestra.run.smithi031.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:21:03.478 INFO:teuthology.orchestra.run.smithi031.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:21:03.940 INFO:teuthology.orchestra.run.smithi092.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1375-g2577e813-1focal [3,944 B] 2024-08-17T02:21:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1375-g2577e813-1focal [871 kB] 2024-08-17T02:21:04.015 INFO:teuthology.orchestra.run.smithi092.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1375-g2577e813-1focal [2,415 kB] 2024-08-17T02:21:04.086 INFO:teuthology.orchestra.run.smithi092.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1375-g2577e813-1focal [81.4 kB] 2024-08-17T02:21:04.088 INFO:teuthology.orchestra.run.smithi092.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1375-g2577e813-1focal [120 kB] 2024-08-17T02:21:04.091 INFO:teuthology.orchestra.run.smithi092.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1375-g2577e813-1focal [6,653 kB] 2024-08-17T02:21:04.542 INFO:teuthology.orchestra.run.smithi092.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1375-g2577e813-1focal [7,886 kB] 2024-08-17T02:21:04.938 INFO:teuthology.orchestra.run.smithi092.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1375-g2577e813-1focal [4,060 B] 2024-08-17T02:21:04.938 INFO:teuthology.orchestra.run.smithi092.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1375-g2577e813-1focal [53.3 MB] 2024-08-17T02:21:05.097 INFO:teuthology.orchestra.run.smithi031.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:21:05.101 INFO:teuthology.orchestra.run.smithi031.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:21:05.106 INFO:teuthology.orchestra.run.smithi031.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:21:05.107 INFO:teuthology.orchestra.run.smithi031.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:21:05.108 INFO:teuthology.orchestra.run.smithi031.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:21:05.108 INFO:teuthology.orchestra.run.smithi031.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:21:05.684 INFO:teuthology.orchestra.run.smithi031.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:21:06.342 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 201 MB in 5s (39.1 MB/s) 2024-08-17T02:21:06.492 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:21:06.550 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:21:06.555 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:21:06.590 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:21:06.893 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:21:06.909 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:21:06.951 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:21:07.140 INFO:teuthology.orchestra.run.smithi092.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1375-g2577e813-1focal [230 kB] 2024-08-17T02:21:07.145 INFO:teuthology.orchestra.run.smithi092.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.7-1375-g2577e813-1focal [241 kB] 2024-08-17T02:21:07.150 INFO:teuthology.orchestra.run.smithi092.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.7-1375-g2577e813-1focal [22.0 kB] 2024-08-17T02:21:07.151 INFO:teuthology.orchestra.run.smithi092.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.7-1375-g2577e813-1focal [13.1 kB] 2024-08-17T02:21:07.152 INFO:teuthology.orchestra.run.smithi092.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1375-g2577e813-1focal [21.9 kB] 2024-08-17T02:21:07.152 INFO:teuthology.orchestra.run.smithi092.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1375-g2577e813-1focal [17.1 MB] 2024-08-17T02:21:07.287 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:21:07.304 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:21:07.346 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:21:07.699 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:21:07.716 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:21:07.824 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:21:07.980 INFO:teuthology.orchestra.run.smithi092.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1375-g2577e813-1focal [80.6 kB] 2024-08-17T02:21:08.169 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:08.319 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:21:08.634 INFO:teuthology.orchestra.run.smithi092.stdout:Fetched 201 MB in 8s (26.7 MB/s) 2024-08-17T02:21:08.798 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-pyperclip. 2024-08-17T02:21:08.854 INFO:teuthology.orchestra.run.smithi092.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141718 files and directories currently installed.) 2024-08-17T02:21:08.858 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-08-17T02:21:08.929 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-08-17T02:21:09.032 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:09.157 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:21:09.224 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-17T02:21:09.240 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-08-17T02:21:09.273 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:21:09.660 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-cmd2. 2024-08-17T02:21:09.679 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-08-17T02:21:09.718 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:21:09.836 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:21:09.858 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:09.894 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:10.113 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-08-17T02:21:10.129 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-08-17T02:21:10.213 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:21:10.231 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:10.242 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:21:10.271 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:10.614 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../004-librbd1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:10.618 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:21:10.635 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:10.674 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:10.742 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking librbd1 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:21:10.953 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:21:10.967 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:11.001 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:11.254 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:21:11.273 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:11.303 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:11.472 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../005-librados2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:11.623 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:21:11.629 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking librados2 (17.2.7-1375-g2577e813-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-08-17T02:21:11.643 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:21:11.681 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:21:11.967 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:21:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:12.034 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:12.325 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libcephfs2. 2024-08-17T02:21:12.341 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../006-libcephfs2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:12.375 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:12.412 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:21:12.429 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:21:12.470 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:21:12.686 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-rados. 2024-08-17T02:21:12.705 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../007-python3-rados_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:12.744 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:12.756 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:21:12.772 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:21:12.806 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:21:13.159 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-17T02:21:13.167 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:21:13.172 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:13.183 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:21:13.214 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:13.225 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:21:13.524 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-cephfs. 2024-08-17T02:21:13.543 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../009-python3-cephfs_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:13.591 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:13.621 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:21:13.636 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:21:13.678 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:21:13.986 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-17T02:21:14.004 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:14.041 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:21:14.044 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:14.056 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:21:14.097 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:21:14.414 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-prettytable. 2024-08-17T02:21:14.475 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2024-08-17T02:21:14.475 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-08-17T02:21:14.585 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:21:14.602 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:21:14.653 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:21:14.769 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-rbd. 2024-08-17T02:21:14.785 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../012-python3-rbd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:14.852 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:15.204 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:21:15.220 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:21:15.230 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-08-17T02:21:15.245 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-08-17T02:21:15.262 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:21:15.312 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:21:15.640 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:21:15.659 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:21:15.698 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:21:15.765 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-08-17T02:21:15.784 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2024-08-17T02:21:15.824 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:21:16.110 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:21:16.128 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:21:16.168 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:21:16.193 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-17T02:21:16.213 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-08-17T02:21:16.325 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:21:16.546 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:21:16.562 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:16.604 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-17T02:21:16.896 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-08-17T02:21:16.938 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:21:17.324 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-17T02:21:17.340 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-08-17T02:21:17.382 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:21:17.582 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:21:17.600 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:17.640 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:17.936 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:21:17.953 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:21:17.961 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-17T02:21:17.977 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:21:18.028 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:21:18.029 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:21:18.339 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:21:18.359 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:18.397 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:18.597 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-17T02:21:18.614 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:21:18.655 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:21:18.825 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:21:18.841 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:18.875 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:19.078 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-17T02:21:19.092 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-08-17T02:21:19.133 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:21:19.587 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-08-17T02:21:19.602 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-08-17T02:21:19.678 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:21:20.048 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package librgw2. 2024-08-17T02:21:20.067 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../022-librgw2_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:20.131 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:20.916 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-rgw. 2024-08-17T02:21:20.932 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../023-python3-rgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:20.999 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:21.404 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package liboath0. 2024-08-17T02:21:21.422 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:21:21.422 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-08-17T02:21:21.438 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:21.469 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-08-17T02:21:21.490 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:21.805 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libradosstriper1. 2024-08-17T02:21:21.821 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../025-libradosstriper1_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:21.880 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:22.359 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:21:22.376 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:21:22.391 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-common. 2024-08-17T02:21:22.410 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../026-ceph-common_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:22.417 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:21:22.441 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:22.829 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:21:22.847 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:21:22.887 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:21:23.224 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:21:23.241 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:21:23.282 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:21:23.534 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:21:23.552 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:23.592 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:23.997 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:21:24.013 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:21:24.055 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:21:24.383 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:21:24.401 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:21:24.441 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:21:24.803 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:21:24.820 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:21:24.861 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:21:24.921 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-base. 2024-08-17T02:21:24.937 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../027-ceph-base_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:24.982 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:25.198 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:21:25.214 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:21:25.256 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:21:25.567 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:21:25.585 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:21:25.625 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:21:25.934 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-cryptography. 2024-08-17T02:21:25.954 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-08-17T02:21:25.970 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:21:25.988 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:21:25.992 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:21:26.028 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:21:26.339 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:21:26.359 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:21:26.397 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:21:26.437 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-openssl. 2024-08-17T02:21:26.453 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2024-08-17T02:21:26.495 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-08-17T02:21:26.759 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:21:26.779 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:21:26.817 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:21:26.857 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-packaging. 2024-08-17T02:21:26.872 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../030-python3-packaging_20.3-1_all.deb ... 2024-08-17T02:21:26.915 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-packaging (20.3-1) ... 2024-08-17T02:21:27.120 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:21:27.137 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:21:27.178 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:21:27.210 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-17T02:21:27.225 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../031-ceph-mgr-modules-core_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:27.278 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:27.497 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:21:27.514 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:21:27.555 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:21:27.739 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-17T02:21:27.754 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../032-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-08-17T02:21:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:21:27.917 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:21:27.933 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:21:27.975 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:21:28.149 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-17T02:21:28.165 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../033-python3-cherrypy3_8.9.1-6_all.deb ... 2024-08-17T02:21:28.207 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:21:28.319 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:21:28.339 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:21:28.377 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:21:28.611 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-natsort. 2024-08-17T02:21:28.628 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../034-python3-natsort_7.0.1-1_all.deb ... 2024-08-17T02:21:28.669 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-08-17T02:21:28.751 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:21:28.771 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:21:28.817 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:21:29.047 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-jwt. 2024-08-17T02:21:29.064 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../035-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-08-17T02:21:29.105 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:21:29.142 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:21:29.160 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:21:29.200 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:21:29.500 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-logutils. 2024-08-17T02:21:29.517 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-7_all.deb ... 2024-08-17T02:21:29.519 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:21:29.542 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:21:29.558 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-08-17T02:21:29.586 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:21:29.911 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-17T02:21:29.928 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../037-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-08-17T02:21:29.943 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:21:29.961 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:21:29.969 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:21:30.002 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:21:30.331 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-mako. 2024-08-17T02:21:30.347 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:21:30.350 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../038-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-08-17T02:21:30.362 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:21:30.389 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:21:30.405 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:21:30.708 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:21:30.717 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-17T02:21:30.724 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:21:30.736 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-17T02:21:30.765 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:21:30.792 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:21:31.102 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:21:31.111 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-17T02:21:31.121 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:21:31.131 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-08-17T02:21:31.160 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:21:31.195 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:21:31.522 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-webob. 2024-08-17T02:21:31.532 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:21:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.5-2_all.deb ... 2024-08-17T02:21:31.549 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:21:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-08-17T02:21:31.591 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:21:31.951 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:21:31.969 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:32.009 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:32.396 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:21:32.413 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:32.454 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:32.767 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-soupsieve. 2024-08-17T02:21:32.787 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../042-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-08-17T02:21:32.818 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:21:33.094 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-bs4. 2024-08-17T02:21:33.110 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../043-python3-bs4_4.8.2-1_all.deb ... 2024-08-17T02:21:33.169 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-08-17T02:21:33.530 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-waitress. 2024-08-17T02:21:33.548 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../044-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-08-17T02:21:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:21:33.651 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:21:33.671 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:33.709 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:34.025 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-tempita. 2024-08-17T02:21:34.044 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../045-python3-tempita_0.5.2-6_all.deb ... 2024-08-17T02:21:34.083 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-08-17T02:21:34.407 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-paste. 2024-08-17T02:21:34.424 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../046-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-08-17T02:21:34.482 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:21:34.523 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:21:34.539 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:34.581 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:34.811 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-17T02:21:34.827 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../047-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-08-17T02:21:34.894 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:21:35.197 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-17T02:21:35.215 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../048-python3-pastedeploy_2.1.0-1_all.deb ... 2024-08-17T02:21:35.255 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:21:35.625 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-webtest. 2024-08-17T02:21:35.641 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../049-python3-webtest_2.0.32-2_all.deb ... 2024-08-17T02:21:35.683 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-08-17T02:21:36.077 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-pecan. 2024-08-17T02:21:36.093 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../050-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-08-17T02:21:36.135 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:21:36.557 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-17T02:21:36.573 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../051-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-08-17T02:21:36.615 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:21:36.718 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph. 2024-08-17T02:21:36.736 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:36.765 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:37.019 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-17T02:21:37.038 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../052-libsqlite3-mod-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:37.098 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:37.101 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:21:37.118 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:37.159 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:37.488 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-mgr. 2024-08-17T02:21:37.505 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../053-ceph-mgr_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:37.564 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:37.621 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:21:37.638 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:37.679 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:38.111 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-mon. 2024-08-17T02:21:38.128 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../054-ceph-mon_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:38.202 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:38.224 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:21:38.243 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:38.281 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:38.618 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:21:38.639 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:21:38.693 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:21:39.089 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-osd. 2024-08-17T02:21:39.107 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../055-ceph-osd_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:39.147 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:39.346 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:21:39.363 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:39.398 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:39.758 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:21:39.774 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:21:39.816 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:21:40.052 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:21:40.072 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:21:40.110 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:21:40.412 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:21:40.429 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:21:40.471 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:21:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:21:40.839 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:21:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:21:41.184 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:21:41.204 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:41.261 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:41.290 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph. 2024-08-17T02:21:41.310 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../056-ceph_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:41.348 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-fuse. 2024-08-17T02:21:41.750 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../057-ceph-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:41.792 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:42.271 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-mds. 2024-08-17T02:21:42.286 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../058-ceph-mds_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:42.320 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:42.547 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:21:42.564 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:21:42.605 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:21:42.933 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:21:42.949 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:21:42.966 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package cephadm. 2024-08-17T02:21:42.982 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../059-cephadm_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:42.991 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:21:43.024 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:43.335 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:21:43.355 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:21:43.377 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-jinja2. 2024-08-17T02:21:43.393 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:21:43.395 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../060-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-08-17T02:21:43.435 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:21:43.804 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-17T02:21:43.820 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../061-ceph-mgr-cephadm_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:43.862 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:44.274 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-17T02:21:44.292 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2024-08-17T02:21:44.332 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-17T02:21:44.626 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libjs-underscore. 2024-08-17T02:21:44.646 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-08-17T02:21:44.653 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:21:44.672 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:21:44.676 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:21:44.711 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:21:44.978 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-08-17T02:21:44.996 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-08-17T02:21:45.053 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:21:45.249 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:21:45.265 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:21:45.306 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:21:45.406 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-routes. 2024-08-17T02:21:45.453 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2024-08-17T02:21:45.481 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-08-17T02:21:45.701 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:21:45.718 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:21:45.759 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:21:45.842 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-17T02:21:45.860 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:45.925 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:46.476 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:21:46.496 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:46.533 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:47.347 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-decorator. 2024-08-17T02:21:47.364 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-08-17T02:21:47.438 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:21:47.703 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:21:47.720 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:21:47.761 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:21:47.774 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-08-17T02:21:47.790 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-08-17T02:21:47.865 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:21:48.056 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:21:48.072 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:21:48.106 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:21:48.493 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:21:48.512 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:21:48.551 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:21:48.661 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-scipy. 2024-08-17T02:21:48.676 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-08-17T02:21:48.718 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-08-17T02:21:48.862 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:21:48.878 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:21:48.938 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:21:49.231 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:21:49.252 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:21:49.289 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:21:49.651 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:21:49.671 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:21:49.709 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:21:50.045 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:21:50.062 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:21:50.103 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:21:50.111 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-08-17T02:21:50.129 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-08-17T02:21:50.190 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:21:50.543 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:21:50.562 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:21:50.601 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:21:50.790 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-joblib. 2024-08-17T02:21:50.806 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2024-08-17T02:21:50.881 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-08-17T02:21:50.895 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:21:50.916 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:21:50.954 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:21:51.307 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:21:51.318 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-sklearn. 2024-08-17T02:21:51.325 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:21:51.334 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-08-17T02:21:51.365 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:21:51.376 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:21:51.946 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:21:51.967 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:52.004 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:52.209 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-17T02:21:52.226 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:52.267 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:52.332 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:21:52.352 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:21:52.390 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:21:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:21:52.777 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:21:52.818 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:21:53.110 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package jq. 2024-08-17T02:21:53.129 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:21:53.168 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:21:53.378 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-cachetools. 2024-08-17T02:21:53.396 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2024-08-17T02:21:53.420 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package socat. 2024-08-17T02:21:53.436 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-08-17T02:21:53.440 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:21:53.478 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:21:53.805 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-17T02:21:53.815 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:21:53.821 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-08-17T02:21:53.833 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:21:53.864 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:21:53.873 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:21:54.245 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:21:54.252 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-17T02:21:54.262 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:54.269 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-08-17T02:21:54.303 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:54.310 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:21:54.680 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-rsa. 2024-08-17T02:21:54.696 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2024-08-17T02:21:54.737 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-rsa (4.0-3) ... 2024-08-17T02:21:55.099 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-google-auth. 2024-08-17T02:21:55.116 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2024-08-17T02:21:55.157 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-08-17T02:21:55.527 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-blinker. 2024-08-17T02:21:55.544 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-08-17T02:21:55.585 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:21:55.855 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-oauthlib. 2024-08-17T02:21:55.874 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-08-17T02:21:55.937 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:21:56.402 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-17T02:21:56.419 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-08-17T02:21:56.460 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:21:56.872 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-websocket. 2024-08-17T02:21:56.889 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-08-17T02:21:56.930 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:21:57.292 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-17T02:21:57.309 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-08-17T02:21:57.351 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:21:57.989 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-17T02:21:58.006 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:58.048 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:58.426 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-17T02:21:58.442 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2024-08-17T02:21:58.484 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:21:58.906 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-17T02:21:58.924 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:21:58.941 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:21:58.959 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:21:58.964 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:21:58.999 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:59.289 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package jq. 2024-08-17T02:21:59.308 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:21:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:21:59.400 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:21:59.418 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:21:59.458 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:21:59.645 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package socat. 2024-08-17T02:21:59.662 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2024-08-17T02:21:59.728 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking socat (1.7.3.3-2) ... 2024-08-17T02:21:59.811 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:21:59.829 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:21:59.869 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:22:00.073 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package xmlstarlet. 2024-08-17T02:22:00.089 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-08-17T02:22:00.122 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:22:00.131 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:22:00.150 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:00.189 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:00.475 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:22:00.492 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:00.528 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-test. 2024-08-17T02:22:00.533 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:00.545 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../090-ceph-test_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:00.585 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:00.788 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:22:00.806 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:22:00.854 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:22:01.358 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:22:01.377 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:01.416 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:01.811 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:22:01.827 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:22:01.895 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:22:02.199 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:22:02.219 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:22:02.257 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:22:03.961 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:22:03.979 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:22:04.019 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:22:04.330 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:22:04.349 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:22:04.389 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:22:04.700 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:22:04.720 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:22:04.758 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:22:05.119 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:22:05.136 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:22:05.177 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:22:05.206 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ceph-volume. 2024-08-17T02:22:05.224 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../091-ceph-volume_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:05.264 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:05.505 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:22:05.525 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:22:05.563 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:22:05.714 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package cephfs-mirror. 2024-08-17T02:22:05.731 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../092-cephfs-mirror_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:05.798 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:05.891 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:22:05.908 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:22:05.949 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:22:06.203 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-colorama. 2024-08-17T02:22:06.223 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2024-08-17T02:22:06.269 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-08-17T02:22:06.386 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:22:06.406 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:22:06.444 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:22:06.538 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package cephfs-shell. 2024-08-17T02:22:06.554 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../094-cephfs-shell_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:06.588 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:06.806 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:22:06.823 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:22:06.855 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:22:06.890 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package cephfs-top. 2024-08-17T02:22:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../095-cephfs-top_17.2.7-1375-g2577e813-1focal_all.deb ... 2024-08-17T02:22:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:07.184 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:22:07.202 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:22:07.234 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package fonts-mathjax. 2024-08-17T02:22:07.241 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:22:07.252 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:22:07.326 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:22:07.620 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:22:07.638 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:22:07.678 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:22:07.871 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-17T02:22:07.888 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../097-libcephfs-dev_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:07.929 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:07.998 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:22:08.017 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:22:08.081 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:22:08.366 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package nvme-cli. 2024-08-17T02:22:08.375 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:22:08.381 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-08-17T02:22:08.396 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:22:08.433 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:22:08.474 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:22:08.795 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:22:08.813 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:22:08.853 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:22:08.862 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libjs-mathjax. 2024-08-17T02:22:08.882 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../099-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-08-17T02:22:08.920 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:22:09.156 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:22:09.174 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:22:09.214 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:22:10.305 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:22:10.323 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:10.365 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:10.711 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python-natsort-doc. 2024-08-17T02:22:10.730 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../100-python-natsort-doc_7.0.1-1_all.deb ... 2024-08-17T02:22:10.769 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-08-17T02:22:11.156 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-atomicwrites. 2024-08-17T02:22:11.176 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../101-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-08-17T02:22:11.214 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:22:11.583 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-attr. 2024-08-17T02:22:11.601 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../102-python3-attr_19.3.0-2_all.deb ... 2024-08-17T02:22:11.641 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-08-17T02:22:12.027 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-webencodings. 2024-08-17T02:22:12.044 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-08-17T02:22:12.085 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:22:12.116 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:22:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:12.174 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:12.438 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-html5lib. 2024-08-17T02:22:12.455 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2024-08-17T02:22:12.488 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-08-17T02:22:12.505 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:22:12.821 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:22:12.883 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-08-17T02:22:12.901 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-08-17T02:22:12.940 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:22:12.947 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:22:13.073 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:22:13.283 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:13.435 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-pastescript. 2024-08-17T02:22:13.452 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-17T02:22:13.510 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-17T02:22:13.847 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-pluggy. 2024-08-17T02:22:13.867 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2024-08-17T02:22:13.914 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user cephadm....done 2024-08-17T02:22:13.930 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-08-17T02:22:14.075 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:22:14.210 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:22:14.266 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-psutil. 2024-08-17T02:22:14.283 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-08-17T02:22:14.324 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:22:14.595 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:22:14.702 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-py. 2024-08-17T02:22:14.720 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-08-17T02:22:14.760 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:22:14.879 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:22:15.005 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:22:15.130 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-17T02:22:15.131 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:22:15.147 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-08-17T02:22:15.188 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:22:15.459 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:22:15.583 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-pytest. 2024-08-17T02:22:15.601 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2024-08-17T02:22:15.663 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-08-17T02:22:15.870 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:22:16.045 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package python3-simplejson. 2024-08-17T02:22:16.104 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-08-17T02:22:16.127 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:22:16.146 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:22:16.433 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-17T02:22:16.439 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:22:16.449 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-08-17T02:22:16.482 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:22:16.732 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:22:17.041 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:22:17.345 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package radosgw. 2024-08-17T02:22:17.350 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:17.362 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../114-radosgw_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:17.394 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:17.643 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:22:17.769 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:22:18.087 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:22:18.388 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:22:18.672 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:22:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:22:19.199 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:22:19.493 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:22:19.785 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:22:19.806 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package rbd-fuse. 2024-08-17T02:22:19.825 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../115-rbd-fuse_17.2.7-1375-g2577e813-1focal_amd64.deb ... 2024-08-17T02:22:19.883 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:20.170 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:22:20.215 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-attr (19.3.0-2) ... 2024-08-17T02:22:20.488 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:22:20.577 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-08-17T02:22:20.705 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-08-17T02:22:20.822 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:22:20.865 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-08-17T02:22:21.091 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:21.123 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:22:21.441 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:22:21.575 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:22:21.701 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:22:21.721 INFO:teuthology.orchestra.run.smithi092.stdout:Adding system user cephadm....done 2024-08-17T02:22:21.907 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:22:22.028 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:22:22.033 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-08-17T02:22:22.420 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-17T02:22:22.453 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:22:22.755 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-08-17T02:22:22.755 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:22:22.881 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-08-17T02:22:23.032 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-08-17T02:22:23.131 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:22:23.388 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-08-17T02:22:23.508 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:22:23.626 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:23.844 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-08-17T02:22:23.952 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:24.112 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:22:24.137 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-08-17T02:22:24.421 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-08-17T02:22:24.495 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:22:24.622 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:22:24.747 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-08-17T02:22:24.748 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:22:25.032 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-08-17T02:22:25.049 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:22:25.324 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-ceph-argparse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:25.393 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:25.552 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:22:25.650 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-08-17T02:22:25.678 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:22:25.776 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-08-17T02:22:26.004 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:22:26.103 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-08-17T02:22:26.322 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:22:26.404 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-08-17T02:22:26.632 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:22:26.722 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-08-17T02:22:26.757 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:22:26.850 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-08-17T02:22:27.086 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:22:27.249 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-08-17T02:22:27.378 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:22:27.608 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-08-17T02:22:27.679 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:22:27.901 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-08-17T02:22:28.110 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:22:28.302 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-08-17T02:22:28.382 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:22:28.508 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:22:28.586 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-08-17T02:22:28.850 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:22:28.954 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-08-17T02:22:29.210 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:22:29.247 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-packaging (20.3-1) ... 2024-08-17T02:22:29.336 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:22:29.478 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:22:29.581 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-08-17T02:22:29.707 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-08-17T02:22:29.796 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:22:29.867 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-08-17T02:22:30.072 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:30.160 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-08-17T02:22:30.223 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:22:30.628 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-08-17T02:22:30.954 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-08-17T02:22:31.347 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-08-17T02:22:31.716 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up socat (1.7.3.3-2) ... 2024-08-17T02:22:31.737 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:31.863 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:22:31.875 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:31.988 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:22:32.243 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:32.356 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:22:32.403 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-08-17T02:22:32.649 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:22:32.762 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-08-17T02:22:32.922 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-08-17T02:22:32.975 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:33.047 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-08-17T02:22:33.093 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:22:33.382 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-08-17T02:22:33.461 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:33.587 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:22:33.700 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:33.851 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-08-17T02:22:33.922 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:34.010 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-08-17T02:22:34.047 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:22:34.329 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-08-17T02:22:34.374 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:22:34.663 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-08-17T02:22:34.956 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-08-17T02:22:35.115 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-17T02:22:35.408 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-08-17T02:22:35.462 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:35.588 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:22:35.722 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:22:35.759 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-08-17T02:22:35.881 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:22:36.007 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:22:36.068 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-08-17T02:22:36.308 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:22:36.434 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:22:36.460 INFO:teuthology.orchestra.run.smithi092.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-08-17T02:22:36.755 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-08-17T02:22:36.829 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:36.914 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-08-17T02:22:36.955 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:37.184 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:22:37.184 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:22:37.254 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-08-17T02:22:37.625 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-08-17T02:22:37.640 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:37.766 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:22:37.776 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-08-17T02:22:37.935 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-08-17T02:22:38.075 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:22:38.286 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-08-17T02:22:38.394 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:22:38.604 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up librados2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:38.730 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-08-17T02:22:38.771 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:38.922 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:39.048 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:39.174 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:39.300 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:39.434 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:22:39.735 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:22:40.028 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:40.154 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:40.252 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:40.280 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:40.404 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:22:40.431 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:22:40.571 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-08-17T02:22:40.989 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-08-17T02:22:41.290 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-08-17T02:22:41.401 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:41.575 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-08-17T02:22:41.734 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-08-17T02:22:41.996 INFO:teuthology.orchestra.run.smithi031.stdout:Adding group ceph....done 2024-08-17T02:22:42.119 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libcephfs2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:42.274 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-08-17T02:22:42.364 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user ceph....done 2024-08-17T02:22:42.565 INFO:teuthology.orchestra.run.smithi031.stdout:Setting system user ceph properties....done 2024-08-17T02:22:42.587 INFO:teuthology.orchestra.run.smithi031.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:22:42.630 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libradosstriper1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:42.735 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:22:42.789 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-08-17T02:22:43.073 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:22:43.155 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-08-17T02:22:43.544 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:43.773 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:43.773 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:44.213 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up librbd1 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:44.229 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:44.372 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-08-17T02:22:44.405 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:44.523 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-08-17T02:22:44.632 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-08-17T02:22:44.728 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:44.729 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:44.783 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-rsa (4.0-3) ... 2024-08-17T02:22:45.170 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-08-17T02:22:45.302 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-08-17T02:22:45.424 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:45.722 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-mgr-modules-core (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:45.838 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:22:45.874 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:46.074 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:22:46.074 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-17T02:22:46.310 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:46.539 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:46.539 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:46.550 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libcephfs-dev (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:46.759 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-08-17T02:22:46.986 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:47.087 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-17T02:22:47.223 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:47.224 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:47.671 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:47.897 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-08-17T02:22:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:48.275 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-rados (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:48.434 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up librgw2 (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:48.593 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up cephfs-top (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:48.664 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:48.720 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-rbd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:48.790 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:48.871 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up rbd-fuse (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:48.916 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:49.022 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-routes (2.4.1-2) ... 2024-08-17T02:22:49.140 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:49.140 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:49.331 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-08-17T02:22:49.600 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:49.691 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-rgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:49.743 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:49.817 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-cephfs (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:49.869 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:49.968 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up cephfs-shell (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:50.011 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:50.119 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-08-17T02:22:50.163 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:22:50.315 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:22:50.641 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:22:51.334 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-common (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:51.950 INFO:teuthology.orchestra.run.smithi092.stdout:Adding group ceph....done 2024-08-17T02:22:52.394 INFO:teuthology.orchestra.run.smithi092.stdout:Adding system user ceph....done 2024-08-17T02:22:52.603 INFO:teuthology.orchestra.run.smithi092.stdout:Setting system user ceph properties....done 2024-08-17T02:22:52.628 INFO:teuthology.orchestra.run.smithi092.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-17T02:22:52.776 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-17T02:22:53.115 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-17T02:22:53.574 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up cephfs-mirror (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:53.611 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:22:53.833 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:53.833 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:22:54.234 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:22:54.238 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:22:54.300 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-test (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:54.310 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-08-17T02:22:54.426 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up radosgw (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:54.532 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-08-17T02:22:54.533 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-08-17T02:22:54.720 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:54.720 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:22:54.758 INFO:teuthology.orchestra.run.smithi031.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:22:54.758 INFO:teuthology.orchestra.run.smithi031.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:22:54.758 INFO:teuthology.orchestra.run.smithi031.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:22:54.758 INFO:teuthology.orchestra.run.smithi031.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:22:54.758 INFO:teuthology.orchestra.run.smithi031.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:22:54.758 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:22:54.759 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:22:54.759 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:22:54.759 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2024-08-17T02:22:54.759 INFO:teuthology.orchestra.run.smithi031.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:22:54.760 INFO:teuthology.orchestra.run.smithi031.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:22:54.760 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:22:54.760 INFO:teuthology.orchestra.run.smithi031.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:22:54.761 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2024-08-17T02:22:54.761 INFO:teuthology.orchestra.run.smithi031.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:22:54.762 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:22:54.815 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2024-08-17T02:22:54.816 INFO:teuthology.orchestra.run.smithi031.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:22:54.816 INFO:teuthology.orchestra.run.smithi031.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:22:54.816 INFO:teuthology.orchestra.run.smithi031.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:22:54.817 INFO:teuthology.orchestra.run.smithi031.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:22:54.818 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2024-08-17T02:22:54.819 INFO:teuthology.orchestra.run.smithi031.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:22:55.021 INFO:teuthology.orchestra.run.smithi031.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:22:55.022 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:22:55.022 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:22:55.022 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:22:55.403 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-base (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:55.636 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:22:55.638 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:22:55.639 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:22:55.651 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:22:55.654 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:22:55.751 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:22:55.753 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:22:55.760 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:22:55.765 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:22:55.766 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:22:55.798 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:22:55.800 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:22:55.803 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:22:55.804 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:22:55.871 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-17T02:22:55.880 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:22:55.880 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:22:55.890 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:22:55.905 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:22:55.905 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:22:55.944 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:22:55.961 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:22:55.983 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:22:56.011 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:22:56.068 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:22:56.081 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:22:56.083 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:22:56.084 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:22:56.084 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:22:56.364 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-mds (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:56.422 INFO:teuthology.orchestra.run.smithi031.stdout:Preconfiguring packages ... 2024-08-17T02:22:56.560 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 10.4 MB in 1s (8,287 kB/s) 2024-08-17T02:22:56.633 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:56.633 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-17T02:22:56.861 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:22:56.866 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:22:57.021 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:22:57.075 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-mgr (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:57.324 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:57.325 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-17T02:22:57.759 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-osd (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:58.145 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:22:58.254 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:58.254 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-17T02:22:58.711 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:58.837 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:59.013 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-mon (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:59.264 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:59.264 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-17T02:22:59.554 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:22:59.559 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:22:59.683 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:22:59.689 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-mgr-cephadm (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:22:59.865 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:00.024 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-mgr-dashboard (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:00.110 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:23:00.167 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ceph-volume (17.2.7-1375-g2577e813-1focal) ... 2024-08-17T02:23:00.272 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:23:00.336 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:23:00.538 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:23:00.634 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:23:00.881 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:23:01.093 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:23:01.098 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:01.305 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:23:01.961 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:02.094 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:23:02.607 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:23:02.740 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:23:03.194 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:23:03.213 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:23:03.243 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:23:03.638 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package dump. 2024-08-17T02:23:03.655 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:23:03.696 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:23:03.742 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-08-17T02:23:04.033 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package indent. 2024-08-17T02:23:04.050 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:04.091 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:23:04.393 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:23:04.396 INFO:teuthology.orchestra.run.smithi092.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:23:04.399 DEBUG:teuthology.orchestra.run.smithi092:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-08-17T02:23:04.413 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:23:04.473 INFO:teuthology.orchestra.run.smithi092.stdout:Reading package lists... 2024-08-17T02:23:04.477 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:23:04.691 INFO:teuthology.orchestra.run.smithi092.stdout:Building dependency tree... 2024-08-17T02:23:04.692 INFO:teuthology.orchestra.run.smithi092.stdout:Reading state information... 2024-08-17T02:23:04.755 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:23:04.775 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:23:04.805 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:23:04.904 INFO:teuthology.orchestra.run.smithi092.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-08-17T02:23:04.904 INFO:teuthology.orchestra.run.smithi092.stdout:flex is already the newest version (2.6.4-6.2). 2024-08-17T02:23:04.904 INFO:teuthology.orchestra.run.smithi092.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-08-17T02:23:04.905 INFO:teuthology.orchestra.run.smithi092.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-08-17T02:23:04.905 INFO:teuthology.orchestra.run.smithi092.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-08-17T02:23:04.905 INFO:teuthology.orchestra.run.smithi092.stdout:The following packages were automatically installed and are no longer required: 2024-08-17T02:23:04.905 INFO:teuthology.orchestra.run.smithi092.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-08-17T02:23:04.906 INFO:teuthology.orchestra.run.smithi092.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-17T02:23:04.906 INFO:teuthology.orchestra.run.smithi092.stdout:The following additional packages will be installed: 2024-08-17T02:23:04.906 INFO:teuthology.orchestra.run.smithi092.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-08-17T02:23:04.906 INFO:teuthology.orchestra.run.smithi092.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2024-08-17T02:23:04.906 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2024-08-17T02:23:04.906 INFO:teuthology.orchestra.run.smithi092.stdout: usb-modeswitch-data wpasupplicant 2024-08-17T02:23:04.908 INFO:teuthology.orchestra.run.smithi092.stdout:Suggested packages: 2024-08-17T02:23:04.908 INFO:teuthology.orchestra.run.smithi092.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2024-08-17T02:23:04.908 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-08-17T02:23:04.960 INFO:teuthology.orchestra.run.smithi092.stdout:The following NEW packages will be installed: 2024-08-17T02:23:04.960 INFO:teuthology.orchestra.run.smithi092.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-08-17T02:23:04.960 INFO:teuthology.orchestra.run.smithi092.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2024-08-17T02:23:04.961 INFO:teuthology.orchestra.run.smithi092.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-08-17T02:23:04.961 INFO:teuthology.orchestra.run.smithi092.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2024-08-17T02:23:04.962 INFO:teuthology.orchestra.run.smithi092.stdout:The following packages will be upgraded: 2024-08-17T02:23:04.963 INFO:teuthology.orchestra.run.smithi092.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-08-17T02:23:05.017 INFO:teuthology.orchestra.run.smithi092.stdout:6 upgraded, 23 newly installed, 0 to remove and 289 not upgraded. 2024-08-17T02:23:05.018 INFO:teuthology.orchestra.run.smithi092.stdout:Need to get 10.4 MB of archives. 2024-08-17T02:23:05.018 INFO:teuthology.orchestra.run.smithi092.stdout:After this operation, 33.5 MB of additional disk space will be used. 2024-08-17T02:23:05.018 INFO:teuthology.orchestra.run.smithi092.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-08-17T02:23:05.116 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:23:05.134 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:05.163 INFO:teuthology.orchestra.run.smithi092.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-08-17T02:23:05.164 INFO:teuthology.orchestra.run.smithi092.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-08-17T02:23:05.165 INFO:teuthology.orchestra.run.smithi092.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-08-17T02:23:05.170 INFO:teuthology.orchestra.run.smithi092.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-08-17T02:23:05.171 INFO:teuthology.orchestra.run.smithi092.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-08-17T02:23:05.173 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:23:05.189 INFO:teuthology.orchestra.run.smithi092.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-08-17T02:23:05.190 INFO:teuthology.orchestra.run.smithi092.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-08-17T02:23:05.191 INFO:teuthology.orchestra.run.smithi092.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-08-17T02:23:05.192 INFO:teuthology.orchestra.run.smithi092.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-08-17T02:23:05.192 INFO:teuthology.orchestra.run.smithi092.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-08-17T02:23:05.197 INFO:teuthology.orchestra.run.smithi092.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-08-17T02:23:05.198 INFO:teuthology.orchestra.run.smithi092.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-08-17T02:23:05.199 INFO:teuthology.orchestra.run.smithi092.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-08-17T02:23:05.199 INFO:teuthology.orchestra.run.smithi092.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-08-17T02:23:05.214 INFO:teuthology.orchestra.run.smithi092.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-08-17T02:23:05.214 INFO:teuthology.orchestra.run.smithi092.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-08-17T02:23:05.220 INFO:teuthology.orchestra.run.smithi092.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-08-17T02:23:05.227 INFO:teuthology.orchestra.run.smithi092.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-08-17T02:23:05.227 INFO:teuthology.orchestra.run.smithi092.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-08-17T02:23:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-08-17T02:23:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-08-17T02:23:05.249 INFO:teuthology.orchestra.run.smithi092.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-08-17T02:23:05.260 INFO:teuthology.orchestra.run.smithi092.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-08-17T02:23:05.274 INFO:teuthology.orchestra.run.smithi092.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-08-17T02:23:05.277 INFO:teuthology.orchestra.run.smithi092.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-08-17T02:23:05.277 INFO:teuthology.orchestra.run.smithi092.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-08-17T02:23:05.278 INFO:teuthology.orchestra.run.smithi092.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-08-17T02:23:05.278 INFO:teuthology.orchestra.run.smithi092.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-08-17T02:23:05.560 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:23:05.578 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:05.596 INFO:teuthology.orchestra.run.smithi092.stdout:Preconfiguring packages ... 2024-08-17T02:23:05.618 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:23:05.759 INFO:teuthology.orchestra.run.smithi092.stdout:Fetched 10.4 MB in 0s (33.9 MB/s) 2024-08-17T02:23:05.879 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:23:05.899 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:05.937 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:23:06.050 INFO:teuthology.orchestra.run.smithi092.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:23:06.054 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:23:06.215 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:23:06.235 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:06.264 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:23:06.311 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:23:06.794 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:23:06.811 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:23:06.852 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:23:07.155 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:23:07.175 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:23:07.213 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:23:07.566 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:23:07.585 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:07.624 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:23:07.636 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-08-17T02:23:07.960 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:23:07.978 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:08.051 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:23:08.304 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:23:08.325 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:23:08.362 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:23:08.857 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:23:08.877 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:23:08.915 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:23:09.120 INFO:teuthology.orchestra.run.smithi092.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:23:09.125 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:23:09.292 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:23:09.318 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:23:09.335 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:09.387 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:23:09.741 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-08-17T02:23:09.940 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-08-17T02:23:10.015 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:23:10.034 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:23:10.090 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:23:10.300 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:23:10.637 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:23:10.654 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:23:10.719 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:23:10.793 INFO:teuthology.orchestra.run.smithi092.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152983 files and directories currently installed.) 2024-08-17T02:23:10.798 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:10.940 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:23:11.476 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ppp. 2024-08-17T02:23:11.495 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:23:11.769 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:23:12.206 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:12.442 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:23:12.462 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:23:12.580 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-08-17T02:23:12.873 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:23:13.072 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:23:13.235 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-08-17T02:23:13.328 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:23:13.346 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:23:13.404 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:23:13.656 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:23:13.674 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:23:13.747 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:23:13.814 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-08-17T02:23:13.831 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-08-17T02:23:13.873 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:23:14.125 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:23:14.143 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:23:14.194 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:23:14.268 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package dump. 2024-08-17T02:23:14.285 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-08-17T02:23:14.334 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking dump (0.4b46-6) ... 2024-08-17T02:23:14.510 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:23:14.705 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package indent. 2024-08-17T02:23:14.722 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-08-17T02:23:14.763 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:23:14.847 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:23:14.964 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:23:15.107 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:23:15.166 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-08-17T02:23:15.186 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-08-17T02:23:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:23:15.542 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:23:15.543 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:23:15.611 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-08-17T02:23:15.628 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-08-17T02:23:15.669 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:23:15.964 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-08-17T02:23:15.983 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-08-17T02:23:15.987 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:23:16.063 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:23:16.113 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:23:16.239 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:23:16.390 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:23:16.391 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-08-17T02:23:16.409 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:16.464 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:23:16.516 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:23:16.642 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:23:16.778 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libmbim-proxy. 2024-08-17T02:23:16.796 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:16.836 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:23:17.231 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-08-17T02:23:17.250 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:17.289 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:23:17.616 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:23:17.864 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:23:17.960 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:23:18.024 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:23:18.034 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libndp0:amd64. 2024-08-17T02:23:18.055 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-08-17T02:23:18.167 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:23:18.293 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:23:18.368 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:23:18.444 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:23:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:23:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:23:18.880 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:23:18.981 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:23:19.123 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libnm0:amd64. 2024-08-17T02:23:19.124 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:23:19.141 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:23:19.181 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:23:19.250 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:23:19.592 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-08-17T02:23:19.612 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:19.642 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:23:19.983 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:19.983 INFO:teuthology.orchestra.run.smithi031.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:23:19.984 INFO:teuthology.orchestra.run.smithi031.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:23:19.984 INFO:teuthology.orchestra.run.smithi031.stdout:- ens1f0 2024-08-17T02:23:19.984 INFO:teuthology.orchestra.run.smithi031.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:23:19.984 INFO:teuthology.orchestra.run.smithi031.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:23:19.984 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:20.012 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libqmi-proxy. 2024-08-17T02:23:20.028 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:20.070 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:23:20.151 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:23:20.397 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-08-17T02:23:20.416 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-08-17T02:23:20.455 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:23:20.490 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:23:21.034 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-08-17T02:23:21.036 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:23:21.051 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2024-08-17T02:23:21.092 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:23:21.545 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:23:21.545 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package modemmanager. 2024-08-17T02:23:21.566 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-08-17T02:23:21.614 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:23:21.671 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:23:21.806 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:23:21.940 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:23:22.051 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:23:22.175 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:23:22.370 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package wpasupplicant. 2024-08-17T02:23:22.389 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-08-17T02:23:22.428 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:23:22.450 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:23:22.450 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:23:22.986 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:23:23.075 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package network-manager. 2024-08-17T02:23:23.095 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-08-17T02:23:23.104 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:23:23.158 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:23:23.240 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:23:23.381 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:23:23.691 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:23:23.957 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package ppp. 2024-08-17T02:23:23.979 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-08-17T02:23:24.533 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:23:25.372 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package pptp-linux. 2024-08-17T02:23:25.389 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-08-17T02:23:25.430 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-08-17T02:23:25.850 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package network-manager-pptp. 2024-08-17T02:23:25.871 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-08-17T02:23:25.926 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-08-17T02:23:26.237 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-08-17T02:23:26.253 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2024-08-17T02:23:26.295 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-08-17T02:23:26.731 INFO:teuthology.orchestra.run.smithi092.stdout:Selecting previously unselected package usb-modeswitch. 2024-08-17T02:23:26.749 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-08-17T02:23:26.800 INFO:teuthology.orchestra.run.smithi092.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:23:27.132 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:23:27.420 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-08-17T02:23:27.554 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-08-17T02:23:27.610 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:23:27.698 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-08-17T02:23:27.701 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:23:28.134 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:23:28.135 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-08-17T02:23:28.575 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:23:28.581 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:28.616 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-08-17T02:23:28.742 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-08-17T02:23:28.893 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-08-17T02:23:29.044 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-08-17T02:23:29.170 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-08-17T02:23:29.330 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-08-17T02:23:30.640 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-08-17T02:23:30.878 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up dump (0.4b46-6) ... 2024-08-17T02:23:30.964 INFO:teuthology.orchestra.run.smithi092.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-08-17T02:23:31.029 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:23:31.189 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-08-17T02:23:31.356 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-08-17T02:23:31.516 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-08-17T02:23:31.717 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-08-17T02:23:31.860 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:23:32.011 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:23:32.120 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-08-17T02:23:32.322 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:23:32.481 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-08-17T02:23:33.259 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:33.259 INFO:teuthology.orchestra.run.smithi092.stdout:The following network interfaces were found in /etc/network/interfaces 2024-08-17T02:23:33.259 INFO:teuthology.orchestra.run.smithi092.stdout:which means they are currently configured by ifupdown: 2024-08-17T02:23:33.259 INFO:teuthology.orchestra.run.smithi092.stdout:- enp3s0f1 2024-08-17T02:23:33.259 INFO:teuthology.orchestra.run.smithi092.stdout:If you want to manage those interfaces with NetworkManager instead 2024-08-17T02:23:33.259 INFO:teuthology.orchestra.run.smithi092.stdout:remove their configuration from /etc/network/interfaces. 2024-08-17T02:23:33.260 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:33.424 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-08-17T02:23:33.746 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-08-17T02:23:34.259 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-08-17T02:23:34.734 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-08-17T02:23:34.902 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-08-17T02:23:35.052 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-08-17T02:23:35.179 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:23:35.782 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-08-17T02:23:35.940 INFO:teuthology.orchestra.run.smithi092.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-08-17T02:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:23:36.215 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-08-17T02:23:36.717 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-08-17T02:23:36.852 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-08-17T02:23:37.003 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-08-17T02:23:37.154 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-08-17T02:23:37.455 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-08-17T02:23:41.216 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-08-17T02:23:41.316 INFO:teuthology.orchestra.run.smithi092.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-08-17T02:23:42.184 INFO:teuthology.orchestra.run.smithi092.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-17T02:23:42.189 DEBUG:teuthology.parallel:result is None 2024-08-17T02:23:42.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:23:42.339 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:23:42.363 INFO:teuthology.orchestra.run.smithi031.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:23:42.364 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:23:42.364 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:23:42.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:23:42.513 DEBUG:teuthology.orchestra.run.smithi092:> dpkg-query -W -f '${Version}' ceph 2024-08-17T02:23:42.537 INFO:teuthology.orchestra.run.smithi092.stdout:17.2.7-1375-g2577e813-1focal 2024-08-17T02:23:42.538 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375-g2577e813-1focal 2024-08-17T02:23:42.538 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375-g2577e813-1focal is installed. 2024-08-17T02:23:42.540 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:23:42.540 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:42.540 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:23:42.558 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:23:42.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:23:42.596 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:23:42.596 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:42.596 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:23:42.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:23:42.629 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:23:42.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:23:42.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:23:42.703 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:23:42.703 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:42.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:23:42.719 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:23:42.777 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:23:42.777 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:23:42.792 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:23:42.851 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:23:42.851 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:42.851 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:23:42.867 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:23:42.925 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:23:42.925 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:23:42.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:23:42.997 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:23:43.073 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:23:43.073 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2024-08-17T02:23:43.076 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2024-08-17T02:23:43.091 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:23:43.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:23:43.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:23:43.107 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:23:43.107 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:23:43.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:23:43.170 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:23:43.170 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:23:43.170 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:23:43.170 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:43.170 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:23:43.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:43.216 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:23:43.216 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:23:43.223 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:23:43.266 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:23:43.266 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:23:43.266 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858255', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi092.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:23:43.267 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:23:43.269 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:23:43.275 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:23:43.277 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:23:43.332 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:43.332 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:23:43.340 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:23:43.341 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-08-17T02:23:43.348 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:23:43.348 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:43.348 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-08-17T02:23:43.348 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:43.348 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-08-17 02:19:20.423512344 +0000 2024-08-17T02:23:43.348 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-08-17 02:19:20.227516862 +0000 2024-08-17T02:23:43.348 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-08-17 02:19:20.227516862 +0000 2024-08-17T02:23:43.348 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-08-17T02:23:43.349 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:23:43.361 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-08-17T02:23:43.361 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-08-17T02:23:43.361 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.00043727 s, 1.2 MB/s 2024-08-17T02:23:43.362 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:23:43.370 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-08-17T02:23:43.376 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:23:43.376 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:43.376 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 364 Links: 1 2024-08-17T02:23:43.376 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:43.376 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-08-17 02:19:20.851502479 +0000 2024-08-17T02:23:43.376 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-08-17 02:19:20.627507643 +0000 2024-08-17T02:23:43.377 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-08-17 02:19:20.627507643 +0000 2024-08-17T02:23:43.377 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-08-17T02:23:43.377 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:23:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-08-17T02:23:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-08-17T02:23:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000400405 s, 1.3 MB/s 2024-08-17T02:23:43.432 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:23:43.440 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-08-17T02:23:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-08-17 02:19:21.315491785 +0000 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-08-17 02:19:21.075497317 +0000 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-08-17 02:19:21.075497317 +0000 2024-08-17T02:23:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-08-17T02:23:43.447 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:23:43.459 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-08-17T02:23:43.460 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-08-17T02:23:43.460 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.00041744 s, 1.2 MB/s 2024-08-17T02:23:43.461 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:23:43.470 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-08-17T02:23:43.517 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:23:43.518 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:43.518 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-08-17T02:23:43.518 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:43.518 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-08-17 02:19:21.783480996 +0000 2024-08-17T02:23:43.518 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-08-17 02:19:21.575485791 +0000 2024-08-17T02:23:43.518 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-08-17 02:19:21.575485791 +0000 2024-08-17T02:23:43.518 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-08-17T02:23:43.518 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:23:43.529 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-08-17T02:23:43.529 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-08-17T02:23:43.529 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000367215 s, 1.4 MB/s 2024-08-17T02:23:43.530 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:23:43.537 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:43.537 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:23:43.537 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:23:43.544 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:23:43.544 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-08-17T02:23:43.596 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:23:43.596 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:43.597 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 342 Links: 1 2024-08-17T02:23:43.597 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:43.597 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-08-17 02:19:20.476897757 +0000 2024-08-17T02:23:43.597 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-08-17 02:19:20.240903195 +0000 2024-08-17T02:23:43.597 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-08-17 02:19:20.240903195 +0000 2024-08-17T02:23:43.598 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2024-08-17T02:23:43.598 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-08-17T02:23:43.608 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-08-17T02:23:43.609 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000426683 s, 1.2 MB/s 2024-08-17T02:23:43.609 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:23:43.618 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-08-17T02:23:43.625 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:23:43.625 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:43.626 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 349 Links: 1 2024-08-17T02:23:43.626 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:43.626 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-08-17 02:19:20.700892597 +0000 2024-08-17T02:23:43.626 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-08-17 02:19:20.696892689 +0000 2024-08-17T02:23:43.626 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-08-17 02:19:20.696892689 +0000 2024-08-17T02:23:43.626 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2024-08-17T02:23:43.626 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:23:43.637 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-08-17T02:23:43.637 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-08-17T02:23:43.638 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000423994 s, 1.2 MB/s 2024-08-17T02:23:43.639 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:23:43.647 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-08-17T02:23:43.699 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:23:43.699 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:43.699 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 357 Links: 1 2024-08-17T02:23:43.699 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:43.699 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-08-17 02:19:21.332878037 +0000 2024-08-17T02:23:43.700 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-08-17 02:19:21.108883197 +0000 2024-08-17T02:23:43.700 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-08-17 02:19:21.108883197 +0000 2024-08-17T02:23:43.700 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2024-08-17T02:23:43.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:23:43.711 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-08-17T02:23:43.712 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-08-17T02:23:43.712 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000418147 s, 1.2 MB/s 2024-08-17T02:23:43.713 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:23:43.722 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-08-17T02:23:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:23:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:23:43.729 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 361 Links: 1 2024-08-17T02:23:43.729 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:23:43.729 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-08-17 02:19:21.552872969 +0000 2024-08-17T02:23:43.729 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-08-17 02:19:21.548873060 +0000 2024-08-17T02:23:43.729 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-08-17 02:19:21.548873060 +0000 2024-08-17T02:23:43.729 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2024-08-17T02:23:43.730 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:23:43.790 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-08-17T02:23:43.791 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-08-17T02:23:43.791 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000378021 s, 1.4 MB/s 2024-08-17T02:23:43.792 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:23:43.799 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:43.799 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:23:43.799 INFO:tasks.ceph:Generating config... 2024-08-17T02:23:43.800 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:23:43.801 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:23:43.801 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:23:43.801 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:23:43.801 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:23:43.801 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:23:43.801 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:23:43.801 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:23:43.801 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:23:43.801 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:23:43.801 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:23:43.801 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:23:43.802 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:23:43.803 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:23:43.804 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:23:43.804 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:23:43.804 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:23:43.804 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:23:43.804 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:23:43.804 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:23:43.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:23:43.839 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:23:43.842 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:23:43.877 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:23:43.892 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31'), ('mon.b', '172.21.15.92'), ('mon.c', '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]')] 2024-08-17T02:23:43.893 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:23:43.894 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:43.894 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:23:43.941 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --add b 172.21.15.92 --addv c '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:43.979 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid bf850b64-aabe-4059-850b-2b80766a6162 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = octopus 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:fsid bf850b64-aabe-4059-850b-2b80766a6162 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2024-08-17T02:23:43.979136+0000 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-08-17T02:23:43.979136+0000 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 15 (octopus) 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:election_strategy: 1 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:1: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:2: [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] mon.c 2024-08-17T02:23:43.980 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:23:43.982 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:23:43.986 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bf850b64-aabe-4059-850b-2b80766a6162... 2024-08-17T02:23:43.987 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:23:44.032 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:23:44.064 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-08-17T02:23:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-08-17T02:23:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:23:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-08-17T02:23:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-08-17T02:23:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-08-17T02:23:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = bf850b64-aabe-4059-850b-2b80766a6162 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-08-17T02:23:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-08-17T02:23:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2024-08-17T02:23:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-08-17T02:23:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: debug finisher = 20 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-08-17T02:23:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-08-17T02:23:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2024-08-17T02:23:44.075 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2024-08-17T02:23:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2024-08-17T02:23:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2024-08-17T02:23:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-08-17T02:23:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2024-08-17T02:23:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2024-08-17T02:23:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2024-08-17T02:23:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2024-08-17T02:23:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-08-17T02:23:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-08-17T02:23:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2024-08-17T02:23:44.078 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.079 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2024-08-17T02:23:44.080 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = "172.21.15.31,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = bf850b64-aabe-4059-850b-2b80766a6162 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2024-08-17T02:23:44.081 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.082 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: bdev async discard = True 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: bdev enable discard = True 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore allocator = bitmap 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2024-08-17T02:23:44.083 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 1/20 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 1/20 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 4/10 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2024-08-17T02:23:44.084 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: debug finisher = 20 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2024-08-17T02:23:44.085 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:23:44.086 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: mon op complaint time = 120 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:23:44.087 INFO:teuthology.orchestra.run.smithi092.stdout: client mount timeout = 600 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = "" 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.b] 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.c] 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout:[mds] 2024-08-17T02:23:44.088 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds = 20 2024-08-17T02:23:44.089 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds balancer = 20 2024-08-17T02:23:44.089 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-08-17T02:23:44.089 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug frag = True 2024-08-17T02:23:44.089 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug scatterstat = True 2024-08-17T02:23:44.089 INFO:teuthology.orchestra.run.smithi092.stdout: mds op complaint time = 180 2024-08-17T02:23:44.089 INFO:teuthology.orchestra.run.smithi092.stdout: mds verify scatter = True 2024-08-17T02:23:44.089 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2024-08-17T02:23:44.089 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2024-08-17T02:23:44.089 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2024-08-17T02:23:44.089 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:23:44.090 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:23:44.140 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:23:44.140 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:44.140 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:23:44.145 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:44.145 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:23:44.151 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:23:44.151 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:44.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:23:44.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:23:44.201 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:23:44.202 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:44.218 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:23:44.218 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:23:44.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:23:44.219 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:23:44.245 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:23:44.245 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:44.251 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:23:44.251 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:23:44.251 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:23:44.308 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:23:44.311 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:23:44.356 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:23:44.358 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:23:44.359 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:23:44.406 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:23:44.407 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:23:44.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:23:44.510 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:23:44.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:23:44.529 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:23:44.575 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:23:44.577 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:23:44.588 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:23:44.630 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:23:44.632 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:23:44.691 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:23:44.691 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:23:44.727 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:23:44.741 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:23:44.819 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:23:44.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:23:44.867 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:23:44.879 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:23:44.911 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:23:44.923 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:23:44.924 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:23:44.924 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:23:44.940 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:44.940 INFO:tasks.ceph:role: osd.0 2024-08-17T02:23:44.940 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:23:44.940 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:23:45.498 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2024-08-17T02:23:45.499 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:45.499 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:45.499 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:23:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:45.499 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:45.500 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-08-17T02:23:45.501 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:23:45.596 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:23:45.609 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:23:45.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:45.610 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:23:45.619 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:45.620 INFO:tasks.ceph:role: osd.1 2024-08-17T02:23:45.620 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:23:45.620 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:23:46.119 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:46.119 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:46.119 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:46.119 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2024-08-17T02:23:46.119 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:46.119 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:46.119 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:46.120 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:23:46.120 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:46.120 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:46.121 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-08-17T02:23:46.121 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:23:46.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:23:46.189 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:23:46.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:46.190 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:23:46.204 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:46.204 INFO:tasks.ceph:role: osd.2 2024-08-17T02:23:46.204 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:23:46.204 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:23:46.697 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2024-08-17T02:23:46.698 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:46.698 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:46.698 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:23:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:46.698 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:46.699 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-08-17T02:23:46.699 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:23:46.740 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:23:46.750 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:23:46.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:46.751 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:23:46.810 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:46.810 INFO:tasks.ceph:role: osd.3 2024-08-17T02:23:46.811 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:23:46.811 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:23:47.312 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:23:47.313 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:23:47.313 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:23:47.313 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 2024-08-17T02:23:47.313 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:23:47.313 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:23:47.313 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:23:47.313 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:23:47.313 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:23:47.313 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:23:47.314 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-08-17T02:23:47.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:23:47.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:23:47.384 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:23:47.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:23:47.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:47.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:47.447+0000 7f4d499df3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:23:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:47.451+0000 7f4d499df3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:23:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:47.451+0000 7f4d499df3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:23:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:47.451+0000 7f4d499df3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:23:47.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:47.451+0000 7f4d499df3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:23:47.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:47.459+0000 7f4d499df3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:23:48.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:48.019+0000 7f4d499df3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:48.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:48.795+0000 7f4d499df3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:49.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:49.587+0000 7f4d499df3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:50.443 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:23:50.461 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:50.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:50.495+0000 7f3a1971f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:23:50.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:50.495+0000 7f3a1971f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:23:50.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:50.495+0000 7f3a1971f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:23:50.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:50.495+0000 7f3a1971f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:23:50.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:50.495+0000 7f3a1971f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:23:50.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:50.495+0000 7f3a1971f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:23:51.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:51.062+0000 7f3a1971f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:51.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:51.846+0000 7f3a1971f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:52.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:52.630+0000 7f3a1971f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:53.491 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:23:53.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:53.586+0000 7f7f3f8393c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:23:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:53.586+0000 7f7f3f8393c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:23:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:53.586+0000 7f7f3f8393c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:23:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:53.586+0000 7f7f3f8393c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:23:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:53.586+0000 7f7f3f8393c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:23:53.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:53.586+0000 7f7f3f8393c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:23:54.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:54.178+0000 7f7f3f8393c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:54.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:54.962+0000 7f7f3f8393c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:55.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:55.738+0000 7f7f3f8393c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:56.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:23:56.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:23:56.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:56.662+0000 7ff761b9b3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:23:56.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:56.666+0000 7ff761b9b3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:23:56.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:56.666+0000 7ff761b9b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:23:56.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:56.666+0000 7ff761b9b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:23:56.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:56.666+0000 7ff761b9b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:23:56.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:56.666+0000 7ff761b9b3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:23:57.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:57.222+0000 7ff761b9b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:58.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:58.006+0000 7ff761b9b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:58.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:23:58.790+0000 7ff761b9b3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:23:59.650 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:23:59.667 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:23:59.684 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:23:59.684 INFO:tasks.ceph:role: osd.4 2024-08-17T02:23:59.684 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:23:59.684 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:24:00.194 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:00.195 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:00.195 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:00.195 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2024-08-17T02:24:00.195 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:00.195 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:00.195 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:00.195 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:24:00.195 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:00.195 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:00.197 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-08-17T02:24:00.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:24:00.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:24:00.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:24:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:24:00.299 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:24:00.310 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:00.311 INFO:tasks.ceph:role: osd.5 2024-08-17T02:24:00.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:24:00.311 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:24:00.842 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:00.843 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:00.843 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:00.843 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2024-08-17T02:24:00.843 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:00.843 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:00.843 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:00.843 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:24:00.843 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:00.843 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:00.844 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-08-17T02:24:00.845 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:24:00.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:24:00.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:24:00.922 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:24:00.922 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:24:00.932 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:00.932 INFO:tasks.ceph:role: osd.6 2024-08-17T02:24:00.932 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:24:00.933 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:24:01.387 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:01.387 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:01.387 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:01.387 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2024-08-17T02:24:01.387 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:01.387 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:01.387 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:01.387 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:24:01.387 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:01.388 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:01.388 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-08-17T02:24:01.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:24:01.439 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:24:01.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:24:01.450 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:24:01.450 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:24:01.467 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:01.467 INFO:tasks.ceph:role: osd.7 2024-08-17T02:24:01.467 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:24:01.467 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:24:01.942 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:01.943 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:01.943 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:01.943 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 2024-08-17T02:24:01.943 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:01.943 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:01.943 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:01.943 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-08-17T02:24:01.943 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:01.943 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:01.944 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-08-17T02:24:01.945 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:24:02.003 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:24:02.015 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: /sbin/restorecon: command not found 2024-08-17T02:24:02.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:24:02.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:02.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:02.137+0000 7fa2f87bc3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:24:02.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:02.137+0000 7fa2f87bc3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:24:02.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:02.137+0000 7fa2f87bc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:24:02.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:02.137+0000 7fa2f87bc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:24:02.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:02.137+0000 7fa2f87bc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:24:02.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:02.141+0000 7fa2f87bc3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:24:02.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:02.705+0000 7fa2f87bc3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:03.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:03.497+0000 7fa2f87bc3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:04.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:04.285+0000 7fa2f87bc3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:05.137 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:24:05.154 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:05.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:05.189+0000 7fe098f103c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:24:05.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:05.193+0000 7fe098f103c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:24:05.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:05.193+0000 7fe098f103c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:24:05.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:05.193+0000 7fe098f103c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:24:05.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:05.193+0000 7fe098f103c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:24:05.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:05.193+0000 7fe098f103c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:24:05.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:05.753+0000 7fe098f103c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:06.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:06.537+0000 7fe098f103c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:07.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:07.321+0000 7fe098f103c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:08.176 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:24:08.192 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:08.277+0000 7f4ed3c7c3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:24:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:08.277+0000 7f4ed3c7c3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:24:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:08.277+0000 7f4ed3c7c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:24:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:08.277+0000 7f4ed3c7c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:24:08.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:08.277+0000 7f4ed3c7c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:24:08.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:08.277+0000 7f4ed3c7c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:24:08.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:08.837+0000 7f4ed3c7c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:09.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:09.621+0000 7f4ed3c7c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:10.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:10.401+0000 7f4ed3c7c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:11.240 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:24:11.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:11.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:11.289+0000 7f7069a8e3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:24:11.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:11.293+0000 7f7069a8e3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:24:11.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:11.293+0000 7f7069a8e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:24:11.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:11.293+0000 7f7069a8e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:24:11.293 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:11.293+0000 7f7069a8e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:24:11.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:11.293+0000 7f7069a8e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:24:11.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:11.845+0000 7f7069a8e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:12.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:12.629+0000 7f7069a8e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:13.268 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:13.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:13.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:13.417+0000 7f7069a8e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:14.268 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:24:14.284 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:24:14.285 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:14.285 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:24:14.301 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:14.301 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:24:14.357 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:14.357 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:24:14.367 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:14.367 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:24:14.378 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:14.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:24:14.436 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:14.436 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:24:14.450 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:14.450 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:24:14.459 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:14.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:24:14.475 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:14.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:24:14.487 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:14.487 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:24:14.545 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:14.545 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:24:14.560 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:14.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:24:14.571 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:14.571 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:24:14.583 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:14.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:24:14.637 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:14.637 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:24:14.644 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:14.645 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:24:14.693 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:14.693 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:24:14.700 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:14.700 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:24:14.707 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:24:14.707 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:24:14.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwCcBmNYpcEhAAT7JRqXXk0qrxOAI+G3Twpw== 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwCcBmWsYMGBAATuy2FpUkK2KxduW8Ss15Ew== 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwCcBmSiBpHhAAe6wj5RSG5BzeoNLwxs8hDQ== 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCzCcBmy2j1GhAA7SQ4FAeLG3CKvTdDXDXqmw== 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC2CcBmS7DNHRAAPAE9sAb9hGJF2pEUGleQOA== 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC5CcBmbUhMIxAAHsmidO5AJbVxgrnp8Pa0Tw== 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQC8CcBmkFruJxAANR31+LcnQAWTyA6Xz/4wdg== 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwCcBm7xxMFRAAoNMMJCQJfZ1I1yaoX4HdxQ== 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwCcBmdz5eIhAAIX9WzIMJQK+oQfgcIiCPAw== 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwCcBmU22hJRAAy0czxaNfvgw2oO+PQSfi2w== 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDCCcBmJzdFCBAAGYzwxSr+uFkycYmCO9H1Pw== 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDFCcBmQpeNCxAA0jiOZAn1WvIvEiX7nIb5LQ== 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDICcBmm5eWEBAAbghTwfKgRZ2vkFhUuffiwQ== 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDLCcBmoV+EERAAO1fzLsabhnmBHbCS9TSPgg== 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwCcBmkNFbKxAAUXw0M96BRSK47th2kqPs5g== 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout:[client.2] 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwCcBmSX7JMBAAhGE8RPlAIA/i5rrP4YULYw== 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2024-08-17T02:24:14.753 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwCcBm+dvEMxAAgUs6zUZ802bVKnD6o1gGSw== 2024-08-17T02:24:14.754 INFO:teuthology.orchestra.run.smithi031.stdout:[client.3] 2024-08-17T02:24:14.754 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCwCcBm9dVrNhAAfCIckPpsaS81diZ5rsWs4g== 2024-08-17T02:24:14.760 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.y] 2024-08-17T02:24:14.760 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCwCcBmNYpcEhAAT7JRqXXk0qrxOAI+G3Twpw== 2024-08-17T02:24:14.760 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2024-08-17T02:24:14.760 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCwCcBmWsYMGBAATuy2FpUkK2KxduW8Ss15Ew== 2024-08-17T02:24:14.760 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2024-08-17T02:24:14.760 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCwCcBmSiBpHhAAe6wj5RSG5BzeoNLwxs8hDQ== 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCzCcBmy2j1GhAA7SQ4FAeLG3CKvTdDXDXqmw== 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQC2CcBmS7DNHRAAPAE9sAb9hGJF2pEUGleQOA== 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQC5CcBmbUhMIxAAHsmidO5AJbVxgrnp8Pa0Tw== 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.3] 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQC8CcBmkFruJxAANR31+LcnQAWTyA6Xz/4wdg== 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCwCcBm7xxMFRAAoNMMJCQJfZ1I1yaoX4HdxQ== 2024-08-17T02:24:14.761 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCwCcBmdz5eIhAAIX9WzIMJQK+oQfgcIiCPAw== 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCwCcBmU22hJRAAy0czxaNfvgw2oO+PQSfi2w== 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.4] 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDCCcBmJzdFCBAAGYzwxSr+uFkycYmCO9H1Pw== 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.5] 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDFCcBmQpeNCxAA0jiOZAn1WvIvEiX7nIb5LQ== 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.6] 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDICcBmm5eWEBAAbghTwfKgRZ2vkFhUuffiwQ== 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.7] 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDLCcBmoV+EERAAO1fzLsabhnmBHbCS9TSPgg== 2024-08-17T02:24:14.762 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2024-08-17T02:24:14.763 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCwCcBmkNFbKxAAUXw0M96BRSK47th2kqPs5g== 2024-08-17T02:24:14.763 INFO:teuthology.orchestra.run.smithi092.stdout:[client.2] 2024-08-17T02:24:14.763 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCwCcBmSX7JMBAAhGE8RPlAIA/i5rrP4YULYw== 2024-08-17T02:24:14.763 INFO:teuthology.orchestra.run.smithi092.stdout:[client.1] 2024-08-17T02:24:14.763 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCwCcBm+dvEMxAAgUs6zUZ802bVKnD6o1gGSw== 2024-08-17T02:24:14.763 INFO:teuthology.orchestra.run.smithi092.stdout:[client.3] 2024-08-17T02:24:14.763 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCwCcBm9dVrNhAAfCIckPpsaS81diZ5rsWs4g== 2024-08-17T02:24:14.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:14.800 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:14.846 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:14.848 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:14.896 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:14.898 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:14.944 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:14.947 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:14.988 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:14.990 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.035 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.121 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.123 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.167 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:15.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:15.211 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:15.213 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:15.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:15.302 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:15.349 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.351 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.393 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.476 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.479 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.522 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:15.609 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:15.612 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:15.658 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:15.661 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:15.705 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:15.707 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:15.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:15.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:15.801 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:24:15.802 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:24:15.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:15.867 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:24:15.880 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:24:15.895 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:15.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:24:16.009 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:24:16.019 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:16.114 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:24:16.126 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:16.128 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:16.133 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:24:16.133 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:24:16.133 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:24:16.135 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:24:16.136 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:24:16.136 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:24:16.138 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:24:16.138 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:24:16.138 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:24:16.140 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:24:16.140 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:24:16.140 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:24:16.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:24:16.143 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:24:16.143 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:24:16.143 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:24:16.145 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:24:16.145 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:24:16.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:24:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.258+0000 7f34ff82b700 1 Processor -- start 2024-08-17T02:24:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.258+0000 7f34ff82b700 1 -- start start 2024-08-17T02:24:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.258+0000 7f34ff82b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.258+0000 7f34ff82b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.258+0000 7f34ff82b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f8063920 con 0x7f34f8156400 2024-08-17T02:24:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.258+0000 7f34ff82b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f80adc20 con 0x7f34f80b08f0 2024-08-17T02:24:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.258+0000 7f34ff82b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f80adf00 con 0x7f34f8069690 2024-08-17T02:24:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.258+0000 7f34fcdc6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fddc8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fcdc6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45136/0 (socket says 172.21.15.31:45136) 2024-08-17T02:24:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fcdc6700 1 -- 172.21.15.31:0/3134794081 learned_addr learned my addr 172.21.15.31:0/3134794081 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fd5c7700 1 --1- 172.21.15.31:0/3134794081 >> v1:172.21.15.92:6789/0 conn(0x7f34f8156400 0x7f34f80b01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:59478/0 (socket says 172.21.15.31:59478) 2024-08-17T02:24:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fcdc6700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 msgr2=0x7f34f80ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:24:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fcdc6700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 msgr2=0x7f34f80ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:24:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fddc8700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 msgr2=0x7f34f80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:24:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fddc8700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 msgr2=0x7f34f80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.262+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:24:16.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.462+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.462+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.462+0000 7f34fcdc6700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 msgr2=0x7f34f80ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:24:16.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.462+0000 7f34fcdc6700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 msgr2=0x7f34f80ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:16.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.462+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:16.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.462+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:24:16.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.462+0000 7f34fddc8700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 msgr2=0x7f34f80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:24:16.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.462+0000 7f34fddc8700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 msgr2=0x7f34f80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:16.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.462+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:16.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.462+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:24:16.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.862+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.862+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:16.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.862+0000 7f34fcdc6700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 msgr2=0x7f34f80ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:24:16.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.862+0000 7f34fcdc6700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 msgr2=0x7f34f80ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:16.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.862+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:16.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.862+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:24:16.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.862+0000 7f34fddc8700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 msgr2=0x7f34f80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:24:16.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.862+0000 7f34fddc8700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 msgr2=0x7f34f80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:16.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.862+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:16.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:16.862+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:24:17.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:17.662+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:17.662+0000 7f34fcdc6700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 msgr2=0x7f34f80ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:24:17.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:17.662+0000 7f34fcdc6700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 msgr2=0x7f34f80ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:17.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:17.662+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:17.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:17.662+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:17.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:17.666+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:24:17.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:17.666+0000 7f34fddc8700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 msgr2=0x7f34f80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:24:17.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:17.666+0000 7f34fddc8700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 msgr2=0x7f34f80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:17.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:17.666+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:17.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:17.666+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:24:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.258+0000 7f34eeffd700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 msgr2=0x7f34f80c8a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.258+0000 7f34eeffd700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.92:3300/0 conn(0x7f34f8069690 0x7f34f80c8a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.258+0000 7f34eeffd700 1 -- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 msgr2=0x7f34f80ad610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.258+0000 7f34eeffd700 1 --2- 172.21.15.31:0/3134794081 >> v2:172.21.15.31:3300/0 conn(0x7f34f80b08f0 0x7f34f80ad610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.258+0000 7f34eeffd700 1 -- 172.21.15.31:0/3134794081 >> v1:172.21.15.92:6789/0 conn(0x7f34f8156400 legacy=0x7f34f80b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.258+0000 7f34eeffd700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.262+0000 7f34eeffd700 1 -- 172.21.15.31:0/3134794081 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80ae1e0 con 0x7f34dc006190 2024-08-17T02:24:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.262+0000 7f34eeffd700 1 -- 172.21.15.31:0/3134794081 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80adc20 con 0x7f34dc0036e0 2024-08-17T02:24:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.262+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.262+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 msgr2=0x7f34dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:24:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.262+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 msgr2=0x7f34dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.262+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:19.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.262+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:24:19.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.462+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.462+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 msgr2=0x7f34dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:24:19.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.462+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 msgr2=0x7f34dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:19.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.462+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:19.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.462+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.862+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.862+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 msgr2=0x7f34dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.862+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 msgr2=0x7f34dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.862+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:19.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:19.862+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:24:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:20.666+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:20.666+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 msgr2=0x7f34dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:24:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:20.666+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 msgr2=0x7f34dc005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:20.666+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:20.666+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:24:21.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.342+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100281726 0 0) 0x7f34f80ae1e0 con 0x7f34dc006190 2024-08-17T02:24:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.342+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e4003570 con 0x7f34dc006190 2024-08-17T02:24:21.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621304503 0 0) 0x7f34e4003570 con 0x7f34dc006190 2024-08-17T02:24:21.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 msgr2=0x7f34dc005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:21.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34dc0036e0 0x7f34dc005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc00af50 con 0x7f34dc006190 2024-08-17T02:24:21.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f34e800c2f0 con 0x7f34dc006190 2024-08-17T02:24:21.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 >> v1:172.21.15.31:6789/0 conn(0x7f34dc006190 legacy=0x7f34dc008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34fddc8700 1 -- 172.21.15.31:0/3134794081 reap_dead start 2024-08-17T02:24:21.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e4003a60 0x7f34e4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4004810 0x7f34e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34e40052e0 0x7f34e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80adc20 con 0x7f34e4004810 2024-08-17T02:24:21.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e400c250 con 0x7f34e40052e0 2024-08-17T02:24:21.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e400c410 con 0x7f34e4003a60 2024-08-17T02:24:21.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e4003a60 0x7f34e4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34fddc8700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34e40052e0 0x7f34e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.346+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4004810 0x7f34e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.350+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34e40052e0 msgr2=0x7f34e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:21.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.350+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34e40052e0 0x7f34e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.350+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4004810 msgr2=0x7f34e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:21.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.350+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4004810 0x7f34e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.350+0000 7f34fd5c7700 1 -- 172.21.15.31:0/3134794081 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4003570 con 0x7f34e4003a60 2024-08-17T02:24:21.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.350+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4004810 0x7f34e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:21.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.350+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e4003a60 0x7f34e4003e50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34f40070d0 tx=0x7f34f4009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=639bd5aa8963b134 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:21.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4016490 con 0x7f34e4003a60 2024-08-17T02:24:21.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f40165f0 con 0x7f34e4003a60 2024-08-17T02:24:21.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34effff700 1 -- 172.21.15.31:0/3134794081 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4016780 con 0x7f34e4003a60 2024-08-17T02:24:21.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34ff82b700 1 -- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e4003a60 msgr2=0x7f34e4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34ff82b700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e4003a60 0x7f34e4003e50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34f40070d0 tx=0x7f34f4009040 comp rx=0 tx=0).stop 2024-08-17T02:24:21.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34ff82b700 1 -- 172.21.15.31:0/3134794081 shutdown_connections 2024-08-17T02:24:21.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34ff82b700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34e40052e0 0x7f34e400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34ff82b700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4004810 0x7f34e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34ff82b700 1 --2- 172.21.15.31:0/3134794081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e4003a60 0x7f34e4003e50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34ff82b700 1 -- 172.21.15.31:0/3134794081 >> 172.21.15.31:0/3134794081 conn(0x7f34f8067ed0 msgr2=0x7f34f8068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:21.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34ff82b700 1 -- 172.21.15.31:0/3134794081 shutdown_connections 2024-08-17T02:24:21.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.354+0000 7f34ff82b700 1 -- 172.21.15.31:0/3134794081 wait complete. 2024-08-17T02:24:21.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ff82b700 1 Processor -- start 2024-08-17T02:24:21.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ff82b700 1 -- start start 2024-08-17T02:24:21.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ff82b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4003a60 0x7f34f80a7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ff82b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34e4004810 0x7f34f80ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ff82b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e40052e0 0x7f34f8168410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ff82b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8169370 con 0x7f34e4003a60 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ff82b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80a6db0 con 0x7f34e4004810 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ff82b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8169090 con 0x7f34e40052e0 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fd5c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4003a60 0x7f34f80a7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fd5c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4003a60 0x7f34f80a7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54620/0 (socket says 172.21.15.31:54620) 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fd5c7700 1 -- 172.21.15.31:0/2916279585 learned_addr learned my addr 172.21.15.31:0/2916279585 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fddc8700 1 --2- 172.21.15.31:0/2916279585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e40052e0 0x7f34f8168410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fcdc6700 1 --2- 172.21.15.31:0/2916279585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34e4004810 0x7f34f80ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fd5c7700 1 -- 172.21.15.31:0/2916279585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e40052e0 msgr2=0x7f34f8168410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/2916279585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e40052e0 0x7f34f8168410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fd5c7700 1 -- 172.21.15.31:0/2916279585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34e4004810 msgr2=0x7f34f80ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/2916279585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34e4004810 0x7f34f80ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fd5c7700 1 -- 172.21.15.31:0/2916279585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f80a6760 con 0x7f34e4003a60 2024-08-17T02:24:21.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fddc8700 1 --2- 172.21.15.31:0/2916279585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e40052e0 0x7f34f8168410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:21.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34fd5c7700 1 --2- 172.21.15.31:0/2916279585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4003a60 0x7f34f80a7240 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c5a0 tx=0x7f34f401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:21.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ed7fa700 1 -- 172.21.15.31:0/2916279585 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4027070 con 0x7f34e4003a60 2024-08-17T02:24:21.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ed7fa700 1 -- 172.21.15.31:0/2916279585 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f4016760 con 0x7f34e4003a60 2024-08-17T02:24:21.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ed7fa700 1 -- 172.21.15.31:0/2916279585 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4017d70 con 0x7f34e4003a60 2024-08-17T02:24:21.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.358+0000 7f34ff82b700 1 -- 172.21.15.31:0/2916279585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f80a6a40 con 0x7f34e4003a60 2024-08-17T02:24:21.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.362+0000 7f34ff82b700 1 -- 172.21.15.31:0/2916279585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f80abf80 con 0x7f34e4003a60 2024-08-17T02:24:21.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.362+0000 7f34ed7fa700 1 -- 172.21.15.31:0/2916279585 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f34f4020630 con 0x7f34e4003a60 2024-08-17T02:24:21.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.362+0000 7f34ed7fa700 1 -- 172.21.15.31:0/2916279585 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f34f402c7b0 con 0x7f34e4003a60 2024-08-17T02:24:21.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.362+0000 7f34ff82b700 1 -- 172.21.15.31:0/2916279585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f80712b0 con 0x7f34e4003a60 2024-08-17T02:24:21.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.366+0000 7f34ed7fa700 1 -- 172.21.15.31:0/2916279585 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f34f4031060 con 0x7f34e4003a60 2024-08-17T02:24:21.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.434+0000 7f34ff82b700 1 -- 172.21.15.31:0/2916279585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f34f8153660 con 0x7f34e4003a60 2024-08-17T02:24:21.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.442+0000 7f34ed7fa700 1 -- 172.21.15.31:0/2916279585 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f34f401b020 con 0x7f34e4003a60 2024-08-17T02:24:21.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.442+0000 7f34ff82b700 1 -- 172.21.15.31:0/2916279585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4003a60 msgr2=0x7f34f80a7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.442+0000 7f34ff82b700 1 --2- 172.21.15.31:0/2916279585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4003a60 0x7f34f80a7240 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c5a0 tx=0x7f34f401d000 comp rx=0 tx=0).stop 2024-08-17T02:24:21.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.442+0000 7f34ff82b700 1 -- 172.21.15.31:0/2916279585 shutdown_connections 2024-08-17T02:24:21.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.442+0000 7f34ff82b700 1 --2- 172.21.15.31:0/2916279585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34e40052e0 0x7f34f8168410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.442+0000 7f34ff82b700 1 --2- 172.21.15.31:0/2916279585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34e4004810 0x7f34f80ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.442+0000 7f34ff82b700 1 --2- 172.21.15.31:0/2916279585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34e4003a60 0x7f34f80a7240 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.442+0000 7f34ff82b700 1 -- 172.21.15.31:0/2916279585 >> 172.21.15.31:0/2916279585 conn(0x7f34f8067ed0 msgr2=0x7f34f81529a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:21.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.442+0000 7f34ff82b700 1 -- 172.21.15.31:0/2916279585 shutdown_connections 2024-08-17T02:24:21.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:21.442+0000 7f34ff82b700 1 -- 172.21.15.31:0/2916279585 wait complete. 2024-08-17T02:24:21.449 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-08-17T02:24:21.461 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:24:21.461 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:21.462 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:24:21.477 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:21.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:24:21.488 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:21.488 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:24:21.504 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-08-17T02:24:21.504 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:24:21.545 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:21.538+0000 7ffb2942b000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:24:21.545 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:21.544+0000 7f3dc9186000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:24:21.559 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:21.559 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:24:21.576 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:21.576 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:24:21.631 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:21.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:24:21.643 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-08-17T02:24:21.643 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:24:21.653 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 42911858-f622-4393-a38f-5b041577bfe4 0 2024-08-17T02:24:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.800+0000 7f349f84b700 1 Processor -- start 2024-08-17T02:24:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.800+0000 7f349f84b700 1 -- start start 2024-08-17T02:24:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.800+0000 7f349f84b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3498156070 0x7f3498067dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.800+0000 7f349f84b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156440 0x7f349806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.800+0000 7f349f84b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f349806e9e0 con 0x7f34980aed10 2024-08-17T02:24:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.800+0000 7f349f84b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34980684a0 con 0x7f3498156070 2024-08-17T02:24:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.800+0000 7f349f84b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3498068780 con 0x7f3498156440 2024-08-17T02:24:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.800+0000 7f349cde6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156440 0x7f349806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.800+0000 7f349cde6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156440 0x7f349806dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:49638/0 (socket says 172.21.15.92:49638) 2024-08-17T02:24:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.800+0000 7f349cde6700 1 -- 172.21.15.92:0/1680097214 learned_addr learned my addr 172.21.15.92:0/1680097214 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349d5e7700 1 --2- 172.21.15.92:0/1680097214 >> v2:172.21.15.31:3300/0 conn(0x7f3498156070 0x7f3498067dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349cde6700 1 -- 172.21.15.92:0/1680097214 >> v2:172.21.15.31:3300/0 conn(0x7f3498156070 msgr2=0x7f3498067dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349cde6700 1 --2- 172.21.15.92:0/1680097214 >> v2:172.21.15.31:3300/0 conn(0x7f3498156070 0x7f3498067dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349cde6700 1 -- 172.21.15.92:0/1680097214 >> v1:172.21.15.31:6789/0 conn(0x7f34980aed10 legacy=0x7f3498159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349cde6700 1 -- 172.21.15.92:0/1680097214 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3498068a60 con 0x7f3498156440 2024-08-17T02:24:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349cde6700 1 --2- 172.21.15.92:0/1680097214 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156440 0x7f349806dc00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34940099b0 tx=0x7f3494009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851deba9ca402f95 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f348bfff700 1 -- 172.21.15.92:0/1680097214 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494009ea0 con 0x7f3498156440 2024-08-17T02:24:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f348bfff700 1 -- 172.21.15.92:0/1680097214 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349400b860 con 0x7f3498156440 2024-08-17T02:24:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f348bfff700 1 -- 172.21.15.92:0/1680097214 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400bc00 con 0x7f3498156440 2024-08-17T02:24:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349f84b700 1 -- 172.21.15.92:0/1680097214 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156440 msgr2=0x7f349806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349f84b700 1 --2- 172.21.15.92:0/1680097214 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156440 0x7f349806dc00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34940099b0 tx=0x7f3494009250 comp rx=0 tx=0).stop 2024-08-17T02:24:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349f84b700 1 -- 172.21.15.92:0/1680097214 shutdown_connections 2024-08-17T02:24:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349f84b700 1 --2- 172.21.15.92:0/1680097214 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156440 0x7f349806dc00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349f84b700 1 --2- 172.21.15.92:0/1680097214 >> v2:172.21.15.31:3300/0 conn(0x7f3498156070 0x7f3498067dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349f84b700 1 -- 172.21.15.92:0/1680097214 >> 172.21.15.92:0/1680097214 conn(0x7f34980cc720 msgr2=0x7f34980ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349f84b700 1 -- 172.21.15.92:0/1680097214 shutdown_connections 2024-08-17T02:24:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.804+0000 7f349f84b700 1 -- 172.21.15.92:0/1680097214 wait complete. 2024-08-17T02:24:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 Processor -- start 2024-08-17T02:24:21.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 -- start start 2024-08-17T02:24:21.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34980aed10 0x7f34980c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156070 0x7f3498151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3498156440 0x7f349814b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3498152630 con 0x7f3498156440 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3498152910 con 0x7f34980aed10 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3498152bf0 con 0x7f3498156070 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349d5e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34980aed10 0x7f34980c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349cde6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156070 0x7f3498151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349d5e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34980aed10 0x7f34980c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52564/0 (socket says 172.21.15.92:52564) 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349d5e7700 1 -- 172.21.15.92:0/364676565 learned_addr learned my addr 172.21.15.92:0/364676565 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349dde8700 1 --2- 172.21.15.92:0/364676565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3498156440 0x7f349814b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349cde6700 1 -- 172.21.15.92:0/364676565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34980aed10 msgr2=0x7f34980c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349cde6700 1 --2- 172.21.15.92:0/364676565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34980aed10 0x7f34980c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349cde6700 1 -- 172.21.15.92:0/364676565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3498156440 msgr2=0x7f349814b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349cde6700 1 --2- 172.21.15.92:0/364676565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3498156440 0x7f349814b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349cde6700 1 -- 172.21.15.92:0/364676565 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940094f0 con 0x7f3498156070 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349dde8700 1 --2- 172.21.15.92:0/364676565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3498156440 0x7f349814b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349d5e7700 1 --2- 172.21.15.92:0/364676565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34980aed10 0x7f34980c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349cde6700 1 --2- 172.21.15.92:0/364676565 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156070 0x7f3498151dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3498068f20 tx=0x7f3494017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f34897fa700 1 -- 172.21.15.92:0/364676565 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400bbe0 con 0x7f3498156070 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f34897fa700 1 -- 172.21.15.92:0/364676565 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349401a450 con 0x7f3498156070 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 -- 172.21.15.92:0/364676565 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3498152ed0 con 0x7f3498156070 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f34897fa700 1 -- 172.21.15.92:0/364676565 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349401a7f0 con 0x7f3498156070 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 -- 172.21.15.92:0/364676565 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3498152310 con 0x7f3498156070 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f34897fa700 1 -- 172.21.15.92:0/364676565 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f349401abe0 con 0x7f3498156070 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f34897fa700 1 -- 172.21.15.92:0/364676565 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f349402eae0 con 0x7f3498156070 2024-08-17T02:24:21.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.808+0000 7f349f84b700 1 -- 172.21.15.92:0/364676565 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3498153d60 con 0x7f3498156070 2024-08-17T02:24:21.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.812+0000 7f34897fa700 1 -- 172.21.15.92:0/364676565 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f3494029070 con 0x7f3498156070 2024-08-17T02:24:21.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.884+0000 7f349f84b700 1 -- 172.21.15.92:0/364676565 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "42911858-f622-4393-a38f-5b041577bfe4", "id": 0} v 0) v1 -- 0x7f34980712b0 con 0x7f3498156070 2024-08-17T02:24:21.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.892+0000 7f34897fa700 1 -- 172.21.15.92:0/364676565 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42911858-f622-4393-a38f-5b041577bfe4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3494015020 con 0x7f3498156070 2024-08-17T02:24:21.895 INFO:teuthology.orchestra.run.smithi092.stdout:0 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.892+0000 7f349f84b700 1 -- 172.21.15.92:0/364676565 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156070 msgr2=0x7f3498151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.892+0000 7f349f84b700 1 --2- 172.21.15.92:0/364676565 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156070 0x7f3498151dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3498068f20 tx=0x7f3494017000 comp rx=0 tx=0).stop 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.892+0000 7f349f84b700 1 -- 172.21.15.92:0/364676565 shutdown_connections 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.892+0000 7f349f84b700 1 --2- 172.21.15.92:0/364676565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3498156440 0x7f349814b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.892+0000 7f349f84b700 1 --2- 172.21.15.92:0/364676565 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3498156070 0x7f3498151dd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.892+0000 7f349f84b700 1 --2- 172.21.15.92:0/364676565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34980aed10 0x7f34980c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:21.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.892+0000 7f349f84b700 1 -- 172.21.15.92:0/364676565 >> 172.21.15.92:0/364676565 conn(0x7f34980cc720 msgr2=0x7f34980c9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:21.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.892+0000 7f349f84b700 1 -- 172.21.15.92:0/364676565 shutdown_connections 2024-08-17T02:24:21.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:21.892+0000 7f349f84b700 1 -- 172.21.15.92:0/364676565 wait complete. 2024-08-17T02:24:21.907 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 18b45aee-644a-4087-bbe1-65f3c30dd3c3 1 2024-08-17T02:24:22.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24f8884700 1 Processor -- start 2024-08-17T02:24:22.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24f8884700 1 -- start start 2024-08-17T02:24:22.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24f8884700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f24f4068850 0x7f24f40c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24f8884700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f40c8bf0 0x7f24f40c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24f8884700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f4067400 con 0x7f24f4156d60 2024-08-17T02:24:22.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24f8884700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f406ea10 con 0x7f24f4068850 2024-08-17T02:24:22.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24f8884700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f406ecf0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24f359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f40c8bf0 0x7f24f40c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24f359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f40c8bf0 0x7f24f40c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:49662/0 (socket says 172.21.15.92:49662) 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24ebfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f24f4068850 0x7f24f40c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.016+0000 7f24f359e700 1 -- 172.21.15.92:0/1542691680 learned_addr learned my addr 172.21.15.92:0/1542691680 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f359e700 1 -- 172.21.15.92:0/1542691680 >> v2:172.21.15.92:3300/0 conn(0x7f24f4068850 msgr2=0x7f24f40c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f359e700 1 --2- 172.21.15.92:0/1542691680 >> v2:172.21.15.92:3300/0 conn(0x7f24f4068850 0x7f24f40c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f359e700 1 -- 172.21.15.92:0/1542691680 >> v1:172.21.15.31:6789/0 conn(0x7f24f4156d60 legacy=0x7f24f4067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f359e700 1 -- 172.21.15.92:0/1542691680 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f406efd0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f359e700 1 --2- 172.21.15.92:0/1542691680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f40c8bf0 0x7f24f40c1be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009f20 tx=0x7f24ec009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e6a565934ef3069 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f259c700 1 -- 172.21.15.92:0/1542691680 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00e070 con 0x7f24f40c8bf0 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f259c700 1 -- 172.21.15.92:0/1542691680 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec00b9d0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f259c700 1 -- 172.21.15.92:0/1542691680 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0092e0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f8884700 1 -- 172.21.15.92:0/1542691680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f40c8bf0 msgr2=0x7f24f40c1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f8884700 1 --2- 172.21.15.92:0/1542691680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f40c8bf0 0x7f24f40c1be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009f20 tx=0x7f24ec009840 comp rx=0 tx=0).stop 2024-08-17T02:24:22.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f8884700 1 -- 172.21.15.92:0/1542691680 shutdown_connections 2024-08-17T02:24:22.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f8884700 1 --2- 172.21.15.92:0/1542691680 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f40c8bf0 0x7f24f40c1be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f8884700 1 --2- 172.21.15.92:0/1542691680 >> v2:172.21.15.92:3300/0 conn(0x7f24f4068850 0x7f24f40c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f8884700 1 -- 172.21.15.92:0/1542691680 >> 172.21.15.92:0/1542691680 conn(0x7f24f406bbb0 msgr2=0x7f24f40b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f8884700 1 -- 172.21.15.92:0/1542691680 shutdown_connections 2024-08-17T02:24:22.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f8884700 1 -- 172.21.15.92:0/1542691680 wait complete. 2024-08-17T02:24:22.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f8884700 1 Processor -- start 2024-08-17T02:24:22.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.020+0000 7f24f8884700 1 -- start start 2024-08-17T02:24:22.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24f8884700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24f4068850 0x7f24f414da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24f8884700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24f40c8bf0 0x7f24f415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24f8884700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f4156d60 0x7f24f415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24f8884700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f415a350 con 0x7f24f4068850 2024-08-17T02:24:22.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24f8884700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f415c0d0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24f8884700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f415b4c0 con 0x7f24f4156d60 2024-08-17T02:24:22.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24f40c8bf0 0x7f24f415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24f40c8bf0 0x7f24f415a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52576/0 (socket says 172.21.15.92:52576) 2024-08-17T02:24:22.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24ebfff700 1 -- 172.21.15.92:0/1341661549 learned_addr learned my addr 172.21.15.92:0/1341661549 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:22.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24f359e700 1 --2- 172.21.15.92:0/1341661549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f4156d60 0x7f24f415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24f2d9d700 1 --2- 172.21.15.92:0/1341661549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24f4068850 0x7f24f414da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24ebfff700 1 -- 172.21.15.92:0/1341661549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f4156d60 msgr2=0x7f24f415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24ebfff700 1 --2- 172.21.15.92:0/1341661549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f4156d60 0x7f24f415adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24ebfff700 1 -- 172.21.15.92:0/1341661549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24f4068850 msgr2=0x7f24f414da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24ebfff700 1 --2- 172.21.15.92:0/1341661549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24f4068850 0x7f24f414da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24ebfff700 1 -- 172.21.15.92:0/1341661549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec009ae0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24ebfff700 1 --2- 172.21.15.92:0/1341661549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24f40c8bf0 0x7f24f415a8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00ec50 tx=0x7f24dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24eaffd700 1 -- 172.21.15.92:0/1341661549 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc00c850 con 0x7f24f40c8bf0 2024-08-17T02:24:22.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24eaffd700 1 -- 172.21.15.92:0/1341661549 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24dc00c9b0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24f8884700 1 -- 172.21.15.92:0/1341661549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f415b7a0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24eaffd700 1 -- 172.21.15.92:0/1341661549 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc00cd70 con 0x7f24f40c8bf0 2024-08-17T02:24:22.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24f8884700 1 -- 172.21.15.92:0/1341661549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f415bd60 con 0x7f24f40c8bf0 2024-08-17T02:24:22.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24eaffd700 1 -- 172.21.15.92:0/1341661549 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f24dc005a00 con 0x7f24f40c8bf0 2024-08-17T02:24:22.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.024+0000 7f24eaffd700 1 -- 172.21.15.92:0/1341661549 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f24dc013cb0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.028+0000 7f24f8884700 1 -- 172.21.15.92:0/1341661549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f415c240 con 0x7f24f40c8bf0 2024-08-17T02:24:22.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.028+0000 7f24eaffd700 1 -- 172.21.15.92:0/1341661549 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f24dc03b7a0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.116+0000 7f24f8884700 1 -- 172.21.15.92:0/1341661549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "18b45aee-644a-4087-bbe1-65f3c30dd3c3", "id": 1} v 0) v1 -- 0x7f24f40712b0 con 0x7f24f40c8bf0 2024-08-17T02:24:22.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.128+0000 7f24eaffd700 1 -- 172.21.15.92:0/1341661549 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "18b45aee-644a-4087-bbe1-65f3c30dd3c3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f24dc02a030 con 0x7f24f40c8bf0 2024-08-17T02:24:22.129 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-08-17T02:24:22.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.128+0000 7f24f8884700 1 -- 172.21.15.92:0/1341661549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24f40c8bf0 msgr2=0x7f24f415a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.128+0000 7f24f8884700 1 --2- 172.21.15.92:0/1341661549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24f40c8bf0 0x7f24f415a8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00ec50 tx=0x7f24dc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.128+0000 7f24f8884700 1 -- 172.21.15.92:0/1341661549 shutdown_connections 2024-08-17T02:24:22.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.128+0000 7f24f8884700 1 --2- 172.21.15.92:0/1341661549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24f4156d60 0x7f24f415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.128+0000 7f24f8884700 1 --2- 172.21.15.92:0/1341661549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24f40c8bf0 0x7f24f415a8b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.128+0000 7f24f8884700 1 --2- 172.21.15.92:0/1341661549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24f4068850 0x7f24f414da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.128+0000 7f24f8884700 1 -- 172.21.15.92:0/1341661549 >> 172.21.15.92:0/1341661549 conn(0x7f24f406bbb0 msgr2=0x7f24f40af800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.128+0000 7f24f8884700 1 -- 172.21.15.92:0/1341661549 shutdown_connections 2024-08-17T02:24:22.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.128+0000 7f24f8884700 1 -- 172.21.15.92:0/1341661549 wait complete. 2024-08-17T02:24:22.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 72a14298-dab1-41c5-89da-8263cf8313ec 2 2024-08-17T02:24:22.220 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:22.214+0000 7ffb2942b000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:24:22.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.244+0000 7f683c9f2700 1 Processor -- start 2024-08-17T02:24:22.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.244+0000 7f683c9f2700 1 -- start start 2024-08-17T02:24:22.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68380adec0 0x7f683806b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683806b970 con 0x7f683815d390 2024-08-17T02:24:22.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6838068b50 con 0x7f6838161200 2024-08-17T02:24:22.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683806c440 con 0x7f68380adec0 2024-08-17T02:24:22.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683759e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6838161200 0x7f6838068fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58438/0 (socket says 172.21.15.92:58438) 2024-08-17T02:24:22.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683759e700 1 -- 172.21.15.92:0/1662541998 learned_addr learned my addr 172.21.15.92:0/1662541998 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-08-17T02:24:22.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683659c700 1 --2- 172.21.15.92:0/1662541998 >> v2:172.21.15.31:3300/0 conn(0x7f68380adec0 0x7f683806b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f6835d9b700 1 -- 172.21.15.92:0/1662541998 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590339662 0 0) 0x7f6838068b50 con 0x7f6838161200 2024-08-17T02:24:22.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f6835d9b700 1 -- 172.21.15.92:0/1662541998 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6820003570 con 0x7f6838161200 2024-08-17T02:24:22.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683659c700 1 -- 172.21.15.92:0/1662541998 >> v1:172.21.15.92:6789/0 conn(0x7f6838161200 legacy=0x7f6838068fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683659c700 1 -- 172.21.15.92:0/1662541998 >> v1:172.21.15.31:6789/0 conn(0x7f683815d390 legacy=0x7f68380ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683659c700 1 -- 172.21.15.92:0/1662541998 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683806bba0 con 0x7f68380adec0 2024-08-17T02:24:22.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683659c700 1 --2- 172.21.15.92:0/1662541998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68380adec0 0x7f683806b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f682c0098e0 tx=0x7f682c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e89e87125fa172 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f6835d9b700 1 -- 172.21.15.92:0/1662541998 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00b640 con 0x7f68380adec0 2024-08-17T02:24:22.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f6835d9b700 1 -- 172.21.15.92:0/1662541998 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00b7a0 con 0x7f68380adec0 2024-08-17T02:24:22.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f6835d9b700 1 -- 172.21.15.92:0/1662541998 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00bb40 con 0x7f68380adec0 2024-08-17T02:24:22.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 -- 172.21.15.92:0/1662541998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68380adec0 msgr2=0x7f683806b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 --2- 172.21.15.92:0/1662541998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68380adec0 0x7f683806b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f682c0098e0 tx=0x7f682c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 -- 172.21.15.92:0/1662541998 shutdown_connections 2024-08-17T02:24:22.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 --2- 172.21.15.92:0/1662541998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68380adec0 0x7f683806b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 -- 172.21.15.92:0/1662541998 >> 172.21.15.92:0/1662541998 conn(0x7f68380b33c0 msgr2=0x7f68380b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 -- 172.21.15.92:0/1662541998 shutdown_connections 2024-08-17T02:24:22.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.248+0000 7f683c9f2700 1 -- 172.21.15.92:0/1662541998 wait complete. 2024-08-17T02:24:22.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683c9f2700 1 Processor -- start 2024-08-17T02:24:22.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683c9f2700 1 -- start start 2024-08-17T02:24:22.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683c9f2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68380adec0 0x7f68381524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683c9f2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f683815d390 0x7f6838160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683c9f2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6838161200 0x7f683814f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683c9f2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68381606a0 con 0x7f68380adec0 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683c9f2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6838153410 con 0x7f683815d390 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683c9f2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6838152b70 con 0x7f6838161200 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f683815d390 0x7f6838160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683759e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6838161200 0x7f683814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f6836d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68380adec0 0x7f68381524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f683815d390 0x7f6838160a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52580/0 (socket says 172.21.15.92:52580) 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.252+0000 7f683659c700 1 -- 172.21.15.92:0/3329359102 learned_addr learned my addr 172.21.15.92:0/3329359102 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f6836d9d700 1 -- 172.21.15.92:0/3329359102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6838161200 msgr2=0x7f683814f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f6836d9d700 1 --2- 172.21.15.92:0/3329359102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6838161200 0x7f683814f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f6836d9d700 1 -- 172.21.15.92:0/3329359102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f683815d390 msgr2=0x7f6838160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f6836d9d700 1 --2- 172.21.15.92:0/3329359102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f683815d390 0x7f6838160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f6836d9d700 1 -- 172.21.15.92:0/3329359102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c009420 con 0x7f68380adec0 2024-08-17T02:24:22.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f6836d9d700 1 --2- 172.21.15.92:0/3329359102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68380adec0 0x7f68381524e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f682800c590 tx=0x7f6828007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f681effd700 1 -- 172.21.15.92:0/3329359102 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828011590 con 0x7f68380adec0 2024-08-17T02:24:22.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f681effd700 1 -- 172.21.15.92:0/3329359102 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6828011710 con 0x7f68380adec0 2024-08-17T02:24:22.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f683c9f2700 1 -- 172.21.15.92:0/3329359102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6838152e50 con 0x7f68380adec0 2024-08-17T02:24:22.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f681effd700 1 -- 172.21.15.92:0/3329359102 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828011ad0 con 0x7f68380adec0 2024-08-17T02:24:22.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f683c9f2700 1 -- 172.21.15.92:0/3329359102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683815ecb0 con 0x7f68380adec0 2024-08-17T02:24:22.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f681effd700 1 -- 172.21.15.92:0/3329359102 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f682801c440 con 0x7f68380adec0 2024-08-17T02:24:22.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.256+0000 7f681effd700 1 -- 172.21.15.92:0/3329359102 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f682801cb20 con 0x7f68380adec0 2024-08-17T02:24:22.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.260+0000 7f683c9f2700 1 -- 172.21.15.92:0/3329359102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683815eed0 con 0x7f68380adec0 2024-08-17T02:24:22.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.264+0000 7f681effd700 1 -- 172.21.15.92:0/3329359102 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6828017070 con 0x7f68380adec0 2024-08-17T02:24:22.274 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:22.270+0000 7ffb2942b000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:24:22.281 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:22.280+0000 7f3dc9186000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:24:22.339 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:22.336+0000 7f3dc9186000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:24:22.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.340+0000 7f683c9f2700 1 -- 172.21.15.92:0/3329359102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "72a14298-dab1-41c5-89da-8263cf8313ec", "id": 2} v 0) v1 -- 0x7f68380712b0 con 0x7f68380adec0 2024-08-17T02:24:22.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.356+0000 7f681effd700 1 -- 172.21.15.92:0/3329359102 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72a14298-dab1-41c5-89da-8263cf8313ec", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f682801c6f0 con 0x7f68380adec0 2024-08-17T02:24:22.358 INFO:teuthology.orchestra.run.smithi092.stdout:2 2024-08-17T02:24:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.356+0000 7f683c9f2700 1 -- 172.21.15.92:0/3329359102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68380adec0 msgr2=0x7f68381524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.356+0000 7f683c9f2700 1 --2- 172.21.15.92:0/3329359102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68380adec0 0x7f68381524e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f682800c590 tx=0x7f6828007ec0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.356+0000 7f683c9f2700 1 -- 172.21.15.92:0/3329359102 shutdown_connections 2024-08-17T02:24:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.356+0000 7f683c9f2700 1 --2- 172.21.15.92:0/3329359102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6838161200 0x7f683814f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.356+0000 7f683c9f2700 1 --2- 172.21.15.92:0/3329359102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f683815d390 0x7f6838160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.356+0000 7f683c9f2700 1 --2- 172.21.15.92:0/3329359102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68380adec0 0x7f68381524e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.356+0000 7f683c9f2700 1 -- 172.21.15.92:0/3329359102 >> 172.21.15.92:0/3329359102 conn(0x7f68380b33c0 msgr2=0x7f68380b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.360 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.356+0000 7f683c9f2700 1 -- 172.21.15.92:0/3329359102 shutdown_connections 2024-08-17T02:24:22.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.356+0000 7f683c9f2700 1 -- 172.21.15.92:0/3329359102 wait complete. 2024-08-17T02:24:22.372 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new be360a02-0abc-4a5f-8b78-6c1265e7558b 3 2024-08-17T02:24:22.386 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:22.378+0000 7ffb2942b000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:22.455 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:22.452+0000 7f3dc9186000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:22.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a3568700 1 Processor -- start 2024-08-17T02:24:22.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a3568700 1 -- start start 2024-08-17T02:24:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a3568700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c1553b0 0x7f479c155780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a3568700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f479c067b10 0x7f479c1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a3568700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c156150 con 0x7f479c155cc0 2024-08-17T02:24:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a3568700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c156430 con 0x7f479c067b10 2024-08-17T02:24:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a3568700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c156710 con 0x7f479c1553b0 2024-08-17T02:24:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a2d67700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f479c067b10 0x7f479c1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a2d67700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f479c067b10 0x7f479c1571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52586/0 (socket says 172.21.15.92:52586) 2024-08-17T02:24:22.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a2d67700 1 -- 172.21.15.92:0/760506630 learned_addr learned my addr 172.21.15.92:0/760506630 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:22.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a2566700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c1553b0 0x7f479c155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a1d65700 1 --1- 172.21.15.92:0/760506630 >> v1:172.21.15.92:6789/0 conn(0x7f479c155cc0 0x7f479c067400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58454/0 (socket says 172.21.15.92:58454) 2024-08-17T02:24:22.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a2d67700 1 -- 172.21.15.92:0/760506630 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c1553b0 msgr2=0x7f479c155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:22.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a2d67700 1 --2- 172.21.15.92:0/760506630 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c1553b0 0x7f479c155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a2d67700 1 -- 172.21.15.92:0/760506630 >> v1:172.21.15.92:6789/0 conn(0x7f479c155cc0 legacy=0x7f479c067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a2d67700 1 -- 172.21.15.92:0/760506630 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c1569f0 con 0x7f479c067b10 2024-08-17T02:24:22.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a2566700 1 --2- 172.21.15.92:0/760506630 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c1553b0 0x7f479c155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:22.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a2d67700 1 --2- 172.21.15.92:0/760506630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f479c067b10 0x7f479c1571f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4794009f50 tx=0x7f4794009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a315a26536725be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a1564700 1 -- 172.21.15.92:0/760506630 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479400e070 con 0x7f479c067b10 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a1564700 1 -- 172.21.15.92:0/760506630 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479400b9c0 con 0x7f479c067b10 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.476+0000 7f47a1564700 1 -- 172.21.15.92:0/760506630 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47940092e0 con 0x7f479c067b10 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- 172.21.15.92:0/760506630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f479c067b10 msgr2=0x7f479c1571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 --2- 172.21.15.92:0/760506630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f479c067b10 0x7f479c1571f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4794009f50 tx=0x7f4794009840 comp rx=0 tx=0).stop 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- 172.21.15.92:0/760506630 shutdown_connections 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 --2- 172.21.15.92:0/760506630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f479c067b10 0x7f479c1571f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 --2- 172.21.15.92:0/760506630 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c1553b0 0x7f479c155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- 172.21.15.92:0/760506630 >> 172.21.15.92:0/760506630 conn(0x7f479c06bbb0 msgr2=0x7f479c0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- 172.21.15.92:0/760506630 shutdown_connections 2024-08-17T02:24:22.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- 172.21.15.92:0/760506630 wait complete. 2024-08-17T02:24:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 Processor -- start 2024-08-17T02:24:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- start start 2024-08-17T02:24:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f479c067b10 0x7f479c1648c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f479c1553b0 0x7f479c0acc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c155cc0 0x7f479c0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0aaca0 con 0x7f479c1553b0 2024-08-17T02:24:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0aaf10 con 0x7f479c067b10 2024-08-17T02:24:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0ab1f0 con 0x7f479c155cc0 2024-08-17T02:24:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2d67700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c155cc0 0x7f479c0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2566700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f479c067b10 0x7f479c1648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2d67700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c155cc0 0x7f479c0ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:49706/0 (socket says 172.21.15.92:49706) 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2566700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f479c067b10 0x7f479c1648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52600/0 (socket says 172.21.15.92:52600) 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2d67700 1 -- 172.21.15.92:0/842159396 learned_addr learned my addr 172.21.15.92:0/842159396 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a1d65700 1 --2- 172.21.15.92:0/842159396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f479c1553b0 0x7f479c0acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2d67700 1 -- 172.21.15.92:0/842159396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f479c067b10 msgr2=0x7f479c1648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2d67700 1 --2- 172.21.15.92:0/842159396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f479c067b10 0x7f479c1648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2d67700 1 -- 172.21.15.92:0/842159396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f479c1553b0 msgr2=0x7f479c0acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2d67700 1 --2- 172.21.15.92:0/842159396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f479c1553b0 0x7f479c0acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2d67700 1 -- 172.21.15.92:0/842159396 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479800da20 con 0x7f479c155cc0 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a1d65700 1 --2- 172.21.15.92:0/842159396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f479c1553b0 0x7f479c0acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a2d67700 1 --2- 172.21.15.92:0/842159396 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c155cc0 0x7f479c0ad1a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4794009880 tx=0x7f4794018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47927fc700 1 -- 172.21.15.92:0/842159396 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794008c50 con 0x7f479c155cc0 2024-08-17T02:24:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47927fc700 1 -- 172.21.15.92:0/842159396 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794008db0 con 0x7f479c155cc0 2024-08-17T02:24:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- 172.21.15.92:0/842159396 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4794009ae0 con 0x7f479c155cc0 2024-08-17T02:24:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47927fc700 1 -- 172.21.15.92:0/842159396 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794026690 con 0x7f479c155cc0 2024-08-17T02:24:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.480+0000 7f47a3568700 1 -- 172.21.15.92:0/842159396 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c0a9ea0 con 0x7f479c155cc0 2024-08-17T02:24:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.484+0000 7f47927fc700 1 -- 172.21.15.92:0/842159396 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4794003040 con 0x7f479c155cc0 2024-08-17T02:24:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.484+0000 7f47927fc700 1 -- 172.21.15.92:0/842159396 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f479401daa0 con 0x7f479c155cc0 2024-08-17T02:24:22.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.484+0000 7f47a3568700 1 -- 172.21.15.92:0/842159396 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c0712b0 con 0x7f479c155cc0 2024-08-17T02:24:22.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.484+0000 7f47927fc700 1 -- 172.21.15.92:0/842159396 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f4794021070 con 0x7f479c155cc0 2024-08-17T02:24:22.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.560+0000 7f47a3568700 1 -- 172.21.15.92:0/842159396 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "be360a02-0abc-4a5f-8b78-6c1265e7558b", "id": 3} v 0) v1 -- 0x7f479c06c0d0 con 0x7f479c155cc0 2024-08-17T02:24:22.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.568+0000 7f47927fc700 1 -- 172.21.15.92:0/842159396 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be360a02-0abc-4a5f-8b78-6c1265e7558b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f479401dd00 con 0x7f479c155cc0 2024-08-17T02:24:22.571 INFO:teuthology.orchestra.run.smithi092.stdout:3 2024-08-17T02:24:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.568+0000 7f47a3568700 1 -- 172.21.15.92:0/842159396 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c155cc0 msgr2=0x7f479c0ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.568+0000 7f47a3568700 1 --2- 172.21.15.92:0/842159396 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c155cc0 0x7f479c0ad1a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4794009880 tx=0x7f4794018000 comp rx=0 tx=0).stop 2024-08-17T02:24:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.568+0000 7f47a3568700 1 -- 172.21.15.92:0/842159396 shutdown_connections 2024-08-17T02:24:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.568+0000 7f47a3568700 1 --2- 172.21.15.92:0/842159396 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f479c155cc0 0x7f479c0ad1a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.568+0000 7f47a3568700 1 --2- 172.21.15.92:0/842159396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f479c1553b0 0x7f479c0acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.568+0000 7f47a3568700 1 --2- 172.21.15.92:0/842159396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f479c067b10 0x7f479c1648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.568+0000 7f47a3568700 1 -- 172.21.15.92:0/842159396 >> 172.21.15.92:0/842159396 conn(0x7f479c06bbb0 msgr2=0x7f479c0af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.572+0000 7f47a3568700 1 -- 172.21.15.92:0/842159396 shutdown_connections 2024-08-17T02:24:22.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.572+0000 7f47a3568700 1 -- 172.21.15.92:0/842159396 wait complete. 2024-08-17T02:24:22.588 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 508e3194-87c9-4dab-9465-204d578375db 4 2024-08-17T02:24:22.613 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:22.606+0000 7ffb2942b000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:24:22.663 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:22.658+0000 7ffb2942b000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:22.679 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:22.676+0000 7f3dc9186000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:24:22.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583d696700 1 Processor -- start 2024-08-17T02:24:22.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583d696700 1 -- start start 2024-08-17T02:24:22.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583d696700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5838159cb0 0x7f58381604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583d696700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5838155e90 con 0x7f5838159130 2024-08-17T02:24:22.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583d696700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5838156150 con 0x7f58381553b0 2024-08-17T02:24:22.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583d696700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5838156430 con 0x7f5838159cb0 2024-08-17T02:24:22.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f5837fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f58381553b0 0x7f5838155780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58462/0 (socket says 172.21.15.92:58462) 2024-08-17T02:24:22.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f5837fff700 1 -- 172.21.15.92:0/2734583626 learned_addr learned my addr 172.21.15.92:0/2734583626 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-08-17T02:24:22.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583ce95700 1 --2- 172.21.15.92:0/2734583626 >> v2:172.21.15.31:3300/0 conn(0x7f5838159cb0 0x7f58381604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f5836ffd700 1 -- 172.21.15.92:0/2734583626 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101911138 0 0) 0x7f5838156150 con 0x7f58381553b0 2024-08-17T02:24:22.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f5836ffd700 1 -- 172.21.15.92:0/2734583626 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5824003570 con 0x7f58381553b0 2024-08-17T02:24:22.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f5836ffd700 1 -- 172.21.15.92:0/2734583626 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1334692589 0 0) 0x7f5824003570 con 0x7f58381553b0 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583ce95700 1 -- 172.21.15.92:0/2734583626 >> v1:172.21.15.92:6789/0 conn(0x7f58381553b0 legacy=0x7f5838155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583ce95700 1 -- 172.21.15.92:0/2734583626 >> v1:172.21.15.31:6789/0 conn(0x7f5838159130 legacy=0x7f58381595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583ce95700 1 -- 172.21.15.92:0/2734583626 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838156710 con 0x7f5838159cb0 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f583ce95700 1 --2- 172.21.15.92:0/2734583626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5838159cb0 0x7f58381604b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5830009860 tx=0x7f58300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d666ef84a80383 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f5836ffd700 1 -- 172.21.15.92:0/2734583626 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280017f0 con 0x7f5838159cb0 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f5836ffd700 1 -- 172.21.15.92:0/2734583626 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5830011420 con 0x7f5838159cb0 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.684+0000 7f5836ffd700 1 -- 172.21.15.92:0/2734583626 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58300117a0 con 0x7f5838159cb0 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 -- 172.21.15.92:0/2734583626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5838159cb0 msgr2=0x7f58381604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 --2- 172.21.15.92:0/2734583626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5838159cb0 0x7f58381604b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5830009860 tx=0x7f58300091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 -- 172.21.15.92:0/2734583626 shutdown_connections 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 --2- 172.21.15.92:0/2734583626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5838159cb0 0x7f58381604b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 -- 172.21.15.92:0/2734583626 >> 172.21.15.92:0/2734583626 conn(0x7f583806bbb0 msgr2=0x7f58380b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 -- 172.21.15.92:0/2734583626 shutdown_connections 2024-08-17T02:24:22.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 -- 172.21.15.92:0/2734583626 wait complete. 2024-08-17T02:24:22.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 Processor -- start 2024-08-17T02:24:22.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 -- start start 2024-08-17T02:24:22.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58381553b0 0x7f583815d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5838159130 0x7f583815ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5838159cb0 0x7f58381520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5838160500 con 0x7f5838159cb0 2024-08-17T02:24:22.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583815d770 con 0x7f5838159130 2024-08-17T02:24:22.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.688+0000 7f583d696700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583815da50 con 0x7f58381553b0 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f5837fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58381553b0 0x7f583815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f5837fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58381553b0 0x7f583815d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:49718/0 (socket says 172.21.15.92:49718) 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f5837fff700 1 -- 172.21.15.92:0/2656306332 learned_addr learned my addr 172.21.15.92:0/2656306332 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f58377fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5838159130 0x7f583815ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f583ce95700 1 --2- 172.21.15.92:0/2656306332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5838159cb0 0x7f58381520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f58377fe700 1 -- 172.21.15.92:0/2656306332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58381553b0 msgr2=0x7f583815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f58377fe700 1 --2- 172.21.15.92:0/2656306332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58381553b0 0x7f583815d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f58377fe700 1 -- 172.21.15.92:0/2656306332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5838159cb0 msgr2=0x7f58381520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f58377fe700 1 --2- 172.21.15.92:0/2656306332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5838159cb0 0x7f58381520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f58377fe700 1 -- 172.21.15.92:0/2656306332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830009420 con 0x7f5838159130 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f5837fff700 1 --2- 172.21.15.92:0/2656306332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58381553b0 0x7f583815d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:22.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f58377fe700 1 --2- 172.21.15.92:0/2656306332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5838159130 0x7f583815ffc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f582000c810 tx=0x7f5820007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f582ffff700 1 -- 172.21.15.92:0/2656306332 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820011590 con 0x7f5838159130 2024-08-17T02:24:22.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f582ffff700 1 -- 172.21.15.92:0/2656306332 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820011710 con 0x7f5838159130 2024-08-17T02:24:22.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f582ffff700 1 -- 172.21.15.92:0/2656306332 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820011ad0 con 0x7f5838159130 2024-08-17T02:24:22.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f583d696700 1 -- 172.21.15.92:0/2656306332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583815dd30 con 0x7f5838159130 2024-08-17T02:24:22.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f583d696700 1 -- 172.21.15.92:0/2656306332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58381608b0 con 0x7f5838159130 2024-08-17T02:24:22.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f582ffff700 1 -- 172.21.15.92:0/2656306332 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f582001c440 con 0x7f5838159130 2024-08-17T02:24:22.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.692+0000 7f582ffff700 1 -- 172.21.15.92:0/2656306332 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f5820012930 con 0x7f5838159130 2024-08-17T02:24:22.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.696+0000 7f583d696700 1 -- 172.21.15.92:0/2656306332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5838160b00 con 0x7f5838159130 2024-08-17T02:24:22.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.696+0000 7f582ffff700 1 -- 172.21.15.92:0/2656306332 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5820017070 con 0x7f5838159130 2024-08-17T02:24:22.727 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:22.724+0000 7f3dc9186000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.776+0000 7f583d696700 1 -- 172.21.15.92:0/2656306332 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "508e3194-87c9-4dab-9465-204d578375db", "id": 4} v 0) v1 -- 0x7f58380712b0 con 0x7f5838159130 2024-08-17T02:24:22.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.784+0000 7f582ffff700 1 -- 172.21.15.92:0/2656306332 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "508e3194-87c9-4dab-9465-204d578375db", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5820012c00 con 0x7f5838159130 2024-08-17T02:24:22.787 INFO:teuthology.orchestra.run.smithi092.stdout:4 2024-08-17T02:24:22.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.788+0000 7f583d696700 1 -- 172.21.15.92:0/2656306332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5838159130 msgr2=0x7f583815ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.788+0000 7f583d696700 1 --2- 172.21.15.92:0/2656306332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5838159130 0x7f583815ffc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f582000c810 tx=0x7f5820007e20 comp rx=0 tx=0).stop 2024-08-17T02:24:22.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.788+0000 7f583d696700 1 -- 172.21.15.92:0/2656306332 shutdown_connections 2024-08-17T02:24:22.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.788+0000 7f583d696700 1 --2- 172.21.15.92:0/2656306332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5838159cb0 0x7f58381520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.788+0000 7f583d696700 1 --2- 172.21.15.92:0/2656306332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5838159130 0x7f583815ffc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.788+0000 7f583d696700 1 --2- 172.21.15.92:0/2656306332 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58381553b0 0x7f583815d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.788+0000 7f583d696700 1 -- 172.21.15.92:0/2656306332 >> 172.21.15.92:0/2656306332 conn(0x7f583806bbb0 msgr2=0x7f58381583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.788+0000 7f583d696700 1 -- 172.21.15.92:0/2656306332 shutdown_connections 2024-08-17T02:24:22.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.788+0000 7f583d696700 1 -- 172.21.15.92:0/2656306332 wait complete. 2024-08-17T02:24:22.807 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 1196dde5-5b26-4c55-a5af-289e282ac05c 5 2024-08-17T02:24:22.842 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:22.838+0000 7ffb2942b000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:24:22.907 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:22.904+0000 7f3dc9186000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:24:22.907 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:22.902+0000 7ffb2942b000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:24:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.908+0000 7f66edf37700 1 Processor -- start 2024-08-17T02:24:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.908+0000 7f66edf37700 1 -- start start 2024-08-17T02:24:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f66e8067400 0x7f66e80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e80c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e80aeaa0 con 0x7f66e80677d0 2024-08-17T02:24:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e806f170 con 0x7f66e8067400 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e80c9590 con 0x7f66e8068b70 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e7fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e80c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e7fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e80c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:49724/0 (socket says 172.21.15.92:49724) 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e7fff700 1 -- 172.21.15.92:0/3875581869 learned_addr learned my addr 172.21.15.92:0/3875581869 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66ecf35700 1 --2- 172.21.15.92:0/3875581869 >> v2:172.21.15.31:3300/0 conn(0x7f66e8067400 0x7f66e80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e7fff700 1 -- 172.21.15.92:0/3875581869 >> v2:172.21.15.31:3300/0 conn(0x7f66e8067400 msgr2=0x7f66e80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e7fff700 1 --2- 172.21.15.92:0/3875581869 >> v2:172.21.15.31:3300/0 conn(0x7f66e8067400 0x7f66e80aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e7fff700 1 -- 172.21.15.92:0/3875581869 >> v1:172.21.15.31:6789/0 conn(0x7f66e80677d0 legacy=0x7f66e8067c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e7fff700 1 -- 172.21.15.92:0/3875581869 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e806ebb0 con 0x7f66e8068b70 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e7fff700 1 --2- 172.21.15.92:0/3875581869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e80c9050 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f66d40099b0 tx=0x7f66d4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94d0f0506f610cf6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e77fe700 1 -- 172.21.15.92:0/3875581869 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4009ea0 con 0x7f66e8068b70 2024-08-17T02:24:22.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e77fe700 1 -- 172.21.15.92:0/3875581869 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d400b860 con 0x7f66e8068b70 2024-08-17T02:24:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66e77fe700 1 -- 172.21.15.92:0/3875581869 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d400bc00 con 0x7f66e8068b70 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 -- 172.21.15.92:0/3875581869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 msgr2=0x7f66e80c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 --2- 172.21.15.92:0/3875581869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e80c9050 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f66d40099b0 tx=0x7f66d4009250 comp rx=0 tx=0).stop 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 -- 172.21.15.92:0/3875581869 shutdown_connections 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 --2- 172.21.15.92:0/3875581869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e80c9050 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 --2- 172.21.15.92:0/3875581869 >> v2:172.21.15.31:3300/0 conn(0x7f66e8067400 0x7f66e80aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 -- 172.21.15.92:0/3875581869 >> 172.21.15.92:0/3875581869 conn(0x7f66e806bbb0 msgr2=0x7f66e80b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 -- 172.21.15.92:0/3875581869 shutdown_connections 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 -- 172.21.15.92:0/3875581869 wait complete. 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 Processor -- start 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.912+0000 7f66edf37700 1 -- start start 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66edf37700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66e8067400 0x7f66e8154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66edf37700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66e80677d0 0x7f66e813bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66edf37700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e8163370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66edf37700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8154170 con 0x7f66e80677d0 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66edf37700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e813ba90 con 0x7f66e8067400 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66edf37700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8162ee0 con 0x7f66e8068b70 2024-08-17T02:24:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ed736700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e8163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ecf35700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66e8067400 0x7f66e8154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ecf35700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66e8067400 0x7f66e8154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52610/0 (socket says 172.21.15.92:52610) 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ecf35700 1 -- 172.21.15.92:0/3333234128 learned_addr learned my addr 172.21.15.92:0/3333234128 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ed736700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e8163370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:49738/0 (socket says 172.21.15.92:49738) 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66e7fff700 1 --2- 172.21.15.92:0/3333234128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66e80677d0 0x7f66e813bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ecf35700 1 -- 172.21.15.92:0/3333234128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 msgr2=0x7f66e8163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ecf35700 1 --2- 172.21.15.92:0/3333234128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e8163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ecf35700 1 -- 172.21.15.92:0/3333234128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66e80677d0 msgr2=0x7f66e813bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ecf35700 1 --2- 172.21.15.92:0/3333234128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66e80677d0 0x7f66e813bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ecf35700 1 -- 172.21.15.92:0/3333234128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d40094f0 con 0x7f66e8067400 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66ecf35700 1 --2- 172.21.15.92:0/3333234128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66e8067400 0x7f66e8154850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e950 tx=0x7f66dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66e4ff9700 1 -- 172.21.15.92:0/3333234128 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc013680 con 0x7f66e8067400 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66e4ff9700 1 -- 172.21.15.92:0/3333234128 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc0137e0 con 0x7f66e8067400 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66e4ff9700 1 -- 172.21.15.92:0/3333234128 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc013ba0 con 0x7f66e8067400 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66edf37700 1 -- 172.21.15.92:0/3333234128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e8153bb0 con 0x7f66e8067400 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66edf37700 1 -- 172.21.15.92:0/3333234128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e8162b70 con 0x7f66e8067400 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66e4ff9700 1 -- 172.21.15.92:0/3333234128 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f66dc005a00 con 0x7f66e8067400 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66e4ff9700 1 -- 172.21.15.92:0/3333234128 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f66dc0068c0 con 0x7f66e8067400 2024-08-17T02:24:22.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.916+0000 7f66edf37700 1 -- 172.21.15.92:0/3333234128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e80712b0 con 0x7f66e8067400 2024-08-17T02:24:22.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:22.920+0000 7f66e4ff9700 1 -- 172.21.15.92:0/3333234128 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f66dc021060 con 0x7f66e8067400 2024-08-17T02:24:22.970 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:22.968+0000 7f3dc9186000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:24:22.971 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:22.966+0000 7ffb2942b000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:24:23.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.000+0000 7f66edf37700 1 -- 172.21.15.92:0/3333234128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1196dde5-5b26-4c55-a5af-289e282ac05c", "id": 5} v 0) v1 -- 0x7f66e8163f10 con 0x7f66e8067400 2024-08-17T02:24:23.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.008+0000 7f66e4ff9700 1 -- 172.21.15.92:0/3333234128 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1196dde5-5b26-4c55-a5af-289e282ac05c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f66dc017070 con 0x7f66e8067400 2024-08-17T02:24:23.011 INFO:teuthology.orchestra.run.smithi092.stdout:5 2024-08-17T02:24:23.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.008+0000 7f66edf37700 1 -- 172.21.15.92:0/3333234128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66e8067400 msgr2=0x7f66e8154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.008+0000 7f66edf37700 1 --2- 172.21.15.92:0/3333234128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66e8067400 0x7f66e8154850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e950 tx=0x7f66dc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.008+0000 7f66edf37700 1 -- 172.21.15.92:0/3333234128 shutdown_connections 2024-08-17T02:24:23.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.008+0000 7f66edf37700 1 --2- 172.21.15.92:0/3333234128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f66e8068b70 0x7f66e8163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.008+0000 7f66edf37700 1 --2- 172.21.15.92:0/3333234128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66e80677d0 0x7f66e813bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.008+0000 7f66edf37700 1 --2- 172.21.15.92:0/3333234128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66e8067400 0x7f66e8154850 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.008+0000 7f66edf37700 1 -- 172.21.15.92:0/3333234128 >> 172.21.15.92:0/3333234128 conn(0x7f66e806bbb0 msgr2=0x7f66e8160530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.008+0000 7f66edf37700 1 -- 172.21.15.92:0/3333234128 shutdown_connections 2024-08-17T02:24:23.013 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.008+0000 7f66edf37700 1 -- 172.21.15.92:0/3333234128 wait complete. 2024-08-17T02:24:23.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 52a319f8-c77f-41aa-b301-e65cbf07e921 6 2024-08-17T02:24:23.029 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:23.028+0000 7f3dc9186000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:24:23.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68effff700 1 Processor -- start 2024-08-17T02:24:23.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68effff700 1 -- start start 2024-08-17T02:24:23.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68effff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f68f0157340 0x7f68f00cba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68effff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f68f00afb60 0x7f68f00b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68effff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f00cccf0 con 0x7f68f0156f70 2024-08-17T02:24:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68effff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00b0540 con 0x7f68f0157340 2024-08-17T02:24:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68effff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00cc0e0 con 0x7f68f00afb60 2024-08-17T02:24:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68eeffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f68f0156f70 0x7f68f00ae8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:58466/0 (socket says 172.21.15.92:58466) 2024-08-17T02:24:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68eeffd700 1 -- 172.21.15.92:0/2115889201 learned_addr learned my addr 172.21.15.92:0/2115889201 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-08-17T02:24:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68ef7fe700 1 --2- 172.21.15.92:0/2115889201 >> v2:172.21.15.92:3300/0 conn(0x7f68f00afb60 0x7f68f00b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68ee7fc700 1 --2- 172.21.15.92:0/2115889201 >> v2:172.21.15.31:3300/0 conn(0x7f68f0157340 0x7f68f00cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68ef7fe700 1 -- 172.21.15.92:0/2115889201 >> v2:172.21.15.31:3300/0 conn(0x7f68f0157340 msgr2=0x7f68f00cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68ef7fe700 1 --2- 172.21.15.92:0/2115889201 >> v2:172.21.15.31:3300/0 conn(0x7f68f0157340 0x7f68f00cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68ef7fe700 1 -- 172.21.15.92:0/2115889201 >> v1:172.21.15.92:6789/0 conn(0x7f68f0156f70 legacy=0x7f68f00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68ef7fe700 1 -- 172.21.15.92:0/2115889201 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00cc3c0 con 0x7f68f00afb60 2024-08-17T02:24:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68ef7fe700 1 --2- 172.21.15.92:0/2115889201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68f00afb60 0x7f68f00b0000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f68f00ccc60 tx=0x7f68e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3e7ee3d8ff81230 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68edffb700 1 -- 172.21.15.92:0/2115889201 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4011630 con 0x7f68f00afb60 2024-08-17T02:24:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68edffb700 1 -- 172.21.15.92:0/2115889201 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e4011790 con 0x7f68f00afb60 2024-08-17T02:24:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68edffb700 1 -- 172.21.15.92:0/2115889201 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4011b30 con 0x7f68f00afb60 2024-08-17T02:24:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68effff700 1 -- 172.21.15.92:0/2115889201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68f00afb60 msgr2=0x7f68f00b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.132+0000 7f68effff700 1 --2- 172.21.15.92:0/2115889201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68f00afb60 0x7f68f00b0000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f68f00ccc60 tx=0x7f68e40091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.136+0000 7f68effff700 1 -- 172.21.15.92:0/2115889201 shutdown_connections 2024-08-17T02:24:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.136+0000 7f68effff700 1 --2- 172.21.15.92:0/2115889201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68f00afb60 0x7f68f00b0000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.136+0000 7f68effff700 1 --2- 172.21.15.92:0/2115889201 >> v2:172.21.15.31:3300/0 conn(0x7f68f0157340 0x7f68f00cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.136+0000 7f68effff700 1 -- 172.21.15.92:0/2115889201 >> 172.21.15.92:0/2115889201 conn(0x7f68f00b33c0 msgr2=0x7f68f00b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.136+0000 7f68effff700 1 -- 172.21.15.92:0/2115889201 shutdown_connections 2024-08-17T02:24:23.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.136+0000 7f68effff700 1 -- 172.21.15.92:0/2115889201 wait complete. 2024-08-17T02:24:23.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.136+0000 7f68effff700 1 Processor -- start 2024-08-17T02:24:23.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.136+0000 7f68effff700 1 -- start start 2024-08-17T02:24:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.136+0000 7f68effff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68f00afb60 0x7f68f01457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68effff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68f0156f70 0x7f68f00c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68effff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68f0157340 0x7f68f00c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68effff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c40d0 con 0x7f68f00afb60 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68effff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c43b0 con 0x7f68f0156f70 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68ee7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68f0156f70 0x7f68f00c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68ef7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68f0157340 0x7f68f00c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68ef7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68f0157340 0x7f68f00c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:49740/0 (socket says 172.21.15.92:49740) 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68ef7fe700 1 -- 172.21.15.92:0/2017315596 learned_addr learned my addr 172.21.15.92:0/2017315596 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68effff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c4690 con 0x7f68f0157340 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68eeffd700 1 --2- 172.21.15.92:0/2017315596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68f00afb60 0x7f68f01457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68ef7fe700 1 -- 172.21.15.92:0/2017315596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68f0156f70 msgr2=0x7f68f00c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68ef7fe700 1 --2- 172.21.15.92:0/2017315596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68f0156f70 0x7f68f00c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68ef7fe700 1 -- 172.21.15.92:0/2017315596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68f00afb60 msgr2=0x7f68f01457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68ef7fe700 1 --2- 172.21.15.92:0/2017315596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68f00afb60 0x7f68f01457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68ef7fe700 1 -- 172.21.15.92:0/2017315596 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4009420 con 0x7f68f0157340 2024-08-17T02:24:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68ef7fe700 1 --2- 172.21.15.92:0/2017315596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68f0157340 0x7f68f00c8400 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f68f00cc220 tx=0x7f68e4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68d6ffd700 1 -- 172.21.15.92:0/2017315596 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4011b10 con 0x7f68f0157340 2024-08-17T02:24:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68d6ffd700 1 -- 172.21.15.92:0/2017315596 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e40233f0 con 0x7f68f0157340 2024-08-17T02:24:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68effff700 1 -- 172.21.15.92:0/2017315596 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f00c6370 con 0x7f68f0157340 2024-08-17T02:24:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68d6ffd700 1 -- 172.21.15.92:0/2017315596 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4023790 con 0x7f68f0157340 2024-08-17T02:24:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68effff700 1 -- 172.21.15.92:0/2017315596 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f00c5ba0 con 0x7f68f0157340 2024-08-17T02:24:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68d6ffd700 1 -- 172.21.15.92:0/2017315596 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f68e4023b80 con 0x7f68f0157340 2024-08-17T02:24:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68d6ffd700 1 -- 172.21.15.92:0/2017315596 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f68e402d440 con 0x7f68f0157340 2024-08-17T02:24:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.140+0000 7f68effff700 1 -- 172.21.15.92:0/2017315596 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f00c5d90 con 0x7f68f0157340 2024-08-17T02:24:23.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.144+0000 7f68d6ffd700 1 -- 172.21.15.92:0/2017315596 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f68f00c5d90 con 0x7f68f0157340 2024-08-17T02:24:23.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.216+0000 7f68effff700 1 -- 172.21.15.92:0/2017315596 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "52a319f8-c77f-41aa-b301-e65cbf07e921", "id": 6} v 0) v1 -- 0x7f68f00712b0 con 0x7f68f0157340 2024-08-17T02:24:23.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.228+0000 7f68d6ffd700 1 -- 172.21.15.92:0/2017315596 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52a319f8-c77f-41aa-b301-e65cbf07e921", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f68e4028070 con 0x7f68f0157340 2024-08-17T02:24:23.230 INFO:teuthology.orchestra.run.smithi092.stdout:6 2024-08-17T02:24:23.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.228+0000 7f68effff700 1 -- 172.21.15.92:0/2017315596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68f0157340 msgr2=0x7f68f00c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.228+0000 7f68effff700 1 --2- 172.21.15.92:0/2017315596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68f0157340 0x7f68f00c8400 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f68f00cc220 tx=0x7f68e4017000 comp rx=0 tx=0).stop 2024-08-17T02:24:23.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.228+0000 7f68effff700 1 -- 172.21.15.92:0/2017315596 shutdown_connections 2024-08-17T02:24:23.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.228+0000 7f68effff700 1 --2- 172.21.15.92:0/2017315596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68f0157340 0x7f68f00c8400 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.228+0000 7f68effff700 1 --2- 172.21.15.92:0/2017315596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68f0156f70 0x7f68f00c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.228+0000 7f68effff700 1 --2- 172.21.15.92:0/2017315596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f68f00afb60 0x7f68f01457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.228+0000 7f68effff700 1 -- 172.21.15.92:0/2017315596 >> 172.21.15.92:0/2017315596 conn(0x7f68f00b33c0 msgr2=0x7f68f006ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.228+0000 7f68effff700 1 -- 172.21.15.92:0/2017315596 shutdown_connections 2024-08-17T02:24:23.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.228+0000 7f68effff700 1 -- 172.21.15.92:0/2017315596 wait complete. 2024-08-17T02:24:23.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new d68a56c4-97c2-43aa-9e56-6b71784a8266 7 2024-08-17T02:24:23.376 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:23.370+0000 7ffb2942b000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:24:23.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.396+0000 7f5f6f5cb700 1 Processor -- start 2024-08-17T02:24:23.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.396+0000 7f5f6f5cb700 1 -- start start 2024-08-17T02:24:23.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5f6814fb70 0x7f5f68156a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f68067400 0x7f5f6814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f681595e0 0x7f5f680698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680af790 con 0x7f5f68067400 2024-08-17T02:24:23.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f68156f50 con 0x7f5f6814fb70 2024-08-17T02:24:23.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68150480 con 0x7f5f681595e0 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6d367700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5f6814fb70 0x7f5f68156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6db68700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f681595e0 0x7f5f680698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6d367700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5f6814fb70 0x7f5f68156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52650/0 (socket says 172.21.15.92:52650) 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6d367700 1 -- 172.21.15.92:0/2566165662 learned_addr learned my addr 172.21.15.92:0/2566165662 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6cb66700 1 --2- 172.21.15.92:0/2566165662 >> v2:172.21.15.31:3300/0 conn(0x7f5f68067400 0x7f5f6814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6db68700 1 -- 172.21.15.92:0/2566165662 >> v2:172.21.15.92:3300/0 conn(0x7f5f6814fb70 msgr2=0x7f5f68156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6db68700 1 --2- 172.21.15.92:0/2566165662 >> v2:172.21.15.92:3300/0 conn(0x7f5f6814fb70 0x7f5f68156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6db68700 1 -- 172.21.15.92:0/2566165662 >> v2:172.21.15.31:3300/0 conn(0x7f5f68067400 msgr2=0x7f5f6814ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6db68700 1 --2- 172.21.15.92:0/2566165662 >> v2:172.21.15.31:3300/0 conn(0x7f5f68067400 0x7f5f6814ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6db68700 1 -- 172.21.15.92:0/2566165662 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68159b30 con 0x7f5f681595e0 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6d367700 1 --2- 172.21.15.92:0/2566165662 >> v2:172.21.15.92:3300/0 conn(0x7f5f6814fb70 0x7f5f68156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6cb66700 1 --2- 172.21.15.92:0/2566165662 >> v2:172.21.15.31:3300/0 conn(0x7f5f68067400 0x7f5f6814ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:23.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6db68700 1 --2- 172.21.15.92:0/2566165662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f681595e0 0x7f5f680698d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009e60 tx=0x7f5f60009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21030fb61bedd52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f5ffff700 1 -- 172.21.15.92:0/2566165662 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000bb20 con 0x7f5f681595e0 2024-08-17T02:24:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f5ffff700 1 -- 172.21.15.92:0/2566165662 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6000bc80 con 0x7f5f681595e0 2024-08-17T02:24:23.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f5ffff700 1 -- 172.21.15.92:0/2566165662 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60011400 con 0x7f5f681595e0 2024-08-17T02:24:23.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/2566165662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f681595e0 msgr2=0x7f5f680698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 --2- 172.21.15.92:0/2566165662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f681595e0 0x7f5f680698d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009e60 tx=0x7f5f60009780 comp rx=0 tx=0).stop 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/2566165662 shutdown_connections 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 --2- 172.21.15.92:0/2566165662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f681595e0 0x7f5f680698d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 --2- 172.21.15.92:0/2566165662 >> v2:172.21.15.31:3300/0 conn(0x7f5f68067400 0x7f5f6814ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 --2- 172.21.15.92:0/2566165662 >> v2:172.21.15.92:3300/0 conn(0x7f5f6814fb70 0x7f5f68156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/2566165662 >> 172.21.15.92:0/2566165662 conn(0x7f5f680cc720 msgr2=0x7f5f680ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/2566165662 shutdown_connections 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.400+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/2566165662 wait complete. 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6f5cb700 1 Processor -- start 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6f5cb700 1 -- start start 2024-08-17T02:24:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6f5cb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f68067400 0x7f5f6814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6f5cb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f6814fb70 0x7f5f680cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6f5cb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f681595e0 0x7f5f68167260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6f5cb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680cb5f0 con 0x7f5f681595e0 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6f5cb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680cb8d0 con 0x7f5f6814fb70 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6f5cb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680cbbb0 con 0x7f5f68067400 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6d367700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f68067400 0x7f5f6814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6d367700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f68067400 0x7f5f6814a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:49756/0 (socket says 172.21.15.92:49756) 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6d367700 1 -- 172.21.15.92:0/4053179296 learned_addr learned my addr 172.21.15.92:0/4053179296 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6cb66700 1 --2- 172.21.15.92:0/4053179296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f6814fb70 0x7f5f680cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6db68700 1 --2- 172.21.15.92:0/4053179296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f681595e0 0x7f5f68167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6d367700 1 -- 172.21.15.92:0/4053179296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f6814fb70 msgr2=0x7f5f680cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6d367700 1 --2- 172.21.15.92:0/4053179296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f6814fb70 0x7f5f680cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6d367700 1 -- 172.21.15.92:0/4053179296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f681595e0 msgr2=0x7f5f68167260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6d367700 1 --2- 172.21.15.92:0/4053179296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f681595e0 0x7f5f68167260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6d367700 1 -- 172.21.15.92:0/4053179296 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640094f0 con 0x7f5f68067400 2024-08-17T02:24:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6db68700 1 --2- 172.21.15.92:0/4053179296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f681595e0 0x7f5f68167260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6d367700 1 --2- 172.21.15.92:0/4053179296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f68067400 0x7f5f6814a680 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400ec50 tx=0x7f5f64009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f5d7fa700 1 -- 172.21.15.92:0/4053179296 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6400c920 con 0x7f5f68067400 2024-08-17T02:24:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f5d7fa700 1 -- 172.21.15.92:0/4053179296 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6400ca80 con 0x7f5f68067400 2024-08-17T02:24:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/4053179296 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f60009a20 con 0x7f5f68067400 2024-08-17T02:24:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f5d7fa700 1 -- 172.21.15.92:0/4053179296 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6400ce00 con 0x7f5f68067400 2024-08-17T02:24:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/4053179296 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f68152b40 con 0x7f5f68067400 2024-08-17T02:24:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f5d7fa700 1 -- 172.21.15.92:0/4053179296 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5f64005a00 con 0x7f5f68067400 2024-08-17T02:24:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.404+0000 7f5f5d7fa700 1 -- 172.21.15.92:0/4053179296 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f5f64006690 con 0x7f5f68067400 2024-08-17T02:24:23.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.408+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/4053179296 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f68152d60 con 0x7f5f68067400 2024-08-17T02:24:23.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.408+0000 7f5f5d7fa700 1 -- 172.21.15.92:0/4053179296 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5f64021060 con 0x7f5f68067400 2024-08-17T02:24:23.460 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:23.456+0000 7f3dc9186000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:24:23.493 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:23.486+0000 7ffb2942b000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:24:23.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.492+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/4053179296 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d68a56c4-97c2-43aa-9e56-6b71784a8266", "id": 7} v 0) v1 -- 0x7f5f680712b0 con 0x7f5f68067400 2024-08-17T02:24:23.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.504+0000 7f5f5d7fa700 1 -- 172.21.15.92:0/4053179296 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d68a56c4-97c2-43aa-9e56-6b71784a8266", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5f64017070 con 0x7f5f68067400 2024-08-17T02:24:23.507 INFO:teuthology.orchestra.run.smithi092.stdout:7 2024-08-17T02:24:23.508 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.504+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/4053179296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f68067400 msgr2=0x7f5f6814a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.504+0000 7f5f6f5cb700 1 --2- 172.21.15.92:0/4053179296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f68067400 0x7f5f6814a680 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400ec50 tx=0x7f5f64009250 comp rx=0 tx=0).stop 2024-08-17T02:24:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.504+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/4053179296 shutdown_connections 2024-08-17T02:24:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.504+0000 7f5f6f5cb700 1 --2- 172.21.15.92:0/4053179296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f681595e0 0x7f5f68167260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.504+0000 7f5f6f5cb700 1 --2- 172.21.15.92:0/4053179296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f6814fb70 0x7f5f680cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.504+0000 7f5f6f5cb700 1 --2- 172.21.15.92:0/4053179296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f68067400 0x7f5f6814a680 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.504+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/4053179296 >> 172.21.15.92:0/4053179296 conn(0x7f5f680cc720 msgr2=0x7f5f6814f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.504+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/4053179296 shutdown_connections 2024-08-17T02:24:23.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-08-17T02:24:23.508+0000 7f5f6f5cb700 1 -- 172.21.15.92:0/4053179296 wait complete. 2024-08-17T02:24:23.523 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:24:23.523 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:24:23.525 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:24:23.525 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:24:23.525 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:24:23.527 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:24:23.527 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:24:23.528 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:24:23.530 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:24:23.530 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:24:23.530 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:24:23.532 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:24:23.532 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:24:23.533 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:24:23.535 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:24:23.535 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:24:23.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:24:23.537 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:24:23.537 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:24:23.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:24:23.540 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:24:23.540 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:24:23.540 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:24:23.542 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:24:23.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:23.595 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:23.592+0000 7f3dc9186000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:24:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.638+0000 7fadd9f91700 1 Processor -- start 2024-08-17T02:24:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.638+0000 7fadd9f91700 1 -- start start 2024-08-17T02:24:23.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.638+0000 7fadd9f91700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fadd4069690 0x7fadd40acae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.638+0000 7fadd9f91700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fadd40ad020 0x7fadd40a9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.638+0000 7fadd9f91700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd40ac4e0 con 0x7fadd4153940 2024-08-17T02:24:23.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.638+0000 7fadd9f91700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd40ab8d0 con 0x7fadd4069690 2024-08-17T02:24:23.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.638+0000 7fadd9f91700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd40abbb0 con 0x7fadd40ad020 2024-08-17T02:24:23.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.638+0000 7fadd3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fadd4069690 0x7fadd40acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.638+0000 7fadd8f8f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fadd4153940 0x7fadd4068f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60560/0 (socket says 172.21.15.31:60560) 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.638+0000 7fadd8f8f700 1 -- 172.21.15.31:0/1788215179 learned_addr learned my addr 172.21.15.31:0/1788215179 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9790700 1 --2- 172.21.15.31:0/1788215179 >> v2:172.21.15.92:3300/0 conn(0x7fadd40ad020 0x7fadd40a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd3fff700 1 -- 172.21.15.31:0/1788215179 >> v2:172.21.15.92:3300/0 conn(0x7fadd40ad020 msgr2=0x7fadd40a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd3fff700 1 --2- 172.21.15.31:0/1788215179 >> v2:172.21.15.92:3300/0 conn(0x7fadd40ad020 0x7fadd40a9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd3fff700 1 -- 172.21.15.31:0/1788215179 >> v1:172.21.15.31:6789/0 conn(0x7fadd4153940 legacy=0x7fadd4068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd3fff700 1 -- 172.21.15.31:0/1788215179 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd40abe90 con 0x7fadd4069690 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd37fe700 1 -- 172.21.15.31:0/1788215179 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779894677 0 0) 0x7fadd40ac4e0 con 0x7fadd4153940 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd3fff700 1 --2- 172.21.15.31:0/1788215179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4069690 0x7fadd40acae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fadd406a6f0 tx=0x7fadc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293b39fa39ca5ddb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd37fe700 1 -- 172.21.15.31:0/1788215179 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4011630 con 0x7fadd4069690 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd37fe700 1 -- 172.21.15.31:0/1788215179 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc4011790 con 0x7fadd4069690 2024-08-17T02:24:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd37fe700 1 -- 172.21.15.31:0/1788215179 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4011b30 con 0x7fadd4069690 2024-08-17T02:24:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 -- 172.21.15.31:0/1788215179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4069690 msgr2=0x7fadd40acae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 --2- 172.21.15.31:0/1788215179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4069690 0x7fadd40acae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fadd406a6f0 tx=0x7fadc40091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 -- 172.21.15.31:0/1788215179 shutdown_connections 2024-08-17T02:24:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 --2- 172.21.15.31:0/1788215179 >> v2:172.21.15.92:3300/0 conn(0x7fadd40ad020 0x7fadd40a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 --2- 172.21.15.31:0/1788215179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4069690 0x7fadd40acae0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 -- 172.21.15.31:0/1788215179 >> 172.21.15.31:0/1788215179 conn(0x7fadd4067400 msgr2=0x7fadd4067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 -- 172.21.15.31:0/1788215179 shutdown_connections 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 -- 172.21.15.31:0/1788215179 wait complete. 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 Processor -- start 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 -- start start 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd4069690 0x7fadd4152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadd40ad020 0x7fadd40c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4153940 0x7fadd40c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd416cde0 con 0x7fadd4153940 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40afb10 con 0x7fadd4069690 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9f91700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd416d030 con 0x7fadd40ad020 2024-08-17T02:24:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9790700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4153940 0x7fadd40c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9790700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4153940 0x7fadd40c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54648/0 (socket says 172.21.15.31:54648) 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9790700 1 -- 172.21.15.31:0/4184827345 learned_addr learned my addr 172.21.15.31:0/4184827345 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd8f8f700 1 --2- 172.21.15.31:0/4184827345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd4069690 0x7fadd4152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd3fff700 1 --2- 172.21.15.31:0/4184827345 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadd40ad020 0x7fadd40c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9790700 1 -- 172.21.15.31:0/4184827345 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadd40ad020 msgr2=0x7fadd40c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9790700 1 --2- 172.21.15.31:0/4184827345 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadd40ad020 0x7fadd40c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.642+0000 7fadd9790700 1 -- 172.21.15.31:0/4184827345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd4069690 msgr2=0x7fadd4152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.646+0000 7fadd9790700 1 --2- 172.21.15.31:0/4184827345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd4069690 0x7fadd4152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.646+0000 7fadd9790700 1 -- 172.21.15.31:0/4184827345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4009420 con 0x7fadd4153940 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.646+0000 7fadd9790700 1 --2- 172.21.15.31:0/4184827345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4153940 0x7fadd40c9960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fadc800ea50 tx=0x7fadc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.646+0000 7fadd0ff9700 1 -- 172.21.15.31:0/4184827345 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800c850 con 0x7fadd4153940 2024-08-17T02:24:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.646+0000 7fadd9f91700 1 -- 172.21.15.31:0/4184827345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd416d310 con 0x7fadd4153940 2024-08-17T02:24:23.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.646+0000 7fadd0ff9700 1 -- 172.21.15.31:0/4184827345 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800c9d0 con 0x7fadd4153940 2024-08-17T02:24:23.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.646+0000 7fadd0ff9700 1 -- 172.21.15.31:0/4184827345 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800cd90 con 0x7fadd4153940 2024-08-17T02:24:23.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.646+0000 7fadd9f91700 1 -- 172.21.15.31:0/4184827345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd416db10 con 0x7fadd4153940 2024-08-17T02:24:23.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.646+0000 7fadd0ff9700 1 -- 172.21.15.31:0/4184827345 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fadc8005a00 con 0x7fadd4153940 2024-08-17T02:24:23.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.646+0000 7fadd0ff9700 1 -- 172.21.15.31:0/4184827345 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fadc8006020 con 0x7fadd4153940 2024-08-17T02:24:23.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.650+0000 7fadd9f91700 1 -- 172.21.15.31:0/4184827345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd40712b0 con 0x7fadd4153940 2024-08-17T02:24:23.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.654+0000 7fadd0ff9700 1 -- 172.21.15.31:0/4184827345 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fadc8021060 con 0x7fadd4153940 2024-08-17T02:24:23.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.718+0000 7fadd9f91700 1 -- 172.21.15.31:0/4184827345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadd406a020 con 0x7fadd4153940 2024-08-17T02:24:23.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.718+0000 7fadd0ff9700 1 -- 172.21.15.31:0/4184827345 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fadc8017070 con 0x7fadd4153940 2024-08-17T02:24:23.726 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:23.726 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:23.496675+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.722+0000 7fadd9f91700 1 -- 172.21.15.31:0/4184827345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4153940 msgr2=0x7fadd40c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.722+0000 7fadd9f91700 1 --2- 172.21.15.31:0/4184827345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4153940 0x7fadd40c9960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fadc800ea50 tx=0x7fadc80091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.722+0000 7fadd9f91700 1 -- 172.21.15.31:0/4184827345 shutdown_connections 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.722+0000 7fadd9f91700 1 --2- 172.21.15.31:0/4184827345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadd4153940 0x7fadd40c9960 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.722+0000 7fadd9f91700 1 --2- 172.21.15.31:0/4184827345 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadd40ad020 0x7fadd40c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.722+0000 7fadd9f91700 1 --2- 172.21.15.31:0/4184827345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadd4069690 0x7fadd4152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.722+0000 7fadd9f91700 1 -- 172.21.15.31:0/4184827345 >> 172.21.15.31:0/4184827345 conn(0x7fadd4067400 msgr2=0x7fadd415c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.722+0000 7fadd9f91700 1 -- 172.21.15.31:0/4184827345 shutdown_connections 2024-08-17T02:24:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:23.722+0000 7fadd9f91700 1 -- 172.21.15.31:0/4184827345 wait complete. 2024-08-17T02:24:23.743 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:24:23.744 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:24:23.812 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:23.806+0000 7ffb2942b000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:24:23.900 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-08-17T02:24:23.894+0000 7fbaa7bae3c0 -1 Falling back to public interface 2024-08-17T02:24:23.911 INFO:tasks.ceph.osd.5.smithi092.stderr:2024-08-17T02:24:23.908+0000 7fa25b1df3c0 -1 Falling back to public interface 2024-08-17T02:24:23.917 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:23.916+0000 7f3dc9186000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:24:23.978 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:23.970+0000 7ffb2942b000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:24.045 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:24.038+0000 7ffb2942b000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:24:24.079 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:24.076+0000 7f3dc9186000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:24.100 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:24.094+0000 7ffb2942b000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:24:24.145 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:24.144+0000 7f3dc9186000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:24:24.159 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:24.154+0000 7ffb2942b000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:24:24.160 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-08-17T02:24:24.154+0000 7f3d42b0e3c0 -1 Falling back to public interface 2024-08-17T02:24:24.167 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-08-17T02:24:24.162+0000 7f3bb0b5c3c0 -1 Falling back to public interface 2024-08-17T02:24:24.168 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-08-17T02:24:24.162+0000 7fc6830f23c0 -1 Falling back to public interface 2024-08-17T02:24:24.170 INFO:tasks.ceph.osd.6.smithi092.stderr:2024-08-17T02:24:24.168+0000 7fc534b713c0 -1 Falling back to public interface 2024-08-17T02:24:24.171 INFO:tasks.ceph.osd.4.smithi092.stderr:2024-08-17T02:24:24.168+0000 7fa6ba1513c0 -1 Falling back to public interface 2024-08-17T02:24:24.194 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:24.192+0000 7f3dc9186000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:24:24.197 INFO:tasks.ceph.osd.7.smithi092.stderr:2024-08-17T02:24:24.196+0000 7fd11ae813c0 -1 Falling back to public interface 2024-08-17T02:24:24.245 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:24.244+0000 7f3dc9186000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:24:24.328 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:24.322+0000 7ffb2942b000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:24.410 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:24.408+0000 7f3dc9186000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:24.490 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:24.486+0000 7ffb2942b000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:24:24.550 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:24.558 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:24.550+0000 7ffb2942b000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:24:24.572 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:24.568+0000 7f3dc9186000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:24:24.637 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:24.636+0000 7f3dc9186000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:24:24.645 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98f0df2700 1 Processor -- start 2024-08-17T02:24:24.645 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98f0df2700 1 -- start start 2024-08-17T02:24:24.647 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98f0df2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f98ec155f70 0x7f98ec068e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.647 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98f0df2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 0x7f98ec06c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.647 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98f0df2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ec0ca200 con 0x7f98ec068ab0 2024-08-17T02:24:24.647 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98f0df2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec06c960 con 0x7f98ec155f70 2024-08-17T02:24:24.647 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98f0df2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0c98d0 con 0x7f98ec06bc30 2024-08-17T02:24:24.647 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98eb7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f98ec068ab0 0x7f98ec155860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60568/0 (socket says 172.21.15.31:60568) 2024-08-17T02:24:24.647 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98eb7fe700 1 -- 172.21.15.31:0/2680629903 learned_addr learned my addr 172.21.15.31:0/2680629903 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:24.647 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98ebfff700 1 --2- 172.21.15.31:0/2680629903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 0x7f98ec06c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.647 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98eaffd700 1 --2- 172.21.15.31:0/2680629903 >> v2:172.21.15.92:3300/0 conn(0x7f98ec155f70 0x7f98ec068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.648 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98ea7fc700 1 -- 172.21.15.31:0/2680629903 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318986889 0 0) 0x7f98ec0ca200 con 0x7f98ec068ab0 2024-08-17T02:24:24.648 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.638+0000 7f98ea7fc700 1 -- 172.21.15.31:0/2680629903 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98d4003570 con 0x7f98ec068ab0 2024-08-17T02:24:24.648 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98ebfff700 1 -- 172.21.15.31:0/2680629903 >> v2:172.21.15.92:3300/0 conn(0x7f98ec155f70 msgr2=0x7f98ec068e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:24.648 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98ebfff700 1 --2- 172.21.15.31:0/2680629903 >> v2:172.21.15.92:3300/0 conn(0x7f98ec155f70 0x7f98ec068e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.648 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98ebfff700 1 -- 172.21.15.31:0/2680629903 >> v1:172.21.15.31:6789/0 conn(0x7f98ec068ab0 legacy=0x7f98ec155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.648 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98ebfff700 1 -- 172.21.15.31:0/2680629903 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec0c9bb0 con 0x7f98ec06bc30 2024-08-17T02:24:24.648 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98ebfff700 1 --2- 172.21.15.31:0/2680629903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 0x7f98ec06c0b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009e60 tx=0x7f98e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c6b28c74cd9a809 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:24.648 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98ea7fc700 1 -- 172.21.15.31:0/2680629903 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400e070 con 0x7f98ec06bc30 2024-08-17T02:24:24.648 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98ea7fc700 1 -- 172.21.15.31:0/2680629903 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e400bab0 con 0x7f98ec06bc30 2024-08-17T02:24:24.648 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98ea7fc700 1 -- 172.21.15.31:0/2680629903 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400be30 con 0x7f98ec06bc30 2024-08-17T02:24:24.649 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98f0df2700 1 -- 172.21.15.31:0/2680629903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 msgr2=0x7f98ec06c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.649 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98f0df2700 1 --2- 172.21.15.31:0/2680629903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 0x7f98ec06c0b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009e60 tx=0x7f98e4009780 comp rx=0 tx=0).stop 2024-08-17T02:24:24.649 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98f0df2700 1 -- 172.21.15.31:0/2680629903 shutdown_connections 2024-08-17T02:24:24.649 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98f0df2700 1 --2- 172.21.15.31:0/2680629903 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 0x7f98ec06c0b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.649 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98f0df2700 1 --2- 172.21.15.31:0/2680629903 >> v2:172.21.15.92:3300/0 conn(0x7f98ec155f70 0x7f98ec068e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.650 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98f0df2700 1 -- 172.21.15.31:0/2680629903 >> 172.21.15.31:0/2680629903 conn(0x7f98ec068480 msgr2=0x7f98ec0b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:24.650 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98f0df2700 1 -- 172.21.15.31:0/2680629903 shutdown_connections 2024-08-17T02:24:24.650 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98f0df2700 1 -- 172.21.15.31:0/2680629903 wait complete. 2024-08-17T02:24:24.650 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98f0df2700 1 Processor -- start 2024-08-17T02:24:24.651 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.642+0000 7f98f0df2700 1 -- start start 2024-08-17T02:24:24.653 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98f0df2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98ec068ab0 0x7f98ec14beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.653 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98f0df2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 0x7f98ec150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.653 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98f0df2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec155f70 0x7f98ec151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:24.653 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98f0df2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec14eef0 con 0x7f98ec068ab0 2024-08-17T02:24:24.653 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98f0df2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec14e2e0 con 0x7f98ec155f70 2024-08-17T02:24:24.653 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98f0df2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec14e5c0 con 0x7f98ec06bc30 2024-08-17T02:24:24.654 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98ec068ab0 0x7f98ec14beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.654 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98ec068ab0 0x7f98ec14beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54662/0 (socket says 172.21.15.31:54662) 2024-08-17T02:24:24.654 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eaffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 0x7f98ec150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.654 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eb7fe700 1 -- 172.21.15.31:0/494559310 learned_addr learned my addr 172.21.15.31:0/494559310 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:24.654 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98ebfff700 1 --2- 172.21.15.31:0/494559310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec155f70 0x7f98ec151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:24.654 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eb7fe700 1 -- 172.21.15.31:0/494559310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 msgr2=0x7f98ec150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.654 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eb7fe700 1 --2- 172.21.15.31:0/494559310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 0x7f98ec150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.654 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eb7fe700 1 -- 172.21.15.31:0/494559310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec155f70 msgr2=0x7f98ec151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.654 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eb7fe700 1 --2- 172.21.15.31:0/494559310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec155f70 0x7f98ec151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.654 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eb7fe700 1 -- 172.21.15.31:0/494559310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e4009a20 con 0x7f98ec068ab0 2024-08-17T02:24:24.655 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98ebfff700 1 --2- 172.21.15.31:0/494559310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec155f70 0x7f98ec151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:24.655 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eaffd700 1 --2- 172.21.15.31:0/494559310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 0x7f98ec150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:24.655 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98eb7fe700 1 --2- 172.21.15.31:0/494559310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98ec068ab0 0x7f98ec14beb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0011e0 tx=0x7f98dc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:24.655 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98d37fe700 1 -- 172.21.15.31:0/494559310 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc005b30 con 0x7f98ec068ab0 2024-08-17T02:24:24.655 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98d37fe700 1 -- 172.21.15.31:0/494559310 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc005c90 con 0x7f98ec068ab0 2024-08-17T02:24:24.655 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98f0df2700 1 -- 172.21.15.31:0/494559310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec14e8a0 con 0x7f98ec068ab0 2024-08-17T02:24:24.655 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98f0df2700 1 -- 172.21.15.31:0/494559310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec14c3f0 con 0x7f98ec068ab0 2024-08-17T02:24:24.655 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98d37fe700 1 -- 172.21.15.31:0/494559310 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc005e00 con 0x7f98ec068ab0 2024-08-17T02:24:24.655 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98d37fe700 1 -- 172.21.15.31:0/494559310 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f98dc0074f0 con 0x7f98ec068ab0 2024-08-17T02:24:24.655 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98d37fe700 1 -- 172.21.15.31:0/494559310 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f98dc012ae0 con 0x7f98ec068ab0 2024-08-17T02:24:24.656 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.646+0000 7f98f0df2700 1 -- 172.21.15.31:0/494559310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec066b30 con 0x7f98ec068ab0 2024-08-17T02:24:24.658 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.650+0000 7f98d37fe700 1 -- 172.21.15.31:0/494559310 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f98dc021060 con 0x7f98ec068ab0 2024-08-17T02:24:24.722 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98f0df2700 1 -- 172.21.15.31:0/494559310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98ec06c000 con 0x7f98ec068ab0 2024-08-17T02:24:24.723 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98d37fe700 1 -- 172.21.15.31:0/494559310 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f98dc017070 con 0x7f98ec068ab0 2024-08-17T02:24:24.723 INFO:teuthology.misc.health.smithi031.stdout: 2024-08-17T02:24:24.724 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":10,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:23.496675+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:24.725 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98f0df2700 1 -- 172.21.15.31:0/494559310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98ec068ab0 msgr2=0x7f98ec14beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:24.725 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98f0df2700 1 --2- 172.21.15.31:0/494559310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98ec068ab0 0x7f98ec14beb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0011e0 tx=0x7f98dc007df0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.725 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98f0df2700 1 -- 172.21.15.31:0/494559310 shutdown_connections 2024-08-17T02:24:24.725 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98f0df2700 1 --2- 172.21.15.31:0/494559310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98ec155f70 0x7f98ec151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.725 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98f0df2700 1 --2- 172.21.15.31:0/494559310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98ec06bc30 0x7f98ec150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.725 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98f0df2700 1 --2- 172.21.15.31:0/494559310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98ec068ab0 0x7f98ec14beb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:24.725 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98f0df2700 1 -- 172.21.15.31:0/494559310 >> 172.21.15.31:0/494559310 conn(0x7f98ec068480 msgr2=0x7f98ec158460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:24.725 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98f0df2700 1 -- 172.21.15.31:0/494559310 shutdown_connections 2024-08-17T02:24:24.726 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:24.718+0000 7f98f0df2700 1 -- 172.21.15.31:0/494559310 wait complete. 2024-08-17T02:24:24.733 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:24.726+0000 7ffb2942b000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:24:24.734 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:24:24.797 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:24.796+0000 7f3dc9186000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:24:24.801 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:24.794+0000 7ffb2942b000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:24:24.865 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:24.860+0000 7f3dc9186000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:24:25.538 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:25.530+0000 7ffb2942b000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:24:25.566 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-08-17T02:24:25.564+0000 7f3dc9186000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:24:26.589 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:26.582+0000 7ffb124a0700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:24:26.590 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-08-17T02:24:26.586+0000 7ffb124a0700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:24:27.517 INFO:tasks.ceph.osd.5.smithi092.stderr:2024-08-17T02:24:27.516+0000 7fa25b1df3c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:24:27.728 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-08-17T02:24:27.722+0000 7fbaa7bae3c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:24:27.942 INFO:tasks.ceph.osd.4.smithi092.stderr:2024-08-17T02:24:27.940+0000 7fa6ba1513c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:24:27.974 INFO:tasks.ceph.osd.6.smithi092.stderr:2024-08-17T02:24:27.972+0000 7fc534b713c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:24:27.997 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-08-17T02:24:27.990+0000 7fc6830f23c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:24:27.997 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-08-17T02:24:27.990+0000 7f3bb0b5c3c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:24:27.997 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-08-17T02:24:27.990+0000 7f3d42b0e3c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:24:28.067 INFO:tasks.ceph.osd.7.smithi092.stderr:2024-08-17T02:24:28.064+0000 7fd11ae813c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:24:30.228 INFO:tasks.ceph.osd.5.smithi092.stderr:2024-08-17T02:24:30.224+0000 7fa25697f700 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:24:30.291 INFO:tasks.ceph.osd.5.smithi092.stderr:2024-08-17T02:24:30.288+0000 7fa24f722700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:31.433 INFO:tasks.ceph.osd.4.smithi092.stderr:2024-08-17T02:24:31.432+0000 7fa6b58f1700 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:24:31.437 INFO:tasks.ceph.osd.4.smithi092.stderr:2024-08-17T02:24:31.436+0000 7fa6ae694700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:31.450 INFO:tasks.ceph.osd.7.smithi092.stderr:2024-08-17T02:24:31.448+0000 7fd117e46700 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:24:31.457 INFO:tasks.ceph.osd.7.smithi092.stderr:2024-08-17T02:24:31.456+0000 7fd10f3c4700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:31.487 INFO:tasks.ceph.osd.6.smithi092.stderr:2024-08-17T02:24:31.484+0000 7fc531b36700 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:24:31.499 INFO:tasks.ceph.osd.6.smithi092.stderr:2024-08-17T02:24:31.496+0000 7fc5290b4700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:31.540 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:31.666 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.658+0000 7f390bfff700 1 Processor -- start 2024-08-17T02:24:31.666 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.658+0000 7f390bfff700 1 -- start start 2024-08-17T02:24:31.667 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.658+0000 7f390bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f390c0cca40 0x7f390c06e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.667 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.658+0000 7f390bfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c161e80 con 0x7f390c140560 2024-08-17T02:24:31.667 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.658+0000 7f390bfff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c161270 con 0x7f390c140190 2024-08-17T02:24:31.667 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.658+0000 7f390bfff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c161550 con 0x7f390c0cca40 2024-08-17T02:24:31.667 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.658+0000 7f390b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f390c140560 0x7f390c15ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38904/0 (socket says 172.21.15.31:38904) 2024-08-17T02:24:31.667 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.658+0000 7f390b7fe700 1 -- 172.21.15.31:0/4034463703 learned_addr learned my addr 172.21.15.31:0/4034463703 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:31.667 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192093031 0 0) 0x7f390c161e80 con 0x7f390c140560 2024-08-17T02:24:31.667 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f4003570 con 0x7f390c140560 2024-08-17T02:24:31.669 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390a7fc700 1 --2- 172.21.15.31:0/4034463703 >> v2:172.21.15.92:3300/0 conn(0x7f390c0cca40 0x7f390c06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.669 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806776900 0 0) 0x7f390c161270 con 0x7f390c140190 2024-08-17T02:24:31.669 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f390c161e80 con 0x7f390c140190 2024-08-17T02:24:31.669 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3028828009 0 0) 0x7f38f4003570 con 0x7f390c140560 2024-08-17T02:24:31.669 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 >> v2:172.21.15.92:3300/0 conn(0x7f390c0cca40 msgr2=0x7f390c06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 --2- 172.21.15.31:0/4034463703 >> v2:172.21.15.92:3300/0 conn(0x7f390c0cca40 0x7f390c06e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 >> v1:172.21.15.92:6789/0 conn(0x7f390c140190 legacy=0x7f390c0aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c161830 con 0x7f390c140560 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f38fc001470 con 0x7f390c140560 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 >> v1:172.21.15.31:6789/0 conn(0x7f390c140560 legacy=0x7f390c15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38f4003cb0 0x7f38f40040a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38f4004810 0x7f38f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38f4005280 0x7f38f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c161550 con 0x7f38f4004810 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f400c230 con 0x7f38f4005280 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f400c3f0 con 0x7f38f4003cb0 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390a7fc700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38f4004810 0x7f38f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.670 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390affd700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38f4003cb0 0x7f38f40040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390b7fe700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38f4005280 0x7f38f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390a7fc700 1 -- 172.21.15.31:0/4034463703 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38f4003cb0 msgr2=0x7f38f40040a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390a7fc700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38f4003cb0 0x7f38f40040a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390a7fc700 1 -- 172.21.15.31:0/4034463703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38f4005280 msgr2=0x7f38f400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390a7fc700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38f4005280 0x7f38f400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390a7fc700 1 -- 172.21.15.31:0/4034463703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4003570 con 0x7f38f4004810 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390b7fe700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38f4005280 0x7f38f400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390b7fe700 1 -- 172.21.15.31:0/4034463703 reap_dead start 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390a7fc700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38f4004810 0x7f38f4004c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f390c15b730 tx=0x7f39000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad11325fd3fce65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390000e6e0 con 0x7f38f4004810 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390000e840 con 0x7f38f4004810 2024-08-17T02:24:31.671 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f3909ffb700 1 -- 172.21.15.31:0/4034463703 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390000ec00 con 0x7f38f4004810 2024-08-17T02:24:31.672 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390bfff700 1 -- 172.21.15.31:0/4034463703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38f4004810 msgr2=0x7f38f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.672 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.662+0000 7f390bfff700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38f4004810 0x7f38f4004c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f390c15b730 tx=0x7f39000091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.672 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.666+0000 7f390bfff700 1 -- 172.21.15.31:0/4034463703 shutdown_connections 2024-08-17T02:24:31.672 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.666+0000 7f390bfff700 1 --2- 172.21.15.31:0/4034463703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38f4004810 0x7f38f4004c80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.672 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.666+0000 7f390bfff700 1 -- 172.21.15.31:0/4034463703 >> 172.21.15.31:0/4034463703 conn(0x7f390c067d80 msgr2=0x7f390c0cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:31.672 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.666+0000 7f390bfff700 1 -- 172.21.15.31:0/4034463703 shutdown_connections 2024-08-17T02:24:31.672 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.666+0000 7f390bfff700 1 -- 172.21.15.31:0/4034463703 wait complete. 2024-08-17T02:24:31.674 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.666+0000 7f390bfff700 1 Processor -- start 2024-08-17T02:24:31.674 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.666+0000 7f390bfff700 1 -- start start 2024-08-17T02:24:31.675 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f390c136b80 0x7f390c1607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.675 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c160d00 0x7f390c1321b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.675 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390bfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f390c1326f0 0x7f390c1409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.675 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390bfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c15b440 con 0x7f390c160d00 2024-08-17T02:24:31.676 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390bfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c160330 con 0x7f390c136b80 2024-08-17T02:24:31.676 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390bfff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c132b70 con 0x7f390c1326f0 2024-08-17T02:24:31.676 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f390c136b80 0x7f390c1607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.676 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f390c136b80 0x7f390c1607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:43862/0 (socket says 172.21.15.31:43862) 2024-08-17T02:24:31.676 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390affd700 1 -- 172.21.15.31:0/1312128253 learned_addr learned my addr 172.21.15.31:0/1312128253 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:31.676 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390b7fe700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f390c1326f0 0x7f390c1409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.676 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390a7fc700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c160d00 0x7f390c1321b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.677 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390b7fe700 1 -- 172.21.15.31:0/1312128253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f390c136b80 msgr2=0x7f390c1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.677 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390b7fe700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f390c136b80 0x7f390c1607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.677 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390b7fe700 1 -- 172.21.15.31:0/1312128253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c160d00 msgr2=0x7f390c1321b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.677 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390b7fe700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c160d00 0x7f390c1321b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.677 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390b7fe700 1 -- 172.21.15.31:0/1312128253 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c143640 con 0x7f390c1326f0 2024-08-17T02:24:31.677 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390b7fe700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f390c1326f0 0x7f390c1409e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f390c140930 tx=0x7f38fc000f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.677 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f38f2ffd700 1 -- 172.21.15.31:0/1312128253 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc014430 con 0x7f390c1326f0 2024-08-17T02:24:31.677 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390bfff700 1 -- 172.21.15.31:0/1312128253 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c143920 con 0x7f390c1326f0 2024-08-17T02:24:31.678 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f38f2ffd700 1 -- 172.21.15.31:0/1312128253 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc0145d0 con 0x7f390c1326f0 2024-08-17T02:24:31.678 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f38f2ffd700 1 -- 172.21.15.31:0/1312128253 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc014990 con 0x7f390c1326f0 2024-08-17T02:24:31.678 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.670+0000 7f390bfff700 1 -- 172.21.15.31:0/1312128253 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c15ffc0 con 0x7f390c1326f0 2024-08-17T02:24:31.678 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.674+0000 7f390bfff700 1 -- 172.21.15.31:0/1312128253 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c1604c0 con 0x7f390c1326f0 2024-08-17T02:24:31.679 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.674+0000 7f38f2ffd700 1 -- 172.21.15.31:0/1312128253 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 4) v1 ==== 80087+0+0 (secure 0 0 0) 0x7f38fc014d40 con 0x7f390c1326f0 2024-08-17T02:24:31.680 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.674+0000 7f38f2ffd700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f38f80607d0 0x7f38f8062c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:31.680 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.674+0000 7f38f2ffd700 1 -- 172.21.15.31:0/1312128253 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2507+0+0 (secure 0 0 0) 0x7f38fc07b250 con 0x7f390c1326f0 2024-08-17T02:24:31.680 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.674+0000 7f390affd700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f38f80607d0 0x7f38f8062c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:31.680 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.674+0000 7f390affd700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f38f80607d0 0x7f38f8062c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f390c134560 tx=0x7f39040017a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:31.689 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.682+0000 7f38f2ffd700 1 -- 172.21.15.31:0/1312128253 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f38fc04b480 con 0x7f390c1326f0 2024-08-17T02:24:31.869 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-08-17T02:24:31.862+0000 7fc67e892700 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:24:31.873 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-08-17T02:24:31.866+0000 7fbaa4b73700 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:24:31.876 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-08-17T02:24:31.870+0000 7fc677635700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:31.879 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-08-17T02:24:31.874+0000 7fba9c0f1700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:31.900 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-08-17T02:24:31.894+0000 7f3bac2fc700 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:24:31.907 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-08-17T02:24:31.902+0000 7f3d3e2ae700 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:24:31.908 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-08-17T02:24:31.902+0000 7f3ba509f700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:31.911 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-08-17T02:24:31.906+0000 7f3d37051700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:24:31.952 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.946+0000 7f390bfff700 1 -- 172.21.15.31:0/1312128253 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f390c066b30 con 0x7f390c1326f0 2024-08-17T02:24:31.954 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.946+0000 7f38f2ffd700 1 -- 172.21.15.31:0/1312128253 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7450 (secure 0 0 0) 0x7f38fc04c3e0 con 0x7f390c1326f0 2024-08-17T02:24:31.954 INFO:teuthology.misc.health.smithi031.stdout: 2024-08-17T02:24:31.954 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":14,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:31.375341+0000","last_up_change":"2024-08-17T02:24:31.375341+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:31.956 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 -- 172.21.15.31:0/1312128253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f38f80607d0 msgr2=0x7f38f8062c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.956 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f38f80607d0 0x7f38f8062c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f390c134560 tx=0x7f39040017a0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.956 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 -- 172.21.15.31:0/1312128253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f390c1326f0 msgr2=0x7f390c1409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:31.956 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f390c1326f0 0x7f390c1409e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f390c140930 tx=0x7f38fc000f80 comp rx=0 tx=0).stop 2024-08-17T02:24:31.956 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 -- 172.21.15.31:0/1312128253 shutdown_connections 2024-08-17T02:24:31.956 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f38f80607d0 0x7f38f8062c80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.957 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f390c1326f0 0x7f390c1409e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.957 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c160d00 0x7f390c1321b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.957 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 --2- 172.21.15.31:0/1312128253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f390c136b80 0x7f390c1607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:31.957 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 -- 172.21.15.31:0/1312128253 >> 172.21.15.31:0/1312128253 conn(0x7f390c067d80 msgr2=0x7f390c13a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:31.957 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 -- 172.21.15.31:0/1312128253 shutdown_connections 2024-08-17T02:24:31.957 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:31.950+0000 7f390bfff700 1 -- 172.21.15.31:0/1312128253 wait complete. 2024-08-17T02:24:31.966 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-08-17T02:24:38.773 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:38.879 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 Processor -- start 2024-08-17T02:24:38.879 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 -- start start 2024-08-17T02:24:38.880 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f65200685b0 0x7f6520068980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.880 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f65200b02c0 0x7f65200c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.880 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65200c94b0 con 0x7f65201591c0 2024-08-17T02:24:38.880 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65200c9750 con 0x7f65200b02c0 2024-08-17T02:24:38.880 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65200c9a30 con 0x7f65200685b0 2024-08-17T02:24:38.880 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f65200b02c0 0x7f65200c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.880 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f65200b02c0 0x7f65200c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49374/0 (socket says 172.21.15.31:49374) 2024-08-17T02:24:38.880 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651effd700 1 -- 172.21.15.31:0/270327206 learned_addr learned my addr 172.21.15.31:0/270327206 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:38.880 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651f7fe700 1 --2- 172.21.15.31:0/270327206 >> v2:172.21.15.92:3300/0 conn(0x7f65200685b0 0x7f6520068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.881 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651effd700 1 -- 172.21.15.31:0/270327206 >> v2:172.21.15.92:3300/0 conn(0x7f65200685b0 msgr2=0x7f6520068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:38.881 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651effd700 1 --2- 172.21.15.31:0/270327206 >> v2:172.21.15.92:3300/0 conn(0x7f65200685b0 0x7f6520068980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.881 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651effd700 1 -- 172.21.15.31:0/270327206 >> v1:172.21.15.92:6789/0 conn(0x7f65201591c0 legacy=0x7f65201595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.881 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651effd700 1 -- 172.21.15.31:0/270327206 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65200c9d10 con 0x7f65200b02c0 2024-08-17T02:24:38.881 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651effd700 1 --2- 172.21.15.31:0/270327206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200b02c0 0x7f65200c8f70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f652006fa10 tx=0x7f6510009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cde0cbad8b5bb18 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.881 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651e7fc700 1 -- 172.21.15.31:0/270327206 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651000e070 con 0x7f65200b02c0 2024-08-17T02:24:38.882 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651e7fc700 1 -- 172.21.15.31:0/270327206 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651000b990 con 0x7f65200b02c0 2024-08-17T02:24:38.882 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f651e7fc700 1 -- 172.21.15.31:0/270327206 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65100092e0 con 0x7f65200b02c0 2024-08-17T02:24:38.882 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 -- 172.21.15.31:0/270327206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200b02c0 msgr2=0x7f65200c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.882 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 --2- 172.21.15.31:0/270327206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200b02c0 0x7f65200c8f70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f652006fa10 tx=0x7f6510009840 comp rx=0 tx=0).stop 2024-08-17T02:24:38.883 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 -- 172.21.15.31:0/270327206 shutdown_connections 2024-08-17T02:24:38.883 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 --2- 172.21.15.31:0/270327206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200b02c0 0x7f65200c8f70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.883 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 --2- 172.21.15.31:0/270327206 >> v2:172.21.15.92:3300/0 conn(0x7f65200685b0 0x7f6520068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.883 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.874+0000 7f6524c44700 1 -- 172.21.15.31:0/270327206 >> 172.21.15.31:0/270327206 conn(0x7f65200697e0 msgr2=0x7f6520069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:38.883 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.878+0000 7f6524c44700 1 -- 172.21.15.31:0/270327206 shutdown_connections 2024-08-17T02:24:38.883 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.878+0000 7f6524c44700 1 -- 172.21.15.31:0/270327206 wait complete. 2024-08-17T02:24:38.885 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.878+0000 7f6524c44700 1 Processor -- start 2024-08-17T02:24:38.885 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.878+0000 7f6524c44700 1 -- start start 2024-08-17T02:24:38.887 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f6524c44700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200685b0 0x7f6520138250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.887 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f6524c44700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65200b02c0 0x7f6520138790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.887 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f6524c44700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65201591c0 0x7f652016ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.887 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f6524c44700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6520157980 con 0x7f65200685b0 2024-08-17T02:24:38.887 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f6524c44700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6520138db0 con 0x7f65200b02c0 2024-08-17T02:24:38.887 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f6524c44700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6520139090 con 0x7f65201591c0 2024-08-17T02:24:38.887 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200685b0 0x7f6520138250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.887 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200685b0 0x7f6520138250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49390/0 (socket says 172.21.15.31:49390) 2024-08-17T02:24:38.888 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651f7fe700 1 -- 172.21.15.31:0/2167323415 learned_addr learned my addr 172.21.15.31:0/2167323415 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:38.888 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651effd700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65200b02c0 0x7f6520138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.888 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651ffff700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65201591c0 0x7f652016ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.889 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651f7fe700 1 -- 172.21.15.31:0/2167323415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65201591c0 msgr2=0x7f652016ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.889 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651f7fe700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65201591c0 0x7f652016ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.889 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651f7fe700 1 -- 172.21.15.31:0/2167323415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65200b02c0 msgr2=0x7f6520138790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:38.889 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651f7fe700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65200b02c0 0x7f6520138790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:38.889 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651f7fe700 1 -- 172.21.15.31:0/2167323415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6510009ae0 con 0x7f65200685b0 2024-08-17T02:24:38.889 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651ffff700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65201591c0 0x7f652016ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:38.889 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f651f7fe700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200685b0 0x7f6520138250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f650800ec80 tx=0x7f65080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.890 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f65177fe700 1 -- 172.21.15.31:0/2167323415 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650800c850 con 0x7f65200685b0 2024-08-17T02:24:38.890 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f65177fe700 1 -- 172.21.15.31:0/2167323415 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650800c9b0 con 0x7f65200685b0 2024-08-17T02:24:38.890 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f6524c44700 1 -- 172.21.15.31:0/2167323415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6520139370 con 0x7f65200685b0 2024-08-17T02:24:38.890 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f65177fe700 1 -- 172.21.15.31:0/2167323415 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650800cd50 con 0x7f65200685b0 2024-08-17T02:24:38.890 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f6524c44700 1 -- 172.21.15.31:0/2167323415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65201483f0 con 0x7f65200685b0 2024-08-17T02:24:38.890 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.882+0000 7f6524c44700 1 -- 172.21.15.31:0/2167323415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6520066b30 con 0x7f65200685b0 2024-08-17T02:24:38.890 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.886+0000 7f65177fe700 1 -- 172.21.15.31:0/2167323415 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6508013680 con 0x7f65200685b0 2024-08-17T02:24:38.891 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.886+0000 7f65177fe700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6500060860 0x7f6500062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:38.891 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.886+0000 7f65177fe700 1 -- 172.21.15.31:0/2167323415 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f650807cee0 con 0x7f65200685b0 2024-08-17T02:24:38.892 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.886+0000 7f651effd700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6500060860 0x7f6500062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:38.892 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.886+0000 7f651effd700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6500060860 0x7f6500062d10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6510009880 tx=0x7f6510018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:38.898 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:38.894+0000 7f65177fe700 1 -- 172.21.15.31:0/2167323415 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f650804d680 con 0x7f65200685b0 2024-08-17T02:24:39.065 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.058+0000 7f6524c44700 1 -- 172.21.15.31:0/2167323415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65200b14b0 con 0x7f65200685b0 2024-08-17T02:24:39.066 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f65177fe700 1 -- 172.21.15.31:0/2167323415 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f6508017090 con 0x7f65200685b0 2024-08-17T02:24:39.067 INFO:teuthology.misc.health.smithi031.stdout: 2024-08-17T02:24:39.067 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":19,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:36.480855+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:39.069 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 -- 172.21.15.31:0/2167323415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6500060860 msgr2=0x7f6500062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.069 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6500060860 0x7f6500062d10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6510009880 tx=0x7f6510018000 comp rx=0 tx=0).stop 2024-08-17T02:24:39.069 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 -- 172.21.15.31:0/2167323415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200685b0 msgr2=0x7f6520138250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.069 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200685b0 0x7f6520138250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f650800ec80 tx=0x7f65080091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.069 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 -- 172.21.15.31:0/2167323415 shutdown_connections 2024-08-17T02:24:39.069 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6500060860 0x7f6500062d10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.069 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65201591c0 0x7f652016ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.070 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65200b02c0 0x7f6520138790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.070 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 --2- 172.21.15.31:0/2167323415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f65200685b0 0x7f6520138250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.070 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 -- 172.21.15.31:0/2167323415 >> 172.21.15.31:0/2167323415 conn(0x7f65200697e0 msgr2=0x7f6520141750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.070 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 -- 172.21.15.31:0/2167323415 shutdown_connections 2024-08-17T02:24:39.070 INFO:teuthology.misc.health.smithi031.stderr:2024-08-17T02:24:39.062+0000 7f6524c44700 1 -- 172.21.15.31:0/2167323415 wait complete. 2024-08-17T02:24:39.079 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:24:39.080 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:24:39.080 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:24:39.080 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:24:39.082 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:24:39.082 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:24:39.083 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:24:39.085 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:24:39.085 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:24:39.085 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:24:39.088 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:24:39.088 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:24:39.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:24:39.091 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:24:39.091 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:24:39.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:39.167 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-08-17T02:24:39.168 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-08-17T02:24:39.175 INFO:tasks.ceph.mds.d.smithi092.stdout:starting mds.d at 2024-08-17T02:24:39.186 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2024-08-17T02:24:39.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.186+0000 7f88fe0e8700 1 Processor -- start 2024-08-17T02:24:39.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.186+0000 7f88fe0e8700 1 -- start start 2024-08-17T02:24:39.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f88f806b710 0x7f88f806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f88f80cda20 0x7f88f80c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f80ca260 con 0x7f88f81405d0 2024-08-17T02:24:39.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f80ae710 con 0x7f88f806b710 2024-08-17T02:24:39.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f80ca7e0 con 0x7f88f80cda20 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fd0e6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f88f806b710 0x7f88f806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fd0e6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f88f806b710 0x7f88f806bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49444/0 (socket says 172.21.15.31:49444) 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fd8e7700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f88f81405d0 0x7f88f81409e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38912/0 (socket says 172.21.15.31:38912) 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fd0e6700 1 -- 172.21.15.31:0/1909432570 learned_addr learned my addr 172.21.15.31:0/1909432570 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fc8e5700 1 --2- 172.21.15.31:0/1909432570 >> v2:172.21.15.92:3300/0 conn(0x7f88f80cda20 0x7f88f80c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fd0e6700 1 -- 172.21.15.31:0/1909432570 >> v2:172.21.15.92:3300/0 conn(0x7f88f80cda20 msgr2=0x7f88f80c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fd0e6700 1 --2- 172.21.15.31:0/1909432570 >> v2:172.21.15.92:3300/0 conn(0x7f88f80cda20 0x7f88f80c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fd0e6700 1 -- 172.21.15.31:0/1909432570 >> v1:172.21.15.31:6789/0 conn(0x7f88f81405d0 legacy=0x7f88f81409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fd0e6700 1 -- 172.21.15.31:0/1909432570 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f80ca500 con 0x7f88f806b710 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88effff700 1 -- 172.21.15.31:0/1909432570 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610048003 0 0) 0x7f88f80ca260 con 0x7f88f81405d0 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fd0e6700 1 --2- 172.21.15.31:0/1909432570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 0x7f88f806bae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88f806c500 tx=0x7f88f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8446fa7a917002 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88effff700 1 -- 172.21.15.31:0/1909432570 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400b860 con 0x7f88f806b710 2024-08-17T02:24:39.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88effff700 1 -- 172.21.15.31:0/1909432570 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f400b9c0 con 0x7f88f806b710 2024-08-17T02:24:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88effff700 1 -- 172.21.15.31:0/1909432570 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400bd60 con 0x7f88f806b710 2024-08-17T02:24:39.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 -- 172.21.15.31:0/1909432570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 msgr2=0x7f88f806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 --2- 172.21.15.31:0/1909432570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 0x7f88f806bae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f88f806c500 tx=0x7f88f4009250 comp rx=0 tx=0).stop 2024-08-17T02:24:39.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 -- 172.21.15.31:0/1909432570 shutdown_connections 2024-08-17T02:24:39.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 --2- 172.21.15.31:0/1909432570 >> v2:172.21.15.92:3300/0 conn(0x7f88f80cda20 0x7f88f80c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 --2- 172.21.15.31:0/1909432570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 0x7f88f806bae0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 -- 172.21.15.31:0/1909432570 >> 172.21.15.31:0/1909432570 conn(0x7f88f80cdf90 msgr2=0x7f88f80ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 -- 172.21.15.31:0/1909432570 shutdown_connections 2024-08-17T02:24:39.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.190+0000 7f88fe0e8700 1 -- 172.21.15.31:0/1909432570 wait complete. 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 Processor -- start 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 -- start start 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 0x7f88f80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f80cda20 0x7f88f813df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88f81405d0 0x7f88f813d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80c7c10 con 0x7f88f806b710 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f816d090 con 0x7f88f80cda20 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f816d370 con 0x7f88f81405d0 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd0e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 0x7f88f80ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd0e6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 0x7f88f80ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49460/0 (socket says 172.21.15.31:49460) 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd0e6700 1 -- 172.21.15.31:0/2046298081 learned_addr learned my addr 172.21.15.31:0/2046298081 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fc8e5700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f80cda20 0x7f88f813df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd8e7700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88f81405d0 0x7f88f813d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd0e6700 1 -- 172.21.15.31:0/2046298081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88f81405d0 msgr2=0x7f88f813d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd0e6700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88f81405d0 0x7f88f813d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd0e6700 1 -- 172.21.15.31:0/2046298081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f80cda20 msgr2=0x7f88f813df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd0e6700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f80cda20 0x7f88f813df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd0e6700 1 -- 172.21.15.31:0/2046298081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40094f0 con 0x7f88f806b710 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd8e7700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88f81405d0 0x7f88f813d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fd0e6700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 0x7f88f80ace20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88f4006f50 tx=0x7f88f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88ed7fa700 1 -- 172.21.15.31:0/2046298081 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4024440 con 0x7f88f806b710 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88ed7fa700 1 -- 172.21.15.31:0/2046298081 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f40245e0 con 0x7f88f806b710 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 -- 172.21.15.31:0/2046298081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f816d650 con 0x7f88f806b710 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88ed7fa700 1 -- 172.21.15.31:0/2046298081 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40249a0 con 0x7f88f806b710 2024-08-17T02:24:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 -- 172.21.15.31:0/2046298081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f816dc10 con 0x7f88f806b710 2024-08-17T02:24:39.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.194+0000 7f88fe0e8700 1 -- 172.21.15.31:0/2046298081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f80712b0 con 0x7f88f806b710 2024-08-17T02:24:39.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.198+0000 7f88ed7fa700 1 -- 172.21.15.31:0/2046298081 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f88f4024d50 con 0x7f88f806b710 2024-08-17T02:24:39.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.198+0000 7f88ed7fa700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f88dc060860 0x7f88dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.198+0000 7f88ed7fa700 1 -- 172.21.15.31:0/2046298081 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f88f407e2e0 con 0x7f88f806b710 2024-08-17T02:24:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.198+0000 7f88fc8e5700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f88dc060860 0x7f88dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.198+0000 7f88fc8e5700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f88dc060860 0x7f88dc062d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88f80adee0 tx=0x7f88e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.202+0000 7f88ed7fa700 1 -- 172.21.15.31:0/2046298081 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f88f404eac0 con 0x7f88f806b710 2024-08-17T02:24:39.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.366+0000 7f88fe0e8700 1 -- 172.21.15.31:0/2046298081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88f80c4850 con 0x7f88f806b710 2024-08-17T02:24:39.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.366+0000 7f88ed7fa700 1 -- 172.21.15.31:0/2046298081 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f88f40520a0 con 0x7f88f806b710 2024-08-17T02:24:39.373 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:39.373 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:36.480855+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:39.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 -- 172.21.15.31:0/2046298081 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f88dc060860 msgr2=0x7f88dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f88dc060860 0x7f88dc062d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88f80adee0 tx=0x7f88e8008040 comp rx=0 tx=0).stop 2024-08-17T02:24:39.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 -- 172.21.15.31:0/2046298081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 msgr2=0x7f88f80ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 0x7f88f80ace20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88f4006f50 tx=0x7f88f4017000 comp rx=0 tx=0).stop 2024-08-17T02:24:39.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 -- 172.21.15.31:0/2046298081 shutdown_connections 2024-08-17T02:24:39.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f88dc060860 0x7f88dc062d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88f81405d0 0x7f88f813d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f80cda20 0x7f88f813df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 --2- 172.21.15.31:0/2046298081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88f806b710 0x7f88f80ace20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 -- 172.21.15.31:0/2046298081 >> 172.21.15.31:0/2046298081 conn(0x7f88f80cdf90 msgr2=0x7f88f806ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 -- 172.21.15.31:0/2046298081 shutdown_connections 2024-08-17T02:24:39.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.370+0000 7f88fe0e8700 1 -- 172.21.15.31:0/2046298081 wait complete. 2024-08-17T02:24:39.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:24:39.387 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:39.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.498+0000 7f9bf2a4f700 1 Processor -- start 2024-08-17T02:24:39.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.498+0000 7f9bf2a4f700 1 -- start start 2024-08-17T02:24:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.498+0000 7f9bf2a4f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 0x7f9bec155780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.498+0000 7f9bf2a4f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9bec067b10 0x7f9bec1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.498+0000 7f9bf2a4f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec156150 con 0x7f9bec155cc0 2024-08-17T02:24:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.498+0000 7f9bf2a4f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec156430 con 0x7f9bec067b10 2024-08-17T02:24:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf2a4f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec156710 con 0x7f9bec1553b0 2024-08-17T02:24:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf124c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9bec155cc0 0x7f9bec067400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38924/0 (socket says 172.21.15.31:38924) 2024-08-17T02:24:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf224e700 1 --2- 172.21.15.31:0/3693882481 >> v2:172.21.15.31:3300/0 conn(0x7f9bec067b10 0x7f9bec1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf124c700 1 -- 172.21.15.31:0/3693882481 learned_addr learned my addr 172.21.15.31:0/3693882481 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf1a4d700 1 --2- 172.21.15.31:0/3693882481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 0x7f9bec155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf224e700 1 -- 172.21.15.31:0/3693882481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 msgr2=0x7f9bec155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:39.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf224e700 1 --2- 172.21.15.31:0/3693882481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 0x7f9bec155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf224e700 1 -- 172.21.15.31:0/3693882481 >> v1:172.21.15.31:6789/0 conn(0x7f9bec155cc0 legacy=0x7f9bec067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf0a4b700 1 -- 172.21.15.31:0/3693882481 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021924011 0 0) 0x7f9bec156150 con 0x7f9bec155cc0 2024-08-17T02:24:39.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf224e700 1 -- 172.21.15.31:0/3693882481 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec1569f0 con 0x7f9bec067b10 2024-08-17T02:24:39.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf224e700 1 --2- 172.21.15.31:0/3693882481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec067b10 0x7f9bec1571f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009e60 tx=0x7f9be4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c37dc9d1e125db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf0a4b700 1 -- 172.21.15.31:0/3693882481 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400e070 con 0x7f9bec067b10 2024-08-17T02:24:39.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf0a4b700 1 -- 172.21.15.31:0/3693882481 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400bb60 con 0x7f9bec067b10 2024-08-17T02:24:39.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf0a4b700 1 -- 172.21.15.31:0/3693882481 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4012430 con 0x7f9bec067b10 2024-08-17T02:24:39.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/3693882481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec067b10 msgr2=0x7f9bec1571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf2a4f700 1 --2- 172.21.15.31:0/3693882481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec067b10 0x7f9bec1571f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009e60 tx=0x7f9be4009780 comp rx=0 tx=0).stop 2024-08-17T02:24:39.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/3693882481 shutdown_connections 2024-08-17T02:24:39.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf2a4f700 1 --2- 172.21.15.31:0/3693882481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec067b10 0x7f9bec1571f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf2a4f700 1 --2- 172.21.15.31:0/3693882481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 0x7f9bec155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/3693882481 >> 172.21.15.31:0/3693882481 conn(0x7f9bec06bbb0 msgr2=0x7f9bec0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/3693882481 shutdown_connections 2024-08-17T02:24:39.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.502+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/3693882481 wait complete. 2024-08-17T02:24:39.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf2a4f700 1 Processor -- start 2024-08-17T02:24:39.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf2a4f700 1 -- start start 2024-08-17T02:24:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf2a4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec067b10 0x7f9bec0a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf2a4f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 0x7f9bec0c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf2a4f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec155cc0 0x7f9bec14eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf2a4f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0c38a0 con 0x7f9bec155cc0 2024-08-17T02:24:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf2a4f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0a59b0 con 0x7f9bec067b10 2024-08-17T02:24:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf2a4f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0c2c90 con 0x7f9bec1553b0 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf224e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec155cc0 0x7f9bec14eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf124c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 0x7f9bec0c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf124c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 0x7f9bec0c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:40432/0 (socket says 172.21.15.31:40432) 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf124c700 1 -- 172.21.15.31:0/2865543794 learned_addr learned my addr 172.21.15.31:0/2865543794 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf224e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec155cc0 0x7f9bec14eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49482/0 (socket says 172.21.15.31:49482) 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf1a4d700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec067b10 0x7f9bec0a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf224e700 1 -- 172.21.15.31:0/2865543794 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 msgr2=0x7f9bec0c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf224e700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 0x7f9bec0c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf224e700 1 -- 172.21.15.31:0/2865543794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec067b10 msgr2=0x7f9bec0a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf224e700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec067b10 0x7f9bec0a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf224e700 1 -- 172.21.15.31:0/2865543794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4009a20 con 0x7f9bec155cc0 2024-08-17T02:24:39.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.506+0000 7f9bf224e700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec155cc0 0x7f9bec14eef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9be4016000 tx=0x7f9be4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.510+0000 7f9bddffb700 1 -- 172.21.15.31:0/2865543794 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4012ea0 con 0x7f9bec155cc0 2024-08-17T02:24:39.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.510+0000 7f9bddffb700 1 -- 172.21.15.31:0/2865543794 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be4027470 con 0x7f9bec155cc0 2024-08-17T02:24:39.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.510+0000 7f9bddffb700 1 -- 172.21.15.31:0/2865543794 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4027830 con 0x7f9bec155cc0 2024-08-17T02:24:39.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.510+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/2865543794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec0c2f70 con 0x7f9bec155cc0 2024-08-17T02:24:39.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.510+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/2865543794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec0c3530 con 0x7f9bec155cc0 2024-08-17T02:24:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.510+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/2865543794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec0c3a10 con 0x7f9bec155cc0 2024-08-17T02:24:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.510+0000 7f9bddffb700 1 -- 172.21.15.31:0/2865543794 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9be4024070 con 0x7f9bec155cc0 2024-08-17T02:24:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.510+0000 7f9bddffb700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9bd0060890 0x7f9bd0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.510+0000 7f9bddffb700 1 -- 172.21.15.31:0/2865543794 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9be407ee50 con 0x7f9bec155cc0 2024-08-17T02:24:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.510+0000 7f9bf1a4d700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9bd0060890 0x7f9bd0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.514+0000 7f9bf1a4d700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9bd0060890 0x7f9bd0062d40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0c4c70 tx=0x7f9be80091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.518+0000 7f9bddffb700 1 -- 172.21.15.31:0/2865543794 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f9be404f550 con 0x7f9bec155cc0 2024-08-17T02:24:39.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.682+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/2865543794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bec0712b0 con 0x7f9bec155cc0 2024-08-17T02:24:39.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bddffb700 1 -- 172.21.15.31:0/2865543794 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9be4052b70 con 0x7f9bec155cc0 2024-08-17T02:24:39.691 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:24:39.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/2865543794 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9bd0060890 msgr2=0x7f9bd0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9bd0060890 0x7f9bd0062d40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0c4c70 tx=0x7f9be80091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/2865543794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec155cc0 msgr2=0x7f9bec14eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec155cc0 0x7f9bec14eef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9be4016000 tx=0x7f9be4019000 comp rx=0 tx=0).stop 2024-08-17T02:24:39.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/2865543794 shutdown_connections 2024-08-17T02:24:39.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9bd0060890 0x7f9bd0062d40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bec155cc0 0x7f9bec14eef0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9bec1553b0 0x7f9bec0c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 --2- 172.21.15.31:0/2865543794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bec067b10 0x7f9bec0a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/2865543794 >> 172.21.15.31:0/2865543794 conn(0x7f9bec06bbb0 msgr2=0x7f9bec150570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/2865543794 shutdown_connections 2024-08-17T02:24:39.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.686+0000 7f9bf2a4f700 1 -- 172.21.15.31:0/2865543794 wait complete. 2024-08-17T02:24:39.705 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:39.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa350a18700 1 Processor -- start 2024-08-17T02:24:39.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa350a18700 1 -- start start 2024-08-17T02:24:39.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa350a18700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa34c154cf0 0x7fa34c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa350a18700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa34c0ad400 0x7fa34c0aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa350a18700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34c157c40 con 0x7fa34c0af200 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa350a18700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34c1588c0 con 0x7fa34c0ad400 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa350a18700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c157f20 con 0x7fa34c154cf0 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa34a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa34c0ad400 0x7fa34c0aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa34a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa34c0ad400 0x7fa34c0aecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49496/0 (socket says 172.21.15.31:49496) 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa34a59c700 1 -- 172.21.15.31:0/37237987 learned_addr learned my addr 172.21.15.31:0/37237987 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.810+0000 7fa34b59e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa34c0af200 0x7fa34c06a200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38926/0 (socket says 172.21.15.31:38926) 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa34ad9d700 1 --2- 172.21.15.31:0/37237987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa34c154cf0 0x7fa34c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa34a59c700 1 -- 172.21.15.31:0/37237987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa34c154cf0 msgr2=0x7fa34c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa34a59c700 1 --2- 172.21.15.31:0/37237987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa34c154cf0 0x7fa34c1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa34a59c700 1 -- 172.21.15.31:0/37237987 >> v1:172.21.15.31:6789/0 conn(0x7fa34c0af200 legacy=0x7fa34c06a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa34a59c700 1 -- 172.21.15.31:0/37237987 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c158200 con 0x7fa34c0ad400 2024-08-17T02:24:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa34a59c700 1 --2- 172.21.15.31:0/37237987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c0ad400 0x7fa34c0aecc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa3400099b0 tx=0x7fa340009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5d1662895fa004 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa349d9b700 1 -- 172.21.15.31:0/37237987 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340009ea0 con 0x7fa34c0ad400 2024-08-17T02:24:39.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa349d9b700 1 -- 172.21.15.31:0/37237987 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34000b860 con 0x7fa34c0ad400 2024-08-17T02:24:39.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa349d9b700 1 -- 172.21.15.31:0/37237987 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000bc00 con 0x7fa34c0ad400 2024-08-17T02:24:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa350a18700 1 -- 172.21.15.31:0/37237987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c0ad400 msgr2=0x7fa34c0aecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa350a18700 1 --2- 172.21.15.31:0/37237987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c0ad400 0x7fa34c0aecc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa3400099b0 tx=0x7fa340009250 comp rx=0 tx=0).stop 2024-08-17T02:24:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa350a18700 1 -- 172.21.15.31:0/37237987 shutdown_connections 2024-08-17T02:24:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa350a18700 1 --2- 172.21.15.31:0/37237987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c0ad400 0x7fa34c0aecc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa350a18700 1 --2- 172.21.15.31:0/37237987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa34c154cf0 0x7fa34c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa350a18700 1 -- 172.21.15.31:0/37237987 >> 172.21.15.31:0/37237987 conn(0x7fa34c0cd2b0 msgr2=0x7fa34c069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:39.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa350a18700 1 -- 172.21.15.31:0/37237987 shutdown_connections 2024-08-17T02:24:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa350a18700 1 -- 172.21.15.31:0/37237987 wait complete. 2024-08-17T02:24:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa350a18700 1 Processor -- start 2024-08-17T02:24:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.814+0000 7fa350a18700 1 -- start start 2024-08-17T02:24:39.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa350a18700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa34c0ad400 0x7fa34c140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa350a18700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa34c0af200 0x7fa34c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa350a18700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c154cf0 0x7fa34c0ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa350a18700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c0aa820 con 0x7fa34c154cf0 2024-08-17T02:24:39.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa350a18700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c15d470 con 0x7fa34c0ad400 2024-08-17T02:24:39.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa350a18700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c0aa540 con 0x7fa34c0af200 2024-08-17T02:24:39.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c154cf0 0x7fa34c0ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34a59c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa34c0af200 0x7fa34c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa34c0ad400 0x7fa34c140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c154cf0 0x7fa34c0ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49512/0 (socket says 172.21.15.31:49512) 2024-08-17T02:24:39.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34b59e700 1 -- 172.21.15.31:0/831082300 learned_addr learned my addr 172.21.15.31:0/831082300 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:39.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34b59e700 1 -- 172.21.15.31:0/831082300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa34c0af200 msgr2=0x7fa34c15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34b59e700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa34c0af200 0x7fa34c15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34b59e700 1 -- 172.21.15.31:0/831082300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa34c0ad400 msgr2=0x7fa34c140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:39.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34b59e700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa34c0ad400 0x7fa34c140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:39.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34b59e700 1 -- 172.21.15.31:0/831082300 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400094f0 con 0x7fa34c154cf0 2024-08-17T02:24:39.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa34b59e700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c154cf0 0x7fa34c0ada70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa34400cd30 tx=0x7fa344001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa332ffd700 1 -- 172.21.15.31:0/831082300 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34400ce90 con 0x7fa34c154cf0 2024-08-17T02:24:39.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa332ffd700 1 -- 172.21.15.31:0/831082300 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa344005df0 con 0x7fa34c154cf0 2024-08-17T02:24:39.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa332ffd700 1 -- 172.21.15.31:0/831082300 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34400aac0 con 0x7fa34c154cf0 2024-08-17T02:24:39.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa350a18700 1 -- 172.21.15.31:0/831082300 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34c15ce20 con 0x7fa34c154cf0 2024-08-17T02:24:39.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.818+0000 7fa350a18700 1 -- 172.21.15.31:0/831082300 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34c1410f0 con 0x7fa34c154cf0 2024-08-17T02:24:39.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.822+0000 7fa350a18700 1 -- 172.21.15.31:0/831082300 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa34c15cc80 con 0x7fa34c154cf0 2024-08-17T02:24:39.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.822+0000 7fa332ffd700 1 -- 172.21.15.31:0/831082300 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa3440070f0 con 0x7fa34c154cf0 2024-08-17T02:24:39.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.822+0000 7fa332ffd700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa338060860 0x7fa338062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:39.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.822+0000 7fa332ffd700 1 -- 172.21.15.31:0/831082300 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa34407c8c0 con 0x7fa34c154cf0 2024-08-17T02:24:39.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.822+0000 7fa34ad9d700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa338060860 0x7fa338062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:39.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.822+0000 7fa34ad9d700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa338060860 0x7fa338062d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0ae730 tx=0x7fa33c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:39.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:39.830+0000 7fa332ffd700 1 -- 172.21.15.31:0/831082300 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa34c15cc80 con 0x7fa34c154cf0 2024-08-17T02:24:40.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.026+0000 7fa350a18700 1 -- 172.21.15.31:0/831082300 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa34c15cc80 con 0x7fa34c154cf0 2024-08-17T02:24:40.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa332ffd700 1 -- 172.21.15.31:0/831082300 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7fa34c15cc80 con 0x7fa34c154cf0 2024-08-17T02:24:40.035 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:40.035 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/3915393252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3915393252},{"type":"v1","addr":"172.21.15.31:6836","nonce":3915393252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:24:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 -- 172.21.15.31:0/831082300 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa338060860 msgr2=0x7fa338062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa338060860 0x7fa338062d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0ae730 tx=0x7fa33c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 -- 172.21.15.31:0/831082300 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c154cf0 msgr2=0x7fa34c0ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c154cf0 0x7fa34c0ada70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa34400cd30 tx=0x7fa344001b10 comp rx=0 tx=0).stop 2024-08-17T02:24:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 -- 172.21.15.31:0/831082300 shutdown_connections 2024-08-17T02:24:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa338060860 0x7fa338062d10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa34c154cf0 0x7fa34c0ada70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa34c0af200 0x7fa34c15d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 --2- 172.21.15.31:0/831082300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa34c0ad400 0x7fa34c140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 -- 172.21.15.31:0/831082300 >> 172.21.15.31:0/831082300 conn(0x7fa34c0cd2b0 msgr2=0x7fa34c06b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 -- 172.21.15.31:0/831082300 shutdown_connections 2024-08-17T02:24:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:40.030+0000 7fa350a18700 1 -- 172.21.15.31:0/831082300 wait complete. 2024-08-17T02:24:40.039 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2024-08-17T02:24:42.050 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:42.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.162+0000 7f1abe5c4700 1 Processor -- start 2024-08-17T02:24:42.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.162+0000 7f1abe5c4700 1 -- start start 2024-08-17T02:24:42.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1abe5c4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ab8068a80 0x7f1ab815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1abe5c4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ab815c8e0 0x7f1ab8069b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1abe5c4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab80aa5c0 con 0x7f1ab815c510 2024-08-17T02:24:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1abe5c4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab80ad220 con 0x7f1ab8068a80 2024-08-17T02:24:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1abe5c4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab815ddb0 con 0x7f1ab815c8e0 2024-08-17T02:24:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1aaf7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ab8068a80 0x7f1ab815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1aaf7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ab8068a80 0x7f1ab815d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56356/0 (socket says 172.21.15.31:56356) 2024-08-17T02:24:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1aaf7fe700 1 -- 172.21.15.31:0/3716754576 learned_addr learned my addr 172.21.15.31:0/3716754576 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1abcb61700 1 --2- 172.21.15.31:0/3716754576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ab815c8e0 0x7f1ab8069b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1aaf7fe700 1 -- 172.21.15.31:0/3716754576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ab815c8e0 msgr2=0x7f1ab8069b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:42.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1aaf7fe700 1 --2- 172.21.15.31:0/3716754576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ab815c8e0 0x7f1ab8069b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1aaf7fe700 1 -- 172.21.15.31:0/3716754576 >> v1:172.21.15.92:6789/0 conn(0x7f1ab815c510 legacy=0x7f1ab80acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1aaf7fe700 1 -- 172.21.15.31:0/3716754576 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab80a99b0 con 0x7f1ab8068a80 2024-08-17T02:24:42.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1ab77fe700 1 -- 172.21.15.31:0/3716754576 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408182522 0 0) 0x7f1ab80aa5c0 con 0x7f1ab815c510 2024-08-17T02:24:42.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1aaf7fe700 1 --2- 172.21.15.31:0/3716754576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab8068a80 0x7f1ab815d870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00099b0 tx=0x7f1aa0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c85e89f44bf3b84 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1ab77fe700 1 -- 172.21.15.31:0/3716754576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0009ea0 con 0x7f1ab8068a80 2024-08-17T02:24:42.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1ab77fe700 1 -- 172.21.15.31:0/3716754576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa000b860 con 0x7f1ab8068a80 2024-08-17T02:24:42.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.166+0000 7f1ab77fe700 1 -- 172.21.15.31:0/3716754576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa000bc20 con 0x7f1ab8068a80 2024-08-17T02:24:42.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.170+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3716754576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab8068a80 msgr2=0x7f1ab815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.170+0000 7f1abe5c4700 1 --2- 172.21.15.31:0/3716754576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab8068a80 0x7f1ab815d870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00099b0 tx=0x7f1aa0009250 comp rx=0 tx=0).stop 2024-08-17T02:24:42.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.170+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3716754576 shutdown_connections 2024-08-17T02:24:42.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.170+0000 7f1abe5c4700 1 --2- 172.21.15.31:0/3716754576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ab815c8e0 0x7f1ab8069b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.170+0000 7f1abe5c4700 1 --2- 172.21.15.31:0/3716754576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab8068a80 0x7f1ab815d870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.170+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3716754576 >> 172.21.15.31:0/3716754576 conn(0x7f1ab8069790 msgr2=0x7f1ab80b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.170+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3716754576 shutdown_connections 2024-08-17T02:24:42.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.170+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3716754576 wait complete. 2024-08-17T02:24:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.170+0000 7f1abe5c4700 1 Processor -- start 2024-08-17T02:24:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.170+0000 7f1abe5c4700 1 -- start start 2024-08-17T02:24:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1abe5c4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab8068a80 0x7f1ab80c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1abe5c4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab815c510 0x7f1ab80cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1abe5c4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ab815c8e0 0x7f1ab8169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1abe5c4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab816ab70 con 0x7f1ab815c510 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1abe5c4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80c9290 con 0x7f1ab8068a80 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1abe5c4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab816a5b0 con 0x7f1ab815c8e0 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1aaf7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab815c510 0x7f1ab80cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1aaf7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab815c510 0x7f1ab80cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56362/0 (socket says 172.21.15.31:56362) 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1ab7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab8068a80 0x7f1ab80c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1aaf7fe700 1 -- 172.21.15.31:0/3450330998 learned_addr learned my addr 172.21.15.31:0/3450330998 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1abcb61700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ab815c8e0 0x7f1ab8169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1aaf7fe700 1 -- 172.21.15.31:0/3450330998 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ab815c8e0 msgr2=0x7f1ab8169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1aaf7fe700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ab815c8e0 0x7f1ab8169ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1aaf7fe700 1 -- 172.21.15.31:0/3450330998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab8068a80 msgr2=0x7f1ab80c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1aaf7fe700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab8068a80 0x7f1ab80c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1aaf7fe700 1 -- 172.21.15.31:0/3450330998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00094f0 con 0x7f1ab815c510 2024-08-17T02:24:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1aaf7fe700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab815c510 0x7f1ab80cb2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80b2a50 tx=0x7f1aa0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1ab4ff9700 1 -- 172.21.15.31:0/3450330998 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa001f070 con 0x7f1ab815c510 2024-08-17T02:24:42.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3450330998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab816a890 con 0x7f1ab815c510 2024-08-17T02:24:42.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1ab4ff9700 1 -- 172.21.15.31:0/3450330998 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa000b9d0 con 0x7f1ab815c510 2024-08-17T02:24:42.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3450330998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab80c9c60 con 0x7f1ab815c510 2024-08-17T02:24:42.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1ab4ff9700 1 -- 172.21.15.31:0/3450330998 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0011420 con 0x7f1ab815c510 2024-08-17T02:24:42.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.174+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3450330998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab80c8d60 con 0x7f1ab815c510 2024-08-17T02:24:42.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.178+0000 7f1ab4ff9700 1 -- 172.21.15.31:0/3450330998 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1aa00117d0 con 0x7f1ab815c510 2024-08-17T02:24:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.178+0000 7f1ab4ff9700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1a98060860 0x7f1a98062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.178+0000 7f1ab4ff9700 1 -- 172.21.15.31:0/3450330998 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1aa007dab0 con 0x7f1ab815c510 2024-08-17T02:24:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.178+0000 7f1ab7fff700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1a98060860 0x7f1a98062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.178+0000 7f1ab7fff700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1a98060860 0x7f1a98062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80c4010 tx=0x7f1aa8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.186+0000 7f1ab4ff9700 1 -- 172.21.15.31:0/3450330998 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1aa004e300 con 0x7f1ab815c510 2024-08-17T02:24:42.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.386+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3450330998 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ab80c9420 con 0x7f1ab815c510 2024-08-17T02:24:42.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.386+0000 7f1ab4ff9700 1 -- 172.21.15.31:0/3450330998 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f1aa0015de0 con 0x7f1ab815c510 2024-08-17T02:24:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:42.393 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2641277078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2641277078},{"type":"v1","addr":"172.21.15.92:6835","nonce":2641277078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2478493982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2478493982},{"type":"v1","addr":"172.21.15.92:6833","nonce":2478493982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/3915393252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3915393252},{"type":"v1","addr":"172.21.15.31:6836","nonce":3915393252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/2360104768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":2360104768},{"type":"v1","addr":"172.21.15.31:6837","nonce":2360104768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:24:42.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3450330998 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1a98060860 msgr2=0x7f1a98062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1a98060860 0x7f1a98062d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80c4010 tx=0x7f1aa8009040 comp rx=0 tx=0).stop 2024-08-17T02:24:42.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3450330998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab815c510 msgr2=0x7f1ab80cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab815c510 0x7f1ab80cb2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80b2a50 tx=0x7f1aa0017000 comp rx=0 tx=0).stop 2024-08-17T02:24:42.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3450330998 shutdown_connections 2024-08-17T02:24:42.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1a98060860 0x7f1a98062d10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ab815c8e0 0x7f1ab8169ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ab815c510 0x7f1ab80cb2b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 --2- 172.21.15.31:0/3450330998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ab8068a80 0x7f1ab80c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3450330998 >> 172.21.15.31:0/3450330998 conn(0x7f1ab8069790 msgr2=0x7f1ab80ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3450330998 shutdown_connections 2024-08-17T02:24:42.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.390+0000 7f1abe5c4700 1 -- 172.21.15.31:0/3450330998 wait complete. 2024-08-17T02:24:42.397 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2024-08-17T02:24:42.407 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:42.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83f59e700 1 Processor -- start 2024-08-17T02:24:42.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83f59e700 1 -- start start 2024-08-17T02:24:42.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83f59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc84015c750 0x7fc8401641c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83f59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84015b2b0 con 0x7fc8400ad6f0 2024-08-17T02:24:42.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83f59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8400ae410 con 0x7fc84015ce20 2024-08-17T02:24:42.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83f59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400ae220 con 0x7fc84015c750 2024-08-17T02:24:42.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83dd9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc8400ad6f0 0x7fc8400adb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45706/0 (socket says 172.21.15.31:45706) 2024-08-17T02:24:42.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83dd9b700 1 -- 172.21.15.31:0/931535155 learned_addr learned my addr 172.21.15.31:0/931535155 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:42.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83ed9d700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc84015c750 0x7fc8401641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50890701 0 0) 0x7fc84015b2b0 con 0x7fc8400ad6f0 2024-08-17T02:24:42.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc828003570 con 0x7fc8400ad6f0 2024-08-17T02:24:42.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648523960 0 0) 0x7fc8400ae410 con 0x7fc84015ce20 2024-08-17T02:24:42.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc84015b2b0 con 0x7fc84015ce20 2024-08-17T02:24:42.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4058850760 0 0) 0x7fc828003570 con 0x7fc8400ad6f0 2024-08-17T02:24:42.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc84015c750 msgr2=0x7fc8401641c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc84015c750 0x7fc8401641c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 >> v1:172.21.15.92:6789/0 conn(0x7fc84015ce20 legacy=0x7fc84015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84015aca0 con 0x7fc8400ad6f0 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7fc834001470 con 0x7fc8400ad6f0 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83ed9d700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc84015c750 0x7fc8401641c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 >> v1:172.21.15.31:6789/0 conn(0x7fc8400ad6f0 legacy=0x7fc8400adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828003c20 0x7fc828004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc828004810 0x7fc828004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc84015c750 0x7fc8280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82800bb10 con 0x7fc828004810 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82800bc50 con 0x7fc828003c20 2024-08-17T02:24:42.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82800be10 con 0x7fc84015c750 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83dd9b700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc828004810 0x7fc828004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83e59c700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828003c20 0x7fc828004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.510+0000 7fc83ed9d700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc84015c750 0x7fc8280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83dd9b700 1 -- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc84015c750 msgr2=0x7fc8280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83dd9b700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc84015c750 0x7fc8280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83dd9b700 1 -- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828003c20 msgr2=0x7fc828004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83dd9b700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc828003c20 0x7fc828004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83dd9b700 1 -- 172.21.15.31:0/931535155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838009a20 con 0x7fc828004810 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83dd9b700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc828004810 0x7fc828004c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c2d0 tx=0x7fc834001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979dfbd1ab8af01 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400cbc0 con 0x7fc828004810 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400cd20 con 0x7fc828004810 2024-08-17T02:24:42.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83d59a700 1 -- 172.21.15.31:0/931535155 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834005b70 con 0x7fc828004810 2024-08-17T02:24:42.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83f59e700 1 -- 172.21.15.31:0/931535155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc828004810 msgr2=0x7fc828004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83f59e700 1 --2- 172.21.15.31:0/931535155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc828004810 0x7fc828004c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c2d0 tx=0x7fc834001e10 comp rx=0 tx=0).stop 2024-08-17T02:24:42.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83ed9d700 1 -- 172.21.15.31:0/931535155 reap_dead start 2024-08-17T02:24:42.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83f59e700 1 -- 172.21.15.31:0/931535155 shutdown_connections 2024-08-17T02:24:42.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83f59e700 1 -- 172.21.15.31:0/931535155 >> 172.21.15.31:0/931535155 conn(0x7fc840089cb0 msgr2=0x7fc8400995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83f59e700 1 -- 172.21.15.31:0/931535155 shutdown_connections 2024-08-17T02:24:42.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83f59e700 1 -- 172.21.15.31:0/931535155 wait complete. 2024-08-17T02:24:42.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.514+0000 7fc83f59e700 1 Processor -- start 2024-08-17T02:24:42.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83f59e700 1 -- start start 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83f59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc828004810 0x7fc840150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8400b0cc0 0x7fc8400b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83f59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8400ae8f0 0x7fc8400aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400ce2e0 con 0x7fc8400b0cc0 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83f59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400b1670 con 0x7fc8400ae8f0 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83f59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400b0110 con 0x7fc828004810 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8400b0cc0 0x7fc8400b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8400ae8f0 0x7fc8400aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8400b0cc0 0x7fc8400b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56370/0 (socket says 172.21.15.31:56370) 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83dd9b700 1 -- 172.21.15.31:0/3185502395 learned_addr learned my addr 172.21.15.31:0/3185502395 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:42.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83e59c700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc828004810 0x7fc840150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83ed9d700 1 -- 172.21.15.31:0/3185502395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc828004810 msgr2=0x7fc840150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83ed9d700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc828004810 0x7fc840150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83ed9d700 1 -- 172.21.15.31:0/3185502395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8400b0cc0 msgr2=0x7fc8400b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83ed9d700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8400b0cc0 0x7fc8400b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83ed9d700 1 -- 172.21.15.31:0/3185502395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400af280 con 0x7fc8400ae8f0 2024-08-17T02:24:42.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83ed9d700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8400ae8f0 0x7fc8400aed40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc8400685e0 tx=0x7fc83800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc82e7fc700 1 -- 172.21.15.31:0/3185502395 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800e040 con 0x7fc8400ae8f0 2024-08-17T02:24:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc82e7fc700 1 -- 172.21.15.31:0/3185502395 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800f040 con 0x7fc8400ae8f0 2024-08-17T02:24:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc82e7fc700 1 -- 172.21.15.31:0/3185502395 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838015430 con 0x7fc8400ae8f0 2024-08-17T02:24:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83f59e700 1 -- 172.21.15.31:0/3185502395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8400af500 con 0x7fc8400ae8f0 2024-08-17T02:24:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.518+0000 7fc83f59e700 1 -- 172.21.15.31:0/3185502395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8400afac0 con 0x7fc8400ae8f0 2024-08-17T02:24:42.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.522+0000 7fc83f59e700 1 -- 172.21.15.31:0/3185502395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8400712b0 con 0x7fc8400ae8f0 2024-08-17T02:24:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.522+0000 7fc82e7fc700 1 -- 172.21.15.31:0/3185502395 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc8380157a0 con 0x7fc8400ae8f0 2024-08-17T02:24:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.522+0000 7fc82e7fc700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc820060860 0x7fc820062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.522+0000 7fc82e7fc700 1 -- 172.21.15.31:0/3185502395 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc83807d240 con 0x7fc8400ae8f0 2024-08-17T02:24:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.522+0000 7fc83e59c700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc820060860 0x7fc820062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.522+0000 7fc83e59c700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc820060860 0x7fc820062d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc830003cd0 tx=0x7fc830007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.534+0000 7fc82e7fc700 1 -- 172.21.15.31:0/3185502395 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc83804da00 con 0x7fc8400ae8f0 2024-08-17T02:24:42.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.702+0000 7fc83f59e700 1 -- 172.21.15.31:0/3185502395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc840068280 con 0x7fc8400ae8f0 2024-08-17T02:24:42.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.706+0000 7fc82e7fc700 1 -- 172.21.15.31:0/3185502395 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12079 (secure 0 0 0) 0x7fc838051020 con 0x7fc8400ae8f0 2024-08-17T02:24:42.712 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:42.712 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:36.480855+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 -- 172.21.15.31:0/3185502395 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc820060860 msgr2=0x7fc820062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc820060860 0x7fc820062d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc830003cd0 tx=0x7fc830007d30 comp rx=0 tx=0).stop 2024-08-17T02:24:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 -- 172.21.15.31:0/3185502395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8400ae8f0 msgr2=0x7fc8400aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8400ae8f0 0x7fc8400aed40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc8400685e0 tx=0x7fc83800b040 comp rx=0 tx=0).stop 2024-08-17T02:24:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 -- 172.21.15.31:0/3185502395 shutdown_connections 2024-08-17T02:24:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc820060860 0x7fc820062d10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8400ae8f0 0x7fc8400aed40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8400b0cc0 0x7fc8400b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 --2- 172.21.15.31:0/3185502395 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc828004810 0x7fc840150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 -- 172.21.15.31:0/3185502395 >> 172.21.15.31:0/3185502395 conn(0x7fc840089cb0 msgr2=0x7fc8400adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 -- 172.21.15.31:0/3185502395 shutdown_connections 2024-08-17T02:24:42.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.710+0000 7fc83f59e700 1 -- 172.21.15.31:0/3185502395 wait complete. 2024-08-17T02:24:42.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:24:42.727 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:42.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.838+0000 7f6f5759e700 1 Processor -- start 2024-08-17T02:24:42.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.838+0000 7f6f5759e700 1 -- start start 2024-08-17T02:24:42.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.838+0000 7f6f5759e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6f58068aa0 0x7f6f58068e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.838+0000 7f6f5759e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f58159fd0 0x7f6f580af290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.838+0000 7f6f5759e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5815cc00 con 0x7f6f580cb010 2024-08-17T02:24:42.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.838+0000 7f6f5759e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f58150510 con 0x7f6f58068aa0 2024-08-17T02:24:42.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.838+0000 7f6f5759e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580cb430 con 0x7f6f58159fd0 2024-08-17T02:24:42.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.838+0000 7f6f5659c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6f58068aa0 0x7f6f58068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f56d9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f58159fd0 0x7f6f580af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f55d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6f580cb010 0x7f6f580aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:47536/0 (socket says 172.21.15.31:47536) 2024-08-17T02:24:42.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f56d9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f58159fd0 0x7f6f580af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:34242/0 (socket says 172.21.15.31:34242) 2024-08-17T02:24:42.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5659c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6f58068aa0 0x7f6f58068e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:43966/0 (socket says 172.21.15.31:43966) 2024-08-17T02:24:42.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f55d9b700 1 -- 172.21.15.31:0/2672511554 learned_addr learned my addr 172.21.15.31:0/2672511554 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:42.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5559a700 1 -- 172.21.15.31:0/2672511554 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523822619 0 0) 0x7f6f5815cc00 con 0x7f6f580cb010 2024-08-17T02:24:42.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5559a700 1 -- 172.21.15.31:0/2672511554 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f40003570 con 0x7f6f580cb010 2024-08-17T02:24:42.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f56d9d700 1 -- 172.21.15.31:0/2672511554 >> v2:172.21.15.92:3300/0 conn(0x7f6f58068aa0 msgr2=0x7f6f58068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:42.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f56d9d700 1 --2- 172.21.15.31:0/2672511554 >> v2:172.21.15.92:3300/0 conn(0x7f6f58068aa0 0x7f6f58068e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f56d9d700 1 -- 172.21.15.31:0/2672511554 >> v1:172.21.15.92:6789/0 conn(0x7f6f580cb010 legacy=0x7f6f580aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f56d9d700 1 -- 172.21.15.31:0/2672511554 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5815ce50 con 0x7f6f58159fd0 2024-08-17T02:24:42.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5659c700 1 --2- 172.21.15.31:0/2672511554 >> v2:172.21.15.92:3300/0 conn(0x7f6f58068aa0 0x7f6f58068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:42.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f56d9d700 1 --2- 172.21.15.31:0/2672511554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f58159fd0 0x7f6f580af290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009e60 tx=0x7f6f50009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fd49269da60efb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5559a700 1 -- 172.21.15.31:0/2672511554 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000e070 con 0x7f6f58159fd0 2024-08-17T02:24:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5559a700 1 -- 172.21.15.31:0/2672511554 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5000bab0 con 0x7f6f58159fd0 2024-08-17T02:24:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5559a700 1 -- 172.21.15.31:0/2672511554 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000be30 con 0x7f6f58159fd0 2024-08-17T02:24:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5759e700 1 -- 172.21.15.31:0/2672511554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f58159fd0 msgr2=0x7f6f580af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5759e700 1 --2- 172.21.15.31:0/2672511554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f58159fd0 0x7f6f580af290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009e60 tx=0x7f6f50009780 comp rx=0 tx=0).stop 2024-08-17T02:24:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5759e700 1 -- 172.21.15.31:0/2672511554 shutdown_connections 2024-08-17T02:24:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5759e700 1 --2- 172.21.15.31:0/2672511554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f58159fd0 0x7f6f580af290 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5759e700 1 --2- 172.21.15.31:0/2672511554 >> v2:172.21.15.92:3300/0 conn(0x7f6f58068aa0 0x7f6f58068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5759e700 1 -- 172.21.15.31:0/2672511554 >> 172.21.15.31:0/2672511554 conn(0x7f6f580d0090 msgr2=0x7f6f580d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5759e700 1 -- 172.21.15.31:0/2672511554 shutdown_connections 2024-08-17T02:24:42.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.842+0000 7f6f5759e700 1 -- 172.21.15.31:0/2672511554 wait complete. 2024-08-17T02:24:42.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5759e700 1 Processor -- start 2024-08-17T02:24:42.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5759e700 1 -- start start 2024-08-17T02:24:42.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5759e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f58068aa0 0x7f6f580b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5759e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f580cb010 0x7f6f580c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f58159fd0 0x7f6f580c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580b3530 con 0x7f6f58159fd0 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5759e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580b3810 con 0x7f6f58068aa0 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5759e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580b3af0 con 0x7f6f580cb010 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f56d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f58159fd0 0x7f6f580c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f56d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f58159fd0 0x7f6f580c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56384/0 (socket says 172.21.15.31:56384) 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f56d9d700 1 -- 172.21.15.31:0/3212719536 learned_addr learned my addr 172.21.15.31:0/3212719536 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5659c700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f58068aa0 0x7f6f580b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f55d9b700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f580cb010 0x7f6f580c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f56d9d700 1 -- 172.21.15.31:0/3212719536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f580cb010 msgr2=0x7f6f580c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f56d9d700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f580cb010 0x7f6f580c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f56d9d700 1 -- 172.21.15.31:0/3212719536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f58068aa0 msgr2=0x7f6f580b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f56d9d700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f58068aa0 0x7f6f580b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f56d9d700 1 -- 172.21.15.31:0/3212719536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c009420 con 0x7f6f58159fd0 2024-08-17T02:24:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f55d9b700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f580cb010 0x7f6f580c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f56d9d700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f58159fd0 0x7f6f580c5390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6f500097c0 tx=0x7f6f50019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f467fc700 1 -- 172.21.15.31:0/3212719536 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50027470 con 0x7f6f58159fd0 2024-08-17T02:24:42.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5759e700 1 -- 172.21.15.31:0/3212719536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f50009a20 con 0x7f6f58159fd0 2024-08-17T02:24:42.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f467fc700 1 -- 172.21.15.31:0/3212719536 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f500275f0 con 0x7f6f58159fd0 2024-08-17T02:24:42.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f467fc700 1 -- 172.21.15.31:0/3212719536 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500279b0 con 0x7f6f58159fd0 2024-08-17T02:24:42.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.846+0000 7f6f5759e700 1 -- 172.21.15.31:0/3212719536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f580b40b0 con 0x7f6f58159fd0 2024-08-17T02:24:42.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.850+0000 7f6f5759e700 1 -- 172.21.15.31:0/3212719536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f580b42d0 con 0x7f6f58159fd0 2024-08-17T02:24:42.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.850+0000 7f6f467fc700 1 -- 172.21.15.31:0/3212719536 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6f50024070 con 0x7f6f58159fd0 2024-08-17T02:24:42.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.850+0000 7f6f467fc700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6f38060860 0x7f6f38062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:42.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.850+0000 7f6f5659c700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6f38060860 0x7f6f38062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:42.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.850+0000 7f6f467fc700 1 -- 172.21.15.31:0/3212719536 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6f5007f400 con 0x7f6f58159fd0 2024-08-17T02:24:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.850+0000 7f6f5659c700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6f38060860 0x7f6f38062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0093f0 tx=0x7f6f4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:42.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:42.862+0000 7f6f467fc700 1 -- 172.21.15.31:0/3212719536 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6f5004fb80 con 0x7f6f58159fd0 2024-08-17T02:24:43.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 -- 172.21.15.31:0/3212719536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f580712b0 con 0x7f6f58159fd0 2024-08-17T02:24:43.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f467fc700 1 -- 172.21.15.31:0/3212719536 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f5002c0a0 con 0x7f6f58159fd0 2024-08-17T02:24:43.031 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:24:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 -- 172.21.15.31:0/3212719536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6f38060860 msgr2=0x7f6f38062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6f38060860 0x7f6f38062d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0093f0 tx=0x7f6f4c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 -- 172.21.15.31:0/3212719536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f58159fd0 msgr2=0x7f6f580c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f58159fd0 0x7f6f580c5390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6f500097c0 tx=0x7f6f50019000 comp rx=0 tx=0).stop 2024-08-17T02:24:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 -- 172.21.15.31:0/3212719536 shutdown_connections 2024-08-17T02:24:43.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6f38060860 0x7f6f38062d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f58159fd0 0x7f6f580c5390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f580cb010 0x7f6f580c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 --2- 172.21.15.31:0/3212719536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f58068aa0 0x7f6f580b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 -- 172.21.15.31:0/3212719536 >> 172.21.15.31:0/3212719536 conn(0x7f6f580d0090 msgr2=0x7f6f580d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 -- 172.21.15.31:0/3212719536 shutdown_connections 2024-08-17T02:24:43.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.026+0000 7f6f5759e700 1 -- 172.21.15.31:0/3212719536 wait complete. 2024-08-17T02:24:43.045 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:24:43.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.146+0000 7f0885ffe700 1 Processor -- start 2024-08-17T02:24:43.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.146+0000 7f0885ffe700 1 -- start start 2024-08-17T02:24:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.146+0000 7f0885ffe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f08800b2650 0x7f08800cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.146+0000 7f0885ffe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08800cee70 0x7f08800c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.146+0000 7f0885ffe700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08800cc420 con 0x7f0880067c70 2024-08-17T02:24:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.146+0000 7f0885ffe700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08800cb810 con 0x7f08800b2650 2024-08-17T02:24:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.146+0000 7f0885ffe700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08800cbaf0 con 0x7f08800cee70 2024-08-17T02:24:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.146+0000 7f087ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0880067c70 0x7f08800ce760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45722/0 (socket says 172.21.15.31:45722) 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.146+0000 7f087ffff700 1 -- 172.21.15.31:0/694639540 learned_addr learned my addr 172.21.15.31:0/694639540 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0884ffc700 1 --2- 172.21.15.31:0/694639540 >> v2:172.21.15.92:3300/0 conn(0x7f08800b2650 0x7f08800cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f08857fd700 1 --2- 172.21.15.31:0/694639540 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08800cee70 0x7f08800c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f087f7fe700 1 -- 172.21.15.31:0/694639540 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935846017 0 0) 0x7f08800cc420 con 0x7f0880067c70 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f087f7fe700 1 -- 172.21.15.31:0/694639540 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0870003570 con 0x7f0880067c70 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0884ffc700 1 -- 172.21.15.31:0/694639540 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08800cee70 msgr2=0x7f08800c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0884ffc700 1 --2- 172.21.15.31:0/694639540 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08800cee70 0x7f08800c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0884ffc700 1 -- 172.21.15.31:0/694639540 >> v1:172.21.15.31:6789/0 conn(0x7f0880067c70 legacy=0x7f08800ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0884ffc700 1 -- 172.21.15.31:0/694639540 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08800cbdd0 con 0x7f08800b2650 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0884ffc700 1 --2- 172.21.15.31:0/694639540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08800b2650 0x7f08800cada0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f086c0098e0 tx=0x7f086c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c96a58b22424188b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f087f7fe700 1 -- 172.21.15.31:0/694639540 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c011630 con 0x7f08800b2650 2024-08-17T02:24:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f087f7fe700 1 -- 172.21.15.31:0/694639540 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c011790 con 0x7f08800b2650 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f087f7fe700 1 -- 172.21.15.31:0/694639540 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c011b30 con 0x7f08800b2650 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0885ffe700 1 -- 172.21.15.31:0/694639540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08800b2650 msgr2=0x7f08800cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0885ffe700 1 --2- 172.21.15.31:0/694639540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08800b2650 0x7f08800cada0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f086c0098e0 tx=0x7f086c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0885ffe700 1 -- 172.21.15.31:0/694639540 shutdown_connections 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0885ffe700 1 --2- 172.21.15.31:0/694639540 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08800cee70 0x7f08800c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0885ffe700 1 --2- 172.21.15.31:0/694639540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08800b2650 0x7f08800cada0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0885ffe700 1 -- 172.21.15.31:0/694639540 >> 172.21.15.31:0/694639540 conn(0x7f0880089d50 msgr2=0x7f0880099670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0885ffe700 1 -- 172.21.15.31:0/694639540 shutdown_connections 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0885ffe700 1 -- 172.21.15.31:0/694639540 wait complete. 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.150+0000 7f0885ffe700 1 Processor -- start 2024-08-17T02:24:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f0885ffe700 1 -- start start 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f0885ffe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0880067c70 0x7f0880159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f0885ffe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08800b2650 0x7f0880147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f0885ffe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08800cee70 0x7f08800c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f0885ffe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08800b46e0 con 0x7f08800b2650 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f0885ffe700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08800b3ed0 con 0x7f0880067c70 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f0885ffe700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0880159e90 con 0x7f08800cee70 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08800b2650 0x7f0880147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08800b2650 0x7f0880147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56394/0 (socket says 172.21.15.31:56394) 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087ffff700 1 -- 172.21.15.31:0/3549968846 learned_addr learned my addr 172.21.15.31:0/3549968846 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f0884ffc700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0880067c70 0x7f0880159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f08857fd700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08800cee70 0x7f08800c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087ffff700 1 -- 172.21.15.31:0/3549968846 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08800cee70 msgr2=0x7f08800c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087ffff700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08800cee70 0x7f08800c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087ffff700 1 -- 172.21.15.31:0/3549968846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0880067c70 msgr2=0x7f0880159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087ffff700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0880067c70 0x7f0880159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087ffff700 1 -- 172.21.15.31:0/3549968846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c009420 con 0x7f08800b2650 2024-08-17T02:24:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087ffff700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08800b2650 0x7f0880147ba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f087400c7f0 tx=0x7f0874007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087cff9700 1 -- 172.21.15.31:0/3549968846 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874005c00 con 0x7f08800b2650 2024-08-17T02:24:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087cff9700 1 -- 172.21.15.31:0/3549968846 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0874005d60 con 0x7f08800b2650 2024-08-17T02:24:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f0885ffe700 1 -- 172.21.15.31:0/3549968846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08800ca030 con 0x7f08800b2650 2024-08-17T02:24:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f087cff9700 1 -- 172.21.15.31:0/3549968846 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874007300 con 0x7f08800b2650 2024-08-17T02:24:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.154+0000 7f0885ffe700 1 -- 172.21.15.31:0/3549968846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08800b4400 con 0x7f08800b2650 2024-08-17T02:24:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.158+0000 7f0885ffe700 1 -- 172.21.15.31:0/3549968846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0880158030 con 0x7f08800b2650 2024-08-17T02:24:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.158+0000 7f087cff9700 1 -- 172.21.15.31:0/3549968846 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0874012400 con 0x7f08800b2650 2024-08-17T02:24:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.158+0000 7f087cff9700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0864060860 0x7f0864062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.158+0000 7f087cff9700 1 -- 172.21.15.31:0/3549968846 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f087407bcf0 con 0x7f08800b2650 2024-08-17T02:24:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.158+0000 7f0884ffc700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0864060860 0x7f0864062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.158+0000 7f0884ffc700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0864060860 0x7f0864062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f086c0091e0 tx=0x7f086c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.166+0000 7f087cff9700 1 -- 172.21.15.31:0/3549968846 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0874080070 con 0x7f08800b2650 2024-08-17T02:24:43.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.330+0000 7f0885ffe700 1 -- 172.21.15.31:0/3549968846 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f08800712b0 con 0x7f08800b2650 2024-08-17T02:24:43.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.330+0000 7f087cff9700 1 -- 172.21.15.31:0/3549968846 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0874017090 con 0x7f08800b2650 2024-08-17T02:24:43.336 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:43.336 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-08-17T02:24:43.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:24:43.336 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-08-17T02:24:43.336 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-08-17T02:24:43.336 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:24:43.336 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-08-17T02:24:43.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.330+0000 7f0885ffe700 1 -- 172.21.15.31:0/3549968846 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0864060860 msgr2=0x7f0864062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.330+0000 7f0885ffe700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0864060860 0x7f0864062d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f086c0091e0 tx=0x7f086c017000 comp rx=0 tx=0).stop 2024-08-17T02:24:43.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.330+0000 7f0885ffe700 1 -- 172.21.15.31:0/3549968846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08800b2650 msgr2=0x7f0880147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.330+0000 7f0885ffe700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08800b2650 0x7f0880147ba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f087400c7f0 tx=0x7f0874007dd0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.330+0000 7f0885ffe700 1 -- 172.21.15.31:0/3549968846 shutdown_connections 2024-08-17T02:24:43.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.330+0000 7f0885ffe700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0864060860 0x7f0864062d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.334+0000 7f0885ffe700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08800cee70 0x7f08800c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.334+0000 7f0885ffe700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08800b2650 0x7f0880147ba0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.334+0000 7f0885ffe700 1 --2- 172.21.15.31:0/3549968846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0880067c70 0x7f0880159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.334+0000 7f0885ffe700 1 -- 172.21.15.31:0/3549968846 >> 172.21.15.31:0/3549968846 conn(0x7f0880089d50 msgr2=0x7f08800c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:43.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.334+0000 7f0885ffe700 1 -- 172.21.15.31:0/3549968846 shutdown_connections 2024-08-17T02:24:43.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.334+0000 7f0885ffe700 1 -- 172.21.15.31:0/3549968846 wait complete. 2024-08-17T02:24:43.342 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:43.344 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:43.350 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:24:43.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:24:43.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.454+0000 7fa8adb05700 1 Processor -- start 2024-08-17T02:24:43.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.454+0000 7fa8adb05700 1 -- start start 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 0x7fa8a80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa8a80b0c40 0x7fa8a80b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a80b2a60 con 0x7fa8a8159700 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a80b11b0 con 0x7fa8a80b0c40 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80b1490 con 0x7fa8a8159330 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa8a80b0c40 0x7fa8a80b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a77fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 0x7fa8a80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa8a80b0c40 0x7fa8a80b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:44004/0 (socket says 172.21.15.31:44004) 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a6ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa8a8159700 0x7fa8a80b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:47542/0 (socket says 172.21.15.31:47542) 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a77fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 0x7fa8a80b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:34276/0 (socket says 172.21.15.31:34276) 2024-08-17T02:24:43.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a7fff700 1 -- 172.21.15.31:0/2324388686 learned_addr learned my addr 172.21.15.31:0/2324388686 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:43.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a7fff700 1 -- 172.21.15.31:0/2324388686 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 msgr2=0x7fa8a80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:43.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a7fff700 1 --2- 172.21.15.31:0/2324388686 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 0x7fa8a80b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a7fff700 1 -- 172.21.15.31:0/2324388686 >> v1:172.21.15.92:6789/0 conn(0x7fa8a8159700 legacy=0x7fa8a80b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a7fff700 1 -- 172.21.15.31:0/2324388686 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80b1770 con 0x7fa8a80b0c40 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a67fc700 1 -- 172.21.15.31:0/2324388686 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350846962 0 0) 0x7fa8a80b2a60 con 0x7fa8a8159700 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a7fff700 1 --2- 172.21.15.31:0/2324388686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a80b0c40 0x7fa8a80b4170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009f20 tx=0x7fa8a0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daf088f35f9fa1f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a67fc700 1 -- 172.21.15.31:0/2324388686 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000e070 con 0x7fa8a80b0c40 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a67fc700 1 -- 172.21.15.31:0/2324388686 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a000b9d0 con 0x7fa8a80b0c40 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8a67fc700 1 -- 172.21.15.31:0/2324388686 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00092e0 con 0x7fa8a80b0c40 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 -- 172.21.15.31:0/2324388686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a80b0c40 msgr2=0x7fa8a80b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 --2- 172.21.15.31:0/2324388686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a80b0c40 0x7fa8a80b4170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009f20 tx=0x7fa8a0009840 comp rx=0 tx=0).stop 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 -- 172.21.15.31:0/2324388686 shutdown_connections 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 --2- 172.21.15.31:0/2324388686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a80b0c40 0x7fa8a80b4170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 --2- 172.21.15.31:0/2324388686 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 0x7fa8a80b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 -- 172.21.15.31:0/2324388686 >> 172.21.15.31:0/2324388686 conn(0x7fa8a8099610 msgr2=0x7fa8a8067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:43.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 -- 172.21.15.31:0/2324388686 shutdown_connections 2024-08-17T02:24:43.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.458+0000 7fa8adb05700 1 -- 172.21.15.31:0/2324388686 wait complete. 2024-08-17T02:24:43.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8adb05700 1 Processor -- start 2024-08-17T02:24:43.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8adb05700 1 -- start start 2024-08-17T02:24:43.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8adb05700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a80b0c40 0x7fa8a809cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8adb05700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 0x7fa8a809d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8adb05700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a8159700 0x7fa8a815e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8adb05700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a809a3a0 con 0x7fa8a8159700 2024-08-17T02:24:43.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8adb05700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a815f5e0 con 0x7fa8a80b0c40 2024-08-17T02:24:43.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8adb05700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a809a640 con 0x7fa8a8159330 2024-08-17T02:24:43.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8a7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a8159700 0x7fa8a815e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8a7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a8159700 0x7fa8a815e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56410/0 (socket says 172.21.15.31:56410) 2024-08-17T02:24:43.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8a7fff700 1 -- 172.21.15.31:0/887008274 learned_addr learned my addr 172.21.15.31:0/887008274 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:43.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8a6ffd700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 0x7fa8a809d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8a77fe700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a80b0c40 0x7fa8a809cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8a7fff700 1 -- 172.21.15.31:0/887008274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 msgr2=0x7fa8a809d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8a7fff700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 0x7fa8a809d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8a7fff700 1 -- 172.21.15.31:0/887008274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a80b0c40 msgr2=0x7fa8a809cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8a7fff700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a80b0c40 0x7fa8a809cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.462+0000 7fa8a7fff700 1 -- 172.21.15.31:0/887008274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0009ae0 con 0x7fa8a8159700 2024-08-17T02:24:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.466+0000 7fa8a7fff700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a8159700 0x7fa8a815e1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8063b70 tx=0x7fa8a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.466+0000 7fa89f7fe700 1 -- 172.21.15.31:0/887008274 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0008b10 con 0x7fa8a8159700 2024-08-17T02:24:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.466+0000 7fa89f7fe700 1 -- 172.21.15.31:0/887008274 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0008c90 con 0x7fa8a8159700 2024-08-17T02:24:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.466+0000 7fa8adb05700 1 -- 172.21.15.31:0/887008274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a809a920 con 0x7fa8a8159700 2024-08-17T02:24:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.466+0000 7fa89f7fe700 1 -- 172.21.15.31:0/887008274 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00266b0 con 0x7fa8a8159700 2024-08-17T02:24:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.466+0000 7fa8adb05700 1 -- 172.21.15.31:0/887008274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a815e6f0 con 0x7fa8a8159700 2024-08-17T02:24:43.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.466+0000 7fa8adb05700 1 -- 172.21.15.31:0/887008274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a809ab10 con 0x7fa8a8159700 2024-08-17T02:24:43.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.466+0000 7fa89f7fe700 1 -- 172.21.15.31:0/887008274 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa8a0003040 con 0x7fa8a8159700 2024-08-17T02:24:43.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.470+0000 7fa89f7fe700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa888060860 0x7fa888062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:43.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.470+0000 7fa8a77fe700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa888060860 0x7fa888062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:43.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.470+0000 7fa89f7fe700 1 -- 172.21.15.31:0/887008274 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa8a007e2c0 con 0x7fa8a8159700 2024-08-17T02:24:43.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.470+0000 7fa8a77fe700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa888060860 0x7fa888062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa890009db0 tx=0x7fa8900091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:43.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.478+0000 7fa89f7fe700 1 -- 172.21.15.31:0/887008274 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa8a004eaf0 con 0x7fa8a8159700 2024-08-17T02:24:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:43.646+0000 7fa8adb05700 1 -- 172.21.15.31:0/887008274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa8a80712b0 con 0x7fa8a8159700 2024-08-17T02:24:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.654+0000 7fa89f7fe700 1 -- 172.21.15.31:0/887008274 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa8a0052110 con 0x7fa8a8159700 2024-08-17T02:24:44.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.662+0000 7fa8adb05700 1 -- 172.21.15.31:0/887008274 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa888060860 msgr2=0x7fa888062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.662+0000 7fa8adb05700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa888060860 0x7fa888062d10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa890009db0 tx=0x7fa8900091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.662+0000 7fa8adb05700 1 -- 172.21.15.31:0/887008274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a8159700 msgr2=0x7fa8a815e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.662+0000 7fa8adb05700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a8159700 0x7fa8a815e1b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8063b70 tx=0x7fa8a0018000 comp rx=0 tx=0).stop 2024-08-17T02:24:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.662+0000 7fa8adb05700 1 -- 172.21.15.31:0/887008274 shutdown_connections 2024-08-17T02:24:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.662+0000 7fa8adb05700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa888060860 0x7fa888062d10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.662+0000 7fa8adb05700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8a8159700 0x7fa8a815e1b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.662+0000 7fa8adb05700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8a8159330 0x7fa8a809d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.662+0000 7fa8adb05700 1 --2- 172.21.15.31:0/887008274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8a80b0c40 0x7fa8a809cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.662+0000 7fa8adb05700 1 -- 172.21.15.31:0/887008274 >> 172.21.15.31:0/887008274 conn(0x7fa8a8099610 msgr2=0x7fa8a815c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:44.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.666+0000 7fa8adb05700 1 -- 172.21.15.31:0/887008274 shutdown_connections 2024-08-17T02:24:44.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.666+0000 7fa8adb05700 1 -- 172.21.15.31:0/887008274 wait complete. 2024-08-17T02:24:44.671 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-08-17T02:24:44.683 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:24:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.798+0000 7f86b1ad7700 1 Processor -- start 2024-08-17T02:24:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.798+0000 7f86b1ad7700 1 -- start start 2024-08-17T02:24:44.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86ac140630 0x7f86ac0aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f86ac0cba30 0x7f86ac0af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac0ccab0 con 0x7f86ac0677e0 2024-08-17T02:24:44.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac068880 con 0x7f86ac140630 2024-08-17T02:24:44.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac0cbea0 con 0x7f86ac0cba30 2024-08-17T02:24:44.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b0ad5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86ac140630 0x7f86ac0aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b0ad5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86ac140630 0x7f86ac0aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56418/0 (socket says 172.21.15.31:56418) 2024-08-17T02:24:44.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b0ad5700 1 -- 172.21.15.31:0/3446753549 learned_addr learned my addr 172.21.15.31:0/3446753549 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:44.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86abfff700 1 --2- 172.21.15.31:0/3446753549 >> v2:172.21.15.92:3300/0 conn(0x7f86ac0cba30 0x7f86ac0af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b0ad5700 1 -- 172.21.15.31:0/3446753549 >> v2:172.21.15.92:3300/0 conn(0x7f86ac0cba30 msgr2=0x7f86ac0af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:44.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b0ad5700 1 --2- 172.21.15.31:0/3446753549 >> v2:172.21.15.92:3300/0 conn(0x7f86ac0cba30 0x7f86ac0af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b0ad5700 1 -- 172.21.15.31:0/3446753549 >> v1:172.21.15.92:6789/0 conn(0x7f86ac0677e0 legacy=0x7f86ac06e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b0ad5700 1 -- 172.21.15.31:0/3446753549 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac0cc180 con 0x7f86ac140630 2024-08-17T02:24:44.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86abfff700 1 --2- 172.21.15.31:0/3446753549 >> v2:172.21.15.92:3300/0 conn(0x7f86ac0cba30 0x7f86ac0af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:44.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b0ad5700 1 --2- 172.21.15.31:0/3446753549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac140630 0x7f86ac0aed30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0cb2c0 tx=0x7f86a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec2794928486f6c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86ab7fe700 1 -- 172.21.15.31:0/3446753549 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0009e70 con 0x7f86ac140630 2024-08-17T02:24:44.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86ab7fe700 1 -- 172.21.15.31:0/3446753549 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a000b860 con 0x7f86ac140630 2024-08-17T02:24:44.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86ab7fe700 1 -- 172.21.15.31:0/3446753549 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a000bc00 con 0x7f86ac140630 2024-08-17T02:24:44.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 -- 172.21.15.31:0/3446753549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac140630 msgr2=0x7f86ac0aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 --2- 172.21.15.31:0/3446753549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac140630 0x7f86ac0aed30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0cb2c0 tx=0x7f86a0009250 comp rx=0 tx=0).stop 2024-08-17T02:24:44.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 -- 172.21.15.31:0/3446753549 shutdown_connections 2024-08-17T02:24:44.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 --2- 172.21.15.31:0/3446753549 >> v2:172.21.15.92:3300/0 conn(0x7f86ac0cba30 0x7f86ac0af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 --2- 172.21.15.31:0/3446753549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac140630 0x7f86ac0aed30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 -- 172.21.15.31:0/3446753549 >> 172.21.15.31:0/3446753549 conn(0x7f86ac06a0c0 msgr2=0x7f86ac06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:44.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.802+0000 7f86b1ad7700 1 -- 172.21.15.31:0/3446753549 shutdown_connections 2024-08-17T02:24:44.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.806+0000 7f86b1ad7700 1 -- 172.21.15.31:0/3446753549 wait complete. 2024-08-17T02:24:44.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.806+0000 7f86b1ad7700 1 Processor -- start 2024-08-17T02:24:44.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.806+0000 7f86b1ad7700 1 -- start start 2024-08-17T02:24:44.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.806+0000 7f86b1ad7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac0677e0 0x7f86ac0a5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.806+0000 7f86b1ad7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86ac0cba30 0x7f86ac15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.806+0000 7f86b1ad7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ac140630 0x7f86ac13a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.806+0000 7f86b1ad7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0a5b70 con 0x7f86ac0677e0 2024-08-17T02:24:44.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.806+0000 7f86b1ad7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0ac3b0 con 0x7f86ac140630 2024-08-17T02:24:44.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.806+0000 7f86b1ad7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac139460 con 0x7f86ac0cba30 2024-08-17T02:24:44.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b0ad5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac0677e0 0x7f86ac0a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86abfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86ac0cba30 0x7f86ac15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b0ad5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac0677e0 0x7f86ac0a5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56426/0 (socket says 172.21.15.31:56426) 2024-08-17T02:24:44.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b0ad5700 1 -- 172.21.15.31:0/1256147826 learned_addr learned my addr 172.21.15.31:0/1256147826 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b12d6700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ac140630 0x7f86ac13a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b0ad5700 1 -- 172.21.15.31:0/1256147826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86ac0cba30 msgr2=0x7f86ac15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b0ad5700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86ac0cba30 0x7f86ac15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b0ad5700 1 -- 172.21.15.31:0/1256147826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ac140630 msgr2=0x7f86ac13a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b0ad5700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ac140630 0x7f86ac13a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b0ad5700 1 -- 172.21.15.31:0/1256147826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8698009420 con 0x7f86ac0677e0 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b0ad5700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac0677e0 0x7f86ac0a5630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f86ac06d5e0 tx=0x7f86a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86a8ff9700 1 -- 172.21.15.31:0/1256147826 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a000bbe0 con 0x7f86ac0677e0 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86a8ff9700 1 -- 172.21.15.31:0/1256147826 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a0011420 con 0x7f86ac0677e0 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b1ad7700 1 -- 172.21.15.31:0/1256147826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a00094f0 con 0x7f86ac0677e0 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86a8ff9700 1 -- 172.21.15.31:0/1256147826 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a00117c0 con 0x7f86ac0677e0 2024-08-17T02:24:44.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b1ad7700 1 -- 172.21.15.31:0/1256147826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac139d00 con 0x7f86ac0677e0 2024-08-17T02:24:44.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.810+0000 7f86b1ad7700 1 -- 172.21.15.31:0/1256147826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ac139800 con 0x7f86ac0677e0 2024-08-17T02:24:44.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.814+0000 7f86a8ff9700 1 -- 172.21.15.31:0/1256147826 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f86a0011bf0 con 0x7f86ac0677e0 2024-08-17T02:24:44.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.814+0000 7f86a8ff9700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8690060890 0x7f8690062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:44.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.814+0000 7f86a8ff9700 1 -- 172.21.15.31:0/1256147826 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f86a007ddb0 con 0x7f86ac0677e0 2024-08-17T02:24:44.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.814+0000 7f86abfff700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8690060890 0x7f8690062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:44.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.814+0000 7f86abfff700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8690060890 0x7f8690062d40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0ca1c0 tx=0x7f86980091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:44.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.822+0000 7f86a8ff9700 1 -- 172.21.15.31:0/1256147826 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f86ac139800 con 0x7f86ac0677e0 2024-08-17T02:24:44.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:44.990+0000 7f86b1ad7700 1 -- 172.21.15.31:0/1256147826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f86ac0712b0 con 0x7f86ac0677e0 2024-08-17T02:24:45.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.666+0000 7f86a8ff9700 1 -- 172.21.15.31:0/1256147826 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f86a004e3e0 con 0x7f86ac0677e0 2024-08-17T02:24:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 -- 172.21.15.31:0/1256147826 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8690060890 msgr2=0x7f8690062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8690060890 0x7f8690062d40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0ca1c0 tx=0x7f86980091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 -- 172.21.15.31:0/1256147826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac0677e0 msgr2=0x7f86ac0a5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac0677e0 0x7f86ac0a5630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f86ac06d5e0 tx=0x7f86a0017000 comp rx=0 tx=0).stop 2024-08-17T02:24:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 -- 172.21.15.31:0/1256147826 shutdown_connections 2024-08-17T02:24:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8690060890 0x7f8690062d40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86ac140630 0x7f86ac13a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86ac0cba30 0x7f86ac15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 --2- 172.21.15.31:0/1256147826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86ac0677e0 0x7f86ac0a5630 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 -- 172.21.15.31:0/1256147826 >> 172.21.15.31:0/1256147826 conn(0x7f86ac06a0c0 msgr2=0x7f86ac157a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:45.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 -- 172.21.15.31:0/1256147826 shutdown_connections 2024-08-17T02:24:45.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.690+0000 7f86b1ad7700 1 -- 172.21.15.31:0/1256147826 wait complete. 2024-08-17T02:24:45.697 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-08-17T02:24:45.708 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:24:45.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.810+0000 7fb84ff1e700 1 Processor -- start 2024-08-17T02:24:45.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.810+0000 7fb84ff1e700 1 -- start start 2024-08-17T02:24:45.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb848159330 0x7fb8480b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb8480b0c40 0x7fb8480b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8480b2a60 con 0x7fb848159700 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480b11b0 con 0x7fb848159330 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480b1490 con 0x7fb8480b0c40 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84dcba700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb848159330 0x7fb8480b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84dcba700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb848159330 0x7fb8480b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56442/0 (socket says 172.21.15.31:56442) 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84dcba700 1 -- 172.21.15.31:0/135277134 learned_addr learned my addr 172.21.15.31:0/135277134 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84e4bb700 1 --2- 172.21.15.31:0/135277134 >> v2:172.21.15.92:3300/0 conn(0x7fb8480b0c40 0x7fb8480b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84dcba700 1 -- 172.21.15.31:0/135277134 >> v2:172.21.15.92:3300/0 conn(0x7fb8480b0c40 msgr2=0x7fb8480b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84dcba700 1 --2- 172.21.15.31:0/135277134 >> v2:172.21.15.92:3300/0 conn(0x7fb8480b0c40 0x7fb8480b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84dcba700 1 -- 172.21.15.31:0/135277134 >> v1:172.21.15.92:6789/0 conn(0x7fb848159700 legacy=0x7fb8480b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84dcba700 1 -- 172.21.15.31:0/135277134 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480b1770 con 0x7fb848159330 2024-08-17T02:24:45.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84dcba700 1 --2- 172.21.15.31:0/135277134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848159330 0x7fb8480b3c30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb84815cf60 tx=0x7fb838009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3db54b5d9dc199 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ccb8700 1 -- 172.21.15.31:0/135277134 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800e070 con 0x7fb848159330 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ccb8700 1 -- 172.21.15.31:0/135277134 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83800ba20 con 0x7fb848159330 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ccb8700 1 -- 172.21.15.31:0/135277134 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380092e0 con 0x7fb848159330 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 -- 172.21.15.31:0/135277134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848159330 msgr2=0x7fb8480b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 --2- 172.21.15.31:0/135277134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848159330 0x7fb8480b3c30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb84815cf60 tx=0x7fb838009840 comp rx=0 tx=0).stop 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 -- 172.21.15.31:0/135277134 shutdown_connections 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 --2- 172.21.15.31:0/135277134 >> v2:172.21.15.92:3300/0 conn(0x7fb8480b0c40 0x7fb8480b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 --2- 172.21.15.31:0/135277134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb848159330 0x7fb8480b3c30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 -- 172.21.15.31:0/135277134 >> 172.21.15.31:0/135277134 conn(0x7fb848099610 msgr2=0x7fb848067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 -- 172.21.15.31:0/135277134 shutdown_connections 2024-08-17T02:24:45.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.814+0000 7fb84ff1e700 1 -- 172.21.15.31:0/135277134 wait complete. 2024-08-17T02:24:45.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84ff1e700 1 Processor -- start 2024-08-17T02:24:45.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84ff1e700 1 -- start start 2024-08-17T02:24:45.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84ff1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b0c40 0x7fb8480ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84ff1e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb848159330 0x7fb84816d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84ff1e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848159700 0x7fb8481585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84ff1e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84809af90 con 0x7fb8480b0c40 2024-08-17T02:24:45.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84ff1e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480af540 con 0x7fb848159700 2024-08-17T02:24:45.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84ff1e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84816d870 con 0x7fb848159330 2024-08-17T02:24:45.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84dcba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b0c40 0x7fb8480ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84dcba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b0c40 0x7fb8480ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56450/0 (socket says 172.21.15.31:56450) 2024-08-17T02:24:45.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84dcba700 1 -- 172.21.15.31:0/4054575303 learned_addr learned my addr 172.21.15.31:0/4054575303 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:45.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84d4b9700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb848159330 0x7fb84816d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84e4bb700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848159700 0x7fb8481585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84dcba700 1 -- 172.21.15.31:0/4054575303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb848159330 msgr2=0x7fb84816d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84dcba700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb848159330 0x7fb84816d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84dcba700 1 -- 172.21.15.31:0/4054575303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848159700 msgr2=0x7fb8481585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:45.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84dcba700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848159700 0x7fb8481585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:45.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84dcba700 1 -- 172.21.15.31:0/4054575303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009ae0 con 0x7fb8480b0c40 2024-08-17T02:24:45.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84dcba700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b0c40 0x7fb8480ad630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb848063b70 tx=0x7fb838018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb845ffb700 1 -- 172.21.15.31:0/4054575303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380078f0 con 0x7fb8480b0c40 2024-08-17T02:24:45.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb845ffb700 1 -- 172.21.15.31:0/4054575303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838007a70 con 0x7fb8480b0c40 2024-08-17T02:24:45.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84ff1e700 1 -- 172.21.15.31:0/4054575303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84809a410 con 0x7fb8480b0c40 2024-08-17T02:24:45.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb845ffb700 1 -- 172.21.15.31:0/4054575303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838007e30 con 0x7fb8480b0c40 2024-08-17T02:24:45.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.818+0000 7fb84ff1e700 1 -- 172.21.15.31:0/4054575303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84809a9d0 con 0x7fb8480b0c40 2024-08-17T02:24:45.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.822+0000 7fb84ff1e700 1 -- 172.21.15.31:0/4054575303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb848169400 con 0x7fb8480b0c40 2024-08-17T02:24:45.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.822+0000 7fb845ffb700 1 -- 172.21.15.31:0/4054575303 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb838003040 con 0x7fb8480b0c40 2024-08-17T02:24:45.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.822+0000 7fb845ffb700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb834060860 0x7fb834062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:45.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.822+0000 7fb845ffb700 1 -- 172.21.15.31:0/4054575303 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb83807e5f0 con 0x7fb8480b0c40 2024-08-17T02:24:45.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.822+0000 7fb84d4b9700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb834060860 0x7fb834062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:45.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.822+0000 7fb84d4b9700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb834060860 0x7fb834062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb84815cab0 tx=0x7fb83c007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:45.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:45.830+0000 7fb845ffb700 1 -- 172.21.15.31:0/4054575303 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb83804eaa0 con 0x7fb8480b0c40 2024-08-17T02:24:46.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.034+0000 7fb84ff1e700 1 -- 172.21.15.31:0/4054575303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb8480712b0 con 0x7fb8480b0c40 2024-08-17T02:24:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.674+0000 7fb845ffb700 1 -- 172.21.15.31:0/4054575303 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb8380520c0 con 0x7fb8480b0c40 2024-08-17T02:24:46.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.682+0000 7fb84ff1e700 1 -- 172.21.15.31:0/4054575303 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb834060860 msgr2=0x7fb834062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.682+0000 7fb84ff1e700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb834060860 0x7fb834062d10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb84815cab0 tx=0x7fb83c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.686+0000 7fb84ff1e700 1 -- 172.21.15.31:0/4054575303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b0c40 msgr2=0x7fb8480ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.686+0000 7fb84ff1e700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b0c40 0x7fb8480ad630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb848063b70 tx=0x7fb838018000 comp rx=0 tx=0).stop 2024-08-17T02:24:46.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.694+0000 7fb84ff1e700 1 -- 172.21.15.31:0/4054575303 shutdown_connections 2024-08-17T02:24:46.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.694+0000 7fb84ff1e700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb834060860 0x7fb834062d10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.694+0000 7fb84ff1e700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb848159700 0x7fb8481585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.694+0000 7fb84ff1e700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb848159330 0x7fb84816d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.694+0000 7fb84ff1e700 1 --2- 172.21.15.31:0/4054575303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8480b0c40 0x7fb8480ad630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.694+0000 7fb84ff1e700 1 -- 172.21.15.31:0/4054575303 >> 172.21.15.31:0/4054575303 conn(0x7fb848099610 msgr2=0x7fb848069c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:46.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.698+0000 7fb84ff1e700 1 -- 172.21.15.31:0/4054575303 shutdown_connections 2024-08-17T02:24:46.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.698+0000 7fb84ff1e700 1 -- 172.21.15.31:0/4054575303 wait complete. 2024-08-17T02:24:46.705 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:24:46.718 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:46.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc58222b700 1 Processor -- start 2024-08-17T02:24:46.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc58222b700 1 -- start start 2024-08-17T02:24:46.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc58222b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc57c0aff40 0x7fc57c159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc58222b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c159db0 0x7fc57c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc58222b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c068980 con 0x7fc57c0afb70 2024-08-17T02:24:46.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc58222b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c067b10 con 0x7fc57c0aff40 2024-08-17T02:24:46.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc58222b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c15a770 con 0x7fc57c159db0 2024-08-17T02:24:46.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc580a28700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc57c0aff40 0x7fc57c159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc580a28700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc57c0aff40 0x7fc57c159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:44070/0 (socket says 172.21.15.31:44070) 2024-08-17T02:24:46.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc580a28700 1 -- 172.21.15.31:0/3619267617 learned_addr learned my addr 172.21.15.31:0/3619267617 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:46.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc581229700 1 --1- 172.21.15.31:0/3619267617 >> v1:172.21.15.92:6789/0 conn(0x7fc57c0afb70 0x7fc57c067400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:47568/0 (socket says 172.21.15.31:47568) 2024-08-17T02:24:46.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc581a2a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c159db0 0x7fc57c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc580a28700 1 -- 172.21.15.31:0/3619267617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c159db0 msgr2=0x7fc57c15a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:46.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc580a28700 1 --2- 172.21.15.31:0/3619267617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c159db0 0x7fc57c15a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc580a28700 1 -- 172.21.15.31:0/3619267617 >> v1:172.21.15.92:6789/0 conn(0x7fc57c0afb70 legacy=0x7fc57c067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc580a28700 1 -- 172.21.15.31:0/3619267617 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c067d70 con 0x7fc57c0aff40 2024-08-17T02:24:46.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.810+0000 7fc581a2a700 1 --2- 172.21.15.31:0/3619267617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c159db0 0x7fc57c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:46.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc580a28700 1 --2- 172.21.15.31:0/3619267617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc57c0aff40 0x7fc57c159870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc5700099b0 tx=0x7fc570009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a46d097955c856 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:46.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc56ffff700 1 -- 172.21.15.31:0/3619267617 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570009ea0 con 0x7fc57c0aff40 2024-08-17T02:24:46.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc56ffff700 1 -- 172.21.15.31:0/3619267617 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57000b860 con 0x7fc57c0aff40 2024-08-17T02:24:46.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc56ffff700 1 -- 172.21.15.31:0/3619267617 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000bc00 con 0x7fc57c0aff40 2024-08-17T02:24:46.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc58222b700 1 -- 172.21.15.31:0/3619267617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc57c0aff40 msgr2=0x7fc57c159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc58222b700 1 --2- 172.21.15.31:0/3619267617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc57c0aff40 0x7fc57c159870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc5700099b0 tx=0x7fc570009250 comp rx=0 tx=0).stop 2024-08-17T02:24:46.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc58222b700 1 -- 172.21.15.31:0/3619267617 shutdown_connections 2024-08-17T02:24:46.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc58222b700 1 --2- 172.21.15.31:0/3619267617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c159db0 0x7fc57c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc58222b700 1 --2- 172.21.15.31:0/3619267617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc57c0aff40 0x7fc57c159870 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc58222b700 1 -- 172.21.15.31:0/3619267617 >> 172.21.15.31:0/3619267617 conn(0x7fc57c0cc5d0 msgr2=0x7fc57c0cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:46.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc58222b700 1 -- 172.21.15.31:0/3619267617 shutdown_connections 2024-08-17T02:24:46.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc58222b700 1 -- 172.21.15.31:0/3619267617 wait complete. 2024-08-17T02:24:46.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc58222b700 1 Processor -- start 2024-08-17T02:24:46.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.814+0000 7fc58222b700 1 -- start start 2024-08-17T02:24:46.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc58222b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c0afb70 0x7fc57c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc58222b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc57c0aff40 0x7fc57c14ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc58222b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c159db0 0x7fc57c13e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc58222b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0aef80 con 0x7fc57c159db0 2024-08-17T02:24:46.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc58222b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1504c0 con 0x7fc57c0aff40 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc58222b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1548e0 con 0x7fc57c0afb70 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc581a2a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c159db0 0x7fc57c13e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc581a2a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c159db0 0x7fc57c13e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56462/0 (socket says 172.21.15.31:56462) 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc581a2a700 1 -- 172.21.15.31:0/3226115393 learned_addr learned my addr 172.21.15.31:0/3226115393 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc580a28700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc57c0aff40 0x7fc57c14ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc581229700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c0afb70 0x7fc57c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc581a2a700 1 -- 172.21.15.31:0/3226115393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c0afb70 msgr2=0x7fc57c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc581a2a700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c0afb70 0x7fc57c0ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc581a2a700 1 -- 172.21.15.31:0/3226115393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc57c0aff40 msgr2=0x7fc57c14ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc581a2a700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc57c0aff40 0x7fc57c14ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc581a2a700 1 -- 172.21.15.31:0/3226115393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574009420 con 0x7fc57c159db0 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc580a28700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc57c0aff40 0x7fc57c14ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:46.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc581a2a700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c159db0 0x7fc57c13e970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc57400ec80 tx=0x7fc5740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:46.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc56d7fa700 1 -- 172.21.15.31:0/3226115393 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400c9d0 con 0x7fc57c159db0 2024-08-17T02:24:46.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc56d7fa700 1 -- 172.21.15.31:0/3226115393 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57400cb30 con 0x7fc57c159db0 2024-08-17T02:24:46.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc58222b700 1 -- 172.21.15.31:0/3226115393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5700094f0 con 0x7fc57c159db0 2024-08-17T02:24:46.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc56d7fa700 1 -- 172.21.15.31:0/3226115393 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574013470 con 0x7fc57c159db0 2024-08-17T02:24:46.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.818+0000 7fc58222b700 1 -- 172.21.15.31:0/3226115393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c154290 con 0x7fc57c159db0 2024-08-17T02:24:46.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.822+0000 7fc58222b700 1 -- 172.21.15.31:0/3226115393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c0712b0 con 0x7fc57c159db0 2024-08-17T02:24:46.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.822+0000 7fc56d7fa700 1 -- 172.21.15.31:0/3226115393 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc574013860 con 0x7fc57c159db0 2024-08-17T02:24:46.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.822+0000 7fc56d7fa700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc560060860 0x7fc560062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:46.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.822+0000 7fc56d7fa700 1 -- 172.21.15.31:0/3226115393 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc57407cdf0 con 0x7fc57c159db0 2024-08-17T02:24:46.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.822+0000 7fc581229700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc560060860 0x7fc560062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:46.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.822+0000 7fc581229700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc560060860 0x7fc560062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc578001ee0 tx=0x7fc578005cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:46.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.826+0000 7fc56d7fa700 1 -- 172.21.15.31:0/3226115393 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc57404d1a0 con 0x7fc57c159db0 2024-08-17T02:24:46.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.994+0000 7fc58222b700 1 -- 172.21.15.31:0/3226115393 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc57c154a20 con 0x7fc57c159db0 2024-08-17T02:24:47.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.994+0000 7fc56d7fa700 1 -- 172.21.15.31:0/3226115393 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fc5740507c0 con 0x7fc57c159db0 2024-08-17T02:24:47.000 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:47.001 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":22,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:46.039991+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:47.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 -- 172.21.15.31:0/3226115393 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc560060860 msgr2=0x7fc560062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc560060860 0x7fc560062d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc578001ee0 tx=0x7fc578005cd0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 -- 172.21.15.31:0/3226115393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c159db0 msgr2=0x7fc57c13e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c159db0 0x7fc57c13e970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc57400ec80 tx=0x7fc5740091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 -- 172.21.15.31:0/3226115393 shutdown_connections 2024-08-17T02:24:47.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc560060860 0x7fc560062d10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc57c159db0 0x7fc57c13e970 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc57c0aff40 0x7fc57c14ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 --2- 172.21.15.31:0/3226115393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc57c0afb70 0x7fc57c0ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 -- 172.21.15.31:0/3226115393 >> 172.21.15.31:0/3226115393 conn(0x7fc57c0cc5d0 msgr2=0x7fc57c15aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:47.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 -- 172.21.15.31:0/3226115393 shutdown_connections 2024-08-17T02:24:47.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:46.998+0000 7fc58222b700 1 -- 172.21.15.31:0/3226115393 wait complete. 2024-08-17T02:24:47.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:47.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.118+0000 7f151b59e700 1 Processor -- start 2024-08-17T02:24:47.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.118+0000 7f151b59e700 1 -- start start 2024-08-17T02:24:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 0x7f151c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f151c15d8b0 0x7f151c1422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151c141e40 con 0x7f151c0691b0 2024-08-17T02:24:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151c15dd30 con 0x7f151c15d8b0 2024-08-17T02:24:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c141230 con 0x7f151c069580 2024-08-17T02:24:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f151c15d8b0 0x7f151c1422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f151c15d8b0 0x7f151c1422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56474/0 (socket says 172.21.15.31:56474) 2024-08-17T02:24:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151ad9d700 1 -- 172.21.15.31:0/2983309587 learned_addr learned my addr 172.21.15.31:0/2983309587 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f1519d9b700 1 --2- 172.21.15.31:0/2983309587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 0x7f151c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151ad9d700 1 -- 172.21.15.31:0/2983309587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 msgr2=0x7f151c15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151ad9d700 1 --2- 172.21.15.31:0/2983309587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 0x7f151c15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151ad9d700 1 -- 172.21.15.31:0/2983309587 >> v1:172.21.15.92:6789/0 conn(0x7f151c0691b0 legacy=0x7f151c161e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151ad9d700 1 -- 172.21.15.31:0/2983309587 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c141510 con 0x7f151c15d8b0 2024-08-17T02:24:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151ad9d700 1 --2- 172.21.15.31:0/2983309587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 0x7f151c1422d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f15140099b0 tx=0x7f1514009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1d00cc97cb9129 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151959a700 1 -- 172.21.15.31:0/2983309587 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514009ea0 con 0x7f151c15d8b0 2024-08-17T02:24:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151959a700 1 -- 172.21.15.31:0/2983309587 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151400b860 con 0x7f151c15d8b0 2024-08-17T02:24:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151959a700 1 -- 172.21.15.31:0/2983309587 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151400bc00 con 0x7f151c15d8b0 2024-08-17T02:24:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 -- 172.21.15.31:0/2983309587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 msgr2=0x7f151c1422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 --2- 172.21.15.31:0/2983309587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 0x7f151c1422d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f15140099b0 tx=0x7f1514009250 comp rx=0 tx=0).stop 2024-08-17T02:24:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 -- 172.21.15.31:0/2983309587 shutdown_connections 2024-08-17T02:24:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 --2- 172.21.15.31:0/2983309587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 0x7f151c1422d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 --2- 172.21.15.31:0/2983309587 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 0x7f151c15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 -- 172.21.15.31:0/2983309587 >> 172.21.15.31:0/2983309587 conn(0x7f151c067400 msgr2=0x7f151c067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 -- 172.21.15.31:0/2983309587 shutdown_connections 2024-08-17T02:24:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.122+0000 7f151b59e700 1 -- 172.21.15.31:0/2983309587 wait complete. 2024-08-17T02:24:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151b59e700 1 Processor -- start 2024-08-17T02:24:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151b59e700 1 -- start start 2024-08-17T02:24:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151b59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c0691b0 0x7f151c160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151b59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 0x7f151c13d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 0x7f151c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c16e2e0 con 0x7f151c15d8b0 2024-08-17T02:24:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151b59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151c160300 con 0x7f151c0691b0 2024-08-17T02:24:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151b59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151c1605e0 con 0x7f151c069580 2024-08-17T02:24:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 0x7f151c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f1519d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 0x7f151c13d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 0x7f151c15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56478/0 (socket says 172.21.15.31:56478) 2024-08-17T02:24:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151ad9d700 1 -- 172.21.15.31:0/605287268 learned_addr learned my addr 172.21.15.31:0/605287268 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151a59c700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c0691b0 0x7f151c160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f1519d9b700 1 -- 172.21.15.31:0/605287268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c0691b0 msgr2=0x7f151c160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f1519d9b700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c0691b0 0x7f151c160dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f1519d9b700 1 -- 172.21.15.31:0/605287268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 msgr2=0x7f151c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f1519d9b700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 0x7f151c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f1519d9b700 1 -- 172.21.15.31:0/605287268 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140094f0 con 0x7f151c069580 2024-08-17T02:24:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.126+0000 7f151ad9d700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 0x7f151c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f1519d9b700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 0x7f151c13d710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1504009ef0 tx=0x7f150400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f15127fc700 1 -- 172.21.15.31:0/605287268 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400cb70 con 0x7f151c069580 2024-08-17T02:24:47.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f15127fc700 1 -- 172.21.15.31:0/605287268 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150400f040 con 0x7f151c069580 2024-08-17T02:24:47.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f151b59e700 1 -- 172.21.15.31:0/605287268 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151c1608c0 con 0x7f151c069580 2024-08-17T02:24:47.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f15127fc700 1 -- 172.21.15.31:0/605287268 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504014480 con 0x7f151c069580 2024-08-17T02:24:47.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f151b59e700 1 -- 172.21.15.31:0/605287268 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c13ddf0 con 0x7f151c069580 2024-08-17T02:24:47.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f151b59e700 1 -- 172.21.15.31:0/605287268 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151c0712b0 con 0x7f151c069580 2024-08-17T02:24:47.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f15127fc700 1 -- 172.21.15.31:0/605287268 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1504014830 con 0x7f151c069580 2024-08-17T02:24:47.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f15127fc700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f14fc060860 0x7f14fc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f151a59c700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f14fc060860 0x7f14fc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.130+0000 7f15127fc700 1 -- 172.21.15.31:0/605287268 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f150407d850 con 0x7f151c069580 2024-08-17T02:24:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.134+0000 7f151a59c700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f14fc060860 0x7f14fc062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f150c003a80 tx=0x7f150c007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.142+0000 7f15127fc700 1 -- 172.21.15.31:0/605287268 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f150404dc00 con 0x7f151c069580 2024-08-17T02:24:47.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.310+0000 7f151b59e700 1 -- 172.21.15.31:0/605287268 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f151c1600e0 con 0x7f151c069580 2024-08-17T02:24:47.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.310+0000 7f15127fc700 1 -- 172.21.15.31:0/605287268 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f1504051220 con 0x7f151c069580 2024-08-17T02:24:47.318 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:47.318 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":22,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:46.039991+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 -- 172.21.15.31:0/605287268 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f14fc060860 msgr2=0x7f14fc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f14fc060860 0x7f14fc062d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f150c003a80 tx=0x7f150c007ec0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 -- 172.21.15.31:0/605287268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 msgr2=0x7f151c13d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 0x7f151c13d710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1504009ef0 tx=0x7f150400b040 comp rx=0 tx=0).stop 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 -- 172.21.15.31:0/605287268 shutdown_connections 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f14fc060860 0x7f14fc062d10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f151c15d8b0 0x7f151c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f151c069580 0x7f151c13d710 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 --2- 172.21.15.31:0/605287268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f151c0691b0 0x7f151c160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 -- 172.21.15.31:0/605287268 >> 172.21.15.31:0/605287268 conn(0x7f151c067400 msgr2=0x7f151c0b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:47.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 -- 172.21.15.31:0/605287268 shutdown_connections 2024-08-17T02:24:47.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.314+0000 7f151b59e700 1 -- 172.21.15.31:0/605287268 wait complete. 2024-08-17T02:24:47.333 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:24:47.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.434+0000 7f48a15d1700 1 Processor -- start 2024-08-17T02:24:47.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.434+0000 7f48a15d1700 1 -- start start 2024-08-17T02:24:47.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.434+0000 7f48a15d1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f489c069ec0 0x7f489c06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.434+0000 7f48a15d1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c06a860 con 0x7f489c0b0780 2024-08-17T02:24:47.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.434+0000 7f48a15d1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c0af0e0 con 0x7f489c157080 2024-08-17T02:24:47.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.434+0000 7f48a15d1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c0b0bb0 con 0x7f489c069ec0 2024-08-17T02:24:47.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f489b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f489c0b0780 0x7f489c0af570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45728/0 (socket says 172.21.15.31:45728) 2024-08-17T02:24:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f489b7fe700 1 -- 172.21.15.31:0/2095076434 learned_addr learned my addr 172.21.15.31:0/2095076434 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a0dd0700 1 --2- 172.21.15.31:0/2095076434 >> v2:172.21.15.31:3300/0 conn(0x7f489c069ec0 0x7f489c06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f489affd700 1 -- 172.21.15.31:0/2095076434 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182339416 0 0) 0x7f4884001490 con 0x7f489c0b0780 2024-08-17T02:24:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a0dd0700 1 -- 172.21.15.31:0/2095076434 >> v1:172.21.15.92:6789/0 conn(0x7f489c157080 legacy=0x7f489c0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a0dd0700 1 -- 172.21.15.31:0/2095076434 >> v1:172.21.15.31:6789/0 conn(0x7f489c0b0780 legacy=0x7f489c0af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a0dd0700 1 -- 172.21.15.31:0/2095076434 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c157450 con 0x7f489c069ec0 2024-08-17T02:24:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a0dd0700 1 --2- 172.21.15.31:0/2095076434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 0x7f489c06a320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f48940098e0 tx=0x7f48940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f548f4313cf0e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f489affd700 1 -- 172.21.15.31:0/2095076434 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894009e80 con 0x7f489c069ec0 2024-08-17T02:24:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f489affd700 1 -- 172.21.15.31:0/2095076434 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489400b860 con 0x7f489c069ec0 2024-08-17T02:24:47.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f489affd700 1 -- 172.21.15.31:0/2095076434 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400bbe0 con 0x7f489c069ec0 2024-08-17T02:24:47.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a15d1700 1 -- 172.21.15.31:0/2095076434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 msgr2=0x7f489c06a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a15d1700 1 --2- 172.21.15.31:0/2095076434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 0x7f489c06a320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f48940098e0 tx=0x7f48940091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a15d1700 1 -- 172.21.15.31:0/2095076434 shutdown_connections 2024-08-17T02:24:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a15d1700 1 --2- 172.21.15.31:0/2095076434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 0x7f489c06a320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a15d1700 1 -- 172.21.15.31:0/2095076434 >> 172.21.15.31:0/2095076434 conn(0x7f489c067e90 msgr2=0x7f489c0cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a15d1700 1 -- 172.21.15.31:0/2095076434 shutdown_connections 2024-08-17T02:24:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.438+0000 7f48a15d1700 1 -- 172.21.15.31:0/2095076434 wait complete. 2024-08-17T02:24:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a15d1700 1 Processor -- start 2024-08-17T02:24:47.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a15d1700 1 -- start start 2024-08-17T02:24:47.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a15d1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 0x7f489c0add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a15d1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f489c0b0780 0x7f489c169f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a15d1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f489c157080 0x7f489c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a15d1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0ae280 con 0x7f489c069ec0 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a15d1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c1592e0 con 0x7f489c0b0780 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a15d1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c16d050 con 0x7f489c157080 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 0x7f489c0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f489c0b0780 0x7f489c169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 0x7f489c0add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56490/0 (socket says 172.21.15.31:56490) 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f489c0b0780 0x7f489c169f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:44100/0 (socket says 172.21.15.31:44100) 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489bfff700 1 -- 172.21.15.31:0/2914815544 learned_addr learned my addr 172.21.15.31:0/2914815544 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a0dd0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f489c157080 0x7f489c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489bfff700 1 -- 172.21.15.31:0/2914815544 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f489c157080 msgr2=0x7f489c06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489bfff700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f489c157080 0x7f489c06e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489bfff700 1 -- 172.21.15.31:0/2914815544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f489c0b0780 msgr2=0x7f489c169f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489bfff700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f489c0b0780 0x7f489c169f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489bfff700 1 -- 172.21.15.31:0/2914815544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4894009420 con 0x7f489c069ec0 2024-08-17T02:24:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f489bfff700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 0x7f489c0add40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c590 tx=0x7f488c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f4893fff700 1 -- 172.21.15.31:0/2914815544 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c011590 con 0x7f489c069ec0 2024-08-17T02:24:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f4893fff700 1 -- 172.21.15.31:0/2914815544 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c011710 con 0x7f489c069ec0 2024-08-17T02:24:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a15d1700 1 -- 172.21.15.31:0/2914815544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c16d330 con 0x7f489c069ec0 2024-08-17T02:24:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f4893fff700 1 -- 172.21.15.31:0/2914815544 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c011ad0 con 0x7f489c069ec0 2024-08-17T02:24:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.442+0000 7f48a15d1700 1 -- 172.21.15.31:0/2914815544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c16a4d0 con 0x7f489c069ec0 2024-08-17T02:24:47.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.446+0000 7f48a15d1700 1 -- 172.21.15.31:0/2914815544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c0712b0 con 0x7f489c069ec0 2024-08-17T02:24:47.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.446+0000 7f4893fff700 1 -- 172.21.15.31:0/2914815544 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f488c01b3b0 con 0x7f489c069ec0 2024-08-17T02:24:47.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.446+0000 7f4893fff700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f487c060860 0x7f487c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.446+0000 7f4893fff700 1 -- 172.21.15.31:0/2914815544 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f488c07bfa0 con 0x7f489c069ec0 2024-08-17T02:24:47.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.446+0000 7f489b7fe700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f487c060860 0x7f487c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.446+0000 7f489b7fe700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f487c060860 0x7f487c062d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f489c14fe00 tx=0x7f4884001970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.454+0000 7f4893fff700 1 -- 172.21.15.31:0/2914815544 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f488c04c3f0 con 0x7f489c069ec0 2024-08-17T02:24:47.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.650+0000 7f48a15d1700 1 -- 172.21.15.31:0/2914815544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f489c16d520 con 0x7f489c069ec0 2024-08-17T02:24:47.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f4893fff700 1 -- 172.21.15.31:0/2914815544 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f488c017020 con 0x7f489c069ec0 2024-08-17T02:24:47.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f48a15d1700 1 -- 172.21.15.31:0/2914815544 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f487c060860 msgr2=0x7f487c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f48a15d1700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f487c060860 0x7f487c062d10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f489c14fe00 tx=0x7f4884001970 comp rx=0 tx=0).stop 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f48a15d1700 1 -- 172.21.15.31:0/2914815544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 msgr2=0x7f489c0add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f48a15d1700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 0x7f489c0add40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c590 tx=0x7f488c00c8a0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f48a15d1700 1 -- 172.21.15.31:0/2914815544 shutdown_connections 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f48a15d1700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f487c060860 0x7f487c062d10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f48a15d1700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f489c157080 0x7f489c06e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f48a15d1700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f489c0b0780 0x7f489c169f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f48a15d1700 1 --2- 172.21.15.31:0/2914815544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f489c069ec0 0x7f489c0add40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.682+0000 7f48a15d1700 1 -- 172.21.15.31:0/2914815544 >> 172.21.15.31:0/2914815544 conn(0x7f489c067e90 msgr2=0x7f489c150a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.686+0000 7f48a15d1700 1 -- 172.21.15.31:0/2914815544 shutdown_connections 2024-08-17T02:24:47.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.686+0000 7f48a15d1700 1 -- 172.21.15.31:0/2914815544 wait complete. 2024-08-17T02:24:47.706 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:24:47.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f223da45700 1 Processor -- start 2024-08-17T02:24:47.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f223da45700 1 -- start start 2024-08-17T02:24:47.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f223da45700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2238159330 0x7f22380b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f223da45700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22380b2a60 con 0x7f22380b0c40 2024-08-17T02:24:47.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f223da45700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22380b11b0 con 0x7f2238159700 2024-08-17T02:24:47.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f223da45700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22380b1490 con 0x7f2238159330 2024-08-17T02:24:47.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f22377fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f22380b0c40 0x7f22380cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45738/0 (socket says 172.21.15.31:45738) 2024-08-17T02:24:47.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f22377fe700 1 -- 172.21.15.31:0/3459828153 learned_addr learned my addr 172.21.15.31:0/3459828153 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:47.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f2236ffd700 1 --2- 172.21.15.31:0/3459828153 >> v2:172.21.15.92:3300/0 conn(0x7f2238159330 0x7f22380b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f2235ffb700 1 -- 172.21.15.31:0/3459828153 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914052868 0 0) 0x7f22380b11b0 con 0x7f2238159700 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f2235ffb700 1 -- 172.21.15.31:0/3459828153 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2224003570 con 0x7f2238159700 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f2236ffd700 1 -- 172.21.15.31:0/3459828153 >> v1:172.21.15.92:6789/0 conn(0x7f2238159700 legacy=0x7f22380b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.814+0000 7f2235ffb700 1 -- 172.21.15.31:0/3459828153 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981584222 0 0) 0x7f22380b2a60 con 0x7f22380b0c40 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f2236ffd700 1 -- 172.21.15.31:0/3459828153 >> v1:172.21.15.31:6789/0 conn(0x7f22380b0c40 legacy=0x7f22380cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f2236ffd700 1 -- 172.21.15.31:0/3459828153 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22380b1770 con 0x7f2238159330 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f2236ffd700 1 --2- 172.21.15.31:0/3459828153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2238159330 0x7f22380b3c30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e60 tx=0x7f2230009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b282dd61911fa6fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f2235ffb700 1 -- 172.21.15.31:0/3459828153 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000e070 con 0x7f2238159330 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f2235ffb700 1 -- 172.21.15.31:0/3459828153 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223000bb60 con 0x7f2238159330 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f2235ffb700 1 -- 172.21.15.31:0/3459828153 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230012430 con 0x7f2238159330 2024-08-17T02:24:47.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f223da45700 1 -- 172.21.15.31:0/3459828153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2238159330 msgr2=0x7f22380b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f223da45700 1 --2- 172.21.15.31:0/3459828153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2238159330 0x7f22380b3c30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e60 tx=0x7f2230009780 comp rx=0 tx=0).stop 2024-08-17T02:24:47.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f223da45700 1 -- 172.21.15.31:0/3459828153 shutdown_connections 2024-08-17T02:24:47.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f223da45700 1 --2- 172.21.15.31:0/3459828153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2238159330 0x7f22380b3c30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f223da45700 1 -- 172.21.15.31:0/3459828153 >> 172.21.15.31:0/3459828153 conn(0x7f2238099610 msgr2=0x7f2238067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:47.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f223da45700 1 -- 172.21.15.31:0/3459828153 shutdown_connections 2024-08-17T02:24:47.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f223da45700 1 -- 172.21.15.31:0/3459828153 wait complete. 2024-08-17T02:24:47.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.818+0000 7f223da45700 1 Processor -- start 2024-08-17T02:24:47.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f223da45700 1 -- start start 2024-08-17T02:24:47.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f223da45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22380b0c40 0x7f223809dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f223da45700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2238159330 0x7f22380abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f223da45700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2238159700 0x7f2238149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f223da45700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380ac150 con 0x7f2238159330 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f223da45700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380acc00 con 0x7f22380b0c40 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f223da45700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22380ad200 con 0x7f2238159700 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f22367fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2238159330 0x7f22380abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f22367fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2238159330 0x7f22380abc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56492/0 (socket says 172.21.15.31:56492) 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f22367fc700 1 -- 172.21.15.31:0/1521572068 learned_addr learned my addr 172.21.15.31:0/1521572068 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f2236ffd700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22380b0c40 0x7f223809dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f22377fe700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2238159700 0x7f2238149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f22367fc700 1 -- 172.21.15.31:0/1521572068 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2238159700 msgr2=0x7f2238149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f22367fc700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2238159700 0x7f2238149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f22367fc700 1 -- 172.21.15.31:0/1521572068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22380b0c40 msgr2=0x7f223809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:47.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f22367fc700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22380b0c40 0x7f223809dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f22367fc700 1 -- 172.21.15.31:0/1521572068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230009a20 con 0x7f2238159330 2024-08-17T02:24:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f22367fc700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2238159330 0x7f22380abc10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f222000c5c0 tx=0x7f2220007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f222effd700 1 -- 172.21.15.31:0/1521572068 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220010510 con 0x7f2238159330 2024-08-17T02:24:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f222effd700 1 -- 172.21.15.31:0/1521572068 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2220010670 con 0x7f2238159330 2024-08-17T02:24:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f222effd700 1 -- 172.21.15.31:0/1521572068 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220010a10 con 0x7f2238159330 2024-08-17T02:24:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f223da45700 1 -- 172.21.15.31:0/1521572068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22380ac360 con 0x7f2238159330 2024-08-17T02:24:47.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.822+0000 7f223da45700 1 -- 172.21.15.31:0/1521572068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22380ac920 con 0x7f2238159330 2024-08-17T02:24:47.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.826+0000 7f223da45700 1 -- 172.21.15.31:0/1521572068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22380712b0 con 0x7f2238159330 2024-08-17T02:24:47.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.826+0000 7f222effd700 1 -- 172.21.15.31:0/1521572068 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f222001b400 con 0x7f2238159330 2024-08-17T02:24:47.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.826+0000 7f222effd700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2218060860 0x7f2218062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:47.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.826+0000 7f2236ffd700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2218060860 0x7f2218062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:47.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.826+0000 7f222effd700 1 -- 172.21.15.31:0/1521572068 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f222007c7c0 con 0x7f2238159330 2024-08-17T02:24:47.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.826+0000 7f2236ffd700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2218060860 0x7f2218062d10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f22300099f0 tx=0x7f2230019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:47.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:47.834+0000 7f222effd700 1 -- 172.21.15.31:0/1521572068 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f222004cb70 con 0x7f2238159330 2024-08-17T02:24:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.038+0000 7f223da45700 1 -- 172.21.15.31:0/1521572068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f22380ad340 con 0x7f2238159330 2024-08-17T02:24:48.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.698+0000 7f222effd700 1 -- 172.21.15.31:0/1521572068 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2220050190 con 0x7f2238159330 2024-08-17T02:24:48.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 -- 172.21.15.31:0/1521572068 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2218060860 msgr2=0x7f2218062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:48.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2218060860 0x7f2218062d10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f22300099f0 tx=0x7f2230019000 comp rx=0 tx=0).stop 2024-08-17T02:24:48.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 -- 172.21.15.31:0/1521572068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2238159330 msgr2=0x7f22380abc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:48.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2238159330 0x7f22380abc10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f222000c5c0 tx=0x7f2220007dc0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 -- 172.21.15.31:0/1521572068 shutdown_connections 2024-08-17T02:24:48.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2218060860 0x7f2218062d10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2238159700 0x7f2238149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2238159330 0x7f22380abc10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 --2- 172.21.15.31:0/1521572068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22380b0c40 0x7f223809dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 -- 172.21.15.31:0/1521572068 >> 172.21.15.31:0/1521572068 conn(0x7f2238099610 msgr2=0x7f2238069970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:48.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 -- 172.21.15.31:0/1521572068 shutdown_connections 2024-08-17T02:24:48.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.702+0000 7f223da45700 1 -- 172.21.15.31:0/1521572068 wait complete. 2024-08-17T02:24:48.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:24:48.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.830+0000 7fe3fa2fc700 1 Processor -- start 2024-08-17T02:24:48.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.830+0000 7fe3fa2fc700 1 -- start start 2024-08-17T02:24:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f4069580 0x7fe3f415d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe3f415d8b0 0x7fe3f41422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f4141e40 con 0x7fe3f40691b0 2024-08-17T02:24:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f415dd30 con 0x7fe3f415d8b0 2024-08-17T02:24:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4141230 con 0x7fe3f4069580 2024-08-17T02:24:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3f92fa700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe3f40691b0 0x7fe3f4161e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45746/0 (socket says 172.21.15.31:45746) 2024-08-17T02:24:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3f92fa700 1 -- 172.21.15.31:0/4149463189 learned_addr learned my addr 172.21.15.31:0/4149463189 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:48.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3f9afb700 1 --2- 172.21.15.31:0/4149463189 >> v2:172.21.15.92:3300/0 conn(0x7fe3f415d8b0 0x7fe3f41422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3f8af9700 1 --2- 172.21.15.31:0/4149463189 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f4069580 0x7fe3f415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3e7fff700 1 -- 172.21.15.31:0/4149463189 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539575403 0 0) 0x7fe3f4141e40 con 0x7fe3f40691b0 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3e7fff700 1 -- 172.21.15.31:0/4149463189 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e0003570 con 0x7fe3f40691b0 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3f8af9700 1 -- 172.21.15.31:0/4149463189 >> v2:172.21.15.92:3300/0 conn(0x7fe3f415d8b0 msgr2=0x7fe3f41422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3f8af9700 1 --2- 172.21.15.31:0/4149463189 >> v2:172.21.15.92:3300/0 conn(0x7fe3f415d8b0 0x7fe3f41422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3f8af9700 1 -- 172.21.15.31:0/4149463189 >> v1:172.21.15.31:6789/0 conn(0x7fe3f40691b0 legacy=0x7fe3f4161e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3f8af9700 1 -- 172.21.15.31:0/4149463189 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f4141510 con 0x7fe3f4069580 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3f9afb700 1 --2- 172.21.15.31:0/4149463189 >> v2:172.21.15.92:3300/0 conn(0x7fe3f415d8b0 0x7fe3f41422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3f8af9700 1 --2- 172.21.15.31:0/4149463189 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f4069580 0x7fe3f415d370 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00098e0 tx=0x7fe3f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea629eac37c748e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3e7fff700 1 -- 172.21.15.31:0/4149463189 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0011630 con 0x7fe3f4069580 2024-08-17T02:24:48.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3e7fff700 1 -- 172.21.15.31:0/4149463189 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0011790 con 0x7fe3f4069580 2024-08-17T02:24:48.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3e7fff700 1 -- 172.21.15.31:0/4149463189 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0011b10 con 0x7fe3f4069580 2024-08-17T02:24:48.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/4149463189 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f4069580 msgr2=0x7fe3f415d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:48.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 --2- 172.21.15.31:0/4149463189 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f4069580 0x7fe3f415d370 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00098e0 tx=0x7fe3f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/4149463189 shutdown_connections 2024-08-17T02:24:48.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 --2- 172.21.15.31:0/4149463189 >> v2:172.21.15.92:3300/0 conn(0x7fe3f415d8b0 0x7fe3f41422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 --2- 172.21.15.31:0/4149463189 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f4069580 0x7fe3f415d370 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/4149463189 >> 172.21.15.31:0/4149463189 conn(0x7fe3f4067400 msgr2=0x7fe3f4067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:48.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/4149463189 shutdown_connections 2024-08-17T02:24:48.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.834+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/4149463189 wait complete. 2024-08-17T02:24:48.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.838+0000 7fe3fa2fc700 1 Processor -- start 2024-08-17T02:24:48.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.838+0000 7fe3fa2fc700 1 -- start start 2024-08-17T02:24:48.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.838+0000 7fe3fa2fc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f40691b0 0x7fe3f40ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:48.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.838+0000 7fe3fa2fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f4069580 0x7fe3f4146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:48.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3fa2fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3f415d8b0 0x7fe3f415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:48.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3fa2fc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4159ce0 con 0x7fe3f4069580 2024-08-17T02:24:48.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3fa2fc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f413d900 con 0x7fe3f415d8b0 2024-08-17T02:24:48.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3fa2fc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40ade60 con 0x7fe3f40691b0 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f8af9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f4069580 0x7fe3f4146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f8af9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f4069580 0x7fe3f4146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56496/0 (socket says 172.21.15.31:56496) 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f8af9700 1 -- 172.21.15.31:0/1179218729 learned_addr learned my addr 172.21.15.31:0/1179218729 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f9afb700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3f415d8b0 0x7fe3f415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f92fa700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f40691b0 0x7fe3f40ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f8af9700 1 -- 172.21.15.31:0/1179218729 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f40691b0 msgr2=0x7fe3f40ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f8af9700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f40691b0 0x7fe3f40ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f8af9700 1 -- 172.21.15.31:0/1179218729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3f415d8b0 msgr2=0x7fe3f415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f8af9700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3f415d8b0 0x7fe3f415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f8af9700 1 -- 172.21.15.31:0/1179218729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec009a20 con 0x7fe3f4069580 2024-08-17T02:24:48.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3f8af9700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f4069580 0x7fe3f4146880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4141370 tx=0x7fe3f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:48.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3e57fa700 1 -- 172.21.15.31:0/1179218729 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0011b10 con 0x7fe3f4069580 2024-08-17T02:24:48.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3e57fa700 1 -- 172.21.15.31:0/1179218729 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0000c90 con 0x7fe3f4069580 2024-08-17T02:24:48.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3e57fa700 1 -- 172.21.15.31:0/1179218729 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f001a660 con 0x7fe3f4069580 2024-08-17T02:24:48.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/1179218729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f0009420 con 0x7fe3f4069580 2024-08-17T02:24:48.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/1179218729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f40ae420 con 0x7fe3f4069580 2024-08-17T02:24:48.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/1179218729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f40712b0 con 0x7fe3f4069580 2024-08-17T02:24:48.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.842+0000 7fe3e57fa700 1 -- 172.21.15.31:0/1179218729 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe3f001aa50 con 0x7fe3f4069580 2024-08-17T02:24:48.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.846+0000 7fe3e57fa700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe3d8060860 0x7fe3d8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:48.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.846+0000 7fe3e57fa700 1 -- 172.21.15.31:0/1179218729 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3f007e6f0 con 0x7fe3f4069580 2024-08-17T02:24:48.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.846+0000 7fe3f92fa700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe3d8060860 0x7fe3d8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:48.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.846+0000 7fe3f92fa700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe3d8060860 0x7fe3d8062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8007fd0 tx=0x7fe3e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:48.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:48.850+0000 7fe3e57fa700 1 -- 172.21.15.31:0/1179218729 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe3f004ec00 con 0x7fe3f4069580 2024-08-17T02:24:49.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.050+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/1179218729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3f406a0b0 con 0x7fe3f4069580 2024-08-17T02:24:49.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.050+0000 7fe3e57fa700 1 -- 172.21.15.31:0/1179218729 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fe3f0052220 con 0x7fe3f4069580 2024-08-17T02:24:49.056 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:49.056 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2641277078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2641277078},{"type":"v1","addr":"172.21.15.92:6835","nonce":2641277078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2478493982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2478493982},{"type":"v1","addr":"172.21.15.92:6833","nonce":2478493982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/3915393252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3915393252},{"type":"v1","addr":"172.21.15.31:6836","nonce":3915393252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:46.040941+0000","modified":"2024-08-17T02:24:48.689838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6837/2360104768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":2360104768},{"type":"v1","addr":"172.21.15.31:6837","nonce":2360104768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:24:49.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.050+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/1179218729 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe3d8060860 msgr2=0x7fe3d8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.050+0000 7fe3fa2fc700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe3d8060860 0x7fe3d8062d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8007fd0 tx=0x7fe3e8009040 comp rx=0 tx=0).stop 2024-08-17T02:24:49.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.050+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/1179218729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f4069580 msgr2=0x7fe3f4146880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.050+0000 7fe3fa2fc700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f4069580 0x7fe3f4146880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4141370 tx=0x7fe3f0017000 comp rx=0 tx=0).stop 2024-08-17T02:24:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.054+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/1179218729 shutdown_connections 2024-08-17T02:24:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.054+0000 7fe3fa2fc700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe3d8060860 0x7fe3d8062d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.054+0000 7fe3fa2fc700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3f415d8b0 0x7fe3f415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.054+0000 7fe3fa2fc700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3f4069580 0x7fe3f4146880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.054+0000 7fe3fa2fc700 1 --2- 172.21.15.31:0/1179218729 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3f40691b0 0x7fe3f40ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.054+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/1179218729 >> 172.21.15.31:0/1179218729 conn(0x7fe3f4067400 msgr2=0x7fe3f4142120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.054+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/1179218729 shutdown_connections 2024-08-17T02:24:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.054+0000 7fe3fa2fc700 1 -- 172.21.15.31:0/1179218729 wait complete. 2024-08-17T02:24:49.060 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-08-17T02:24:49.070 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:49.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.170+0000 7f6e35143700 1 Processor -- start 2024-08-17T02:24:49.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.170+0000 7f6e35143700 1 -- start start 2024-08-17T02:24:49.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6e3015ce20 0x7f6e3015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6e300ad6f0 0x7f6e300adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3015b2b0 con 0x7f6e30159830 2024-08-17T02:24:49.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e300ae410 con 0x7f6e300ad6f0 2024-08-17T02:24:49.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3015aca0 con 0x7f6e3015ce20 2024-08-17T02:24:49.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6e300ad6f0 0x7f6e300adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e34942700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6e30159830 0x7f6e30159c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45748/0 (socket says 172.21.15.31:45748) 2024-08-17T02:24:49.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6e300ad6f0 0x7f6e300adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56504/0 (socket says 172.21.15.31:56504) 2024-08-17T02:24:49.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e34942700 1 -- 172.21.15.31:0/250406662 learned_addr learned my addr 172.21.15.31:0/250406662 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:49.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2ffff700 1 --2- 172.21.15.31:0/250406662 >> v2:172.21.15.92:3300/0 conn(0x7f6e3015ce20 0x7f6e3015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2f7fe700 1 -- 172.21.15.31:0/250406662 >> v2:172.21.15.92:3300/0 conn(0x7f6e3015ce20 msgr2=0x7f6e3015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:49.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2f7fe700 1 --2- 172.21.15.31:0/250406662 >> v2:172.21.15.92:3300/0 conn(0x7f6e3015ce20 0x7f6e3015d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2f7fe700 1 -- 172.21.15.31:0/250406662 >> v1:172.21.15.31:6789/0 conn(0x7f6e30159830 legacy=0x7f6e30159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2f7fe700 1 -- 172.21.15.31:0/250406662 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3015d730 con 0x7f6e300ad6f0 2024-08-17T02:24:49.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2ffff700 1 --2- 172.21.15.31:0/250406662 >> v2:172.21.15.92:3300/0 conn(0x7f6e3015ce20 0x7f6e3015d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:49.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2f7fe700 1 --2- 172.21.15.31:0/250406662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e300ad6f0 0x7f6e300adb10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e300686d0 tx=0x7f6e200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd2e5f5a0a57575 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2effd700 1 -- 172.21.15.31:0/250406662 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2000b6b0 con 0x7f6e300ad6f0 2024-08-17T02:24:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2effd700 1 -- 172.21.15.31:0/250406662 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2000b810 con 0x7f6e300ad6f0 2024-08-17T02:24:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e2effd700 1 -- 172.21.15.31:0/250406662 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2000bbb0 con 0x7f6e300ad6f0 2024-08-17T02:24:49.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 -- 172.21.15.31:0/250406662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e300ad6f0 msgr2=0x7f6e300adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 --2- 172.21.15.31:0/250406662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e300ad6f0 0x7f6e300adb10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e300686d0 tx=0x7f6e200091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 -- 172.21.15.31:0/250406662 shutdown_connections 2024-08-17T02:24:49.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 --2- 172.21.15.31:0/250406662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e300ad6f0 0x7f6e300adb10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 --2- 172.21.15.31:0/250406662 >> v2:172.21.15.92:3300/0 conn(0x7f6e3015ce20 0x7f6e3015d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 -- 172.21.15.31:0/250406662 >> 172.21.15.31:0/250406662 conn(0x7f6e30089cb0 msgr2=0x7f6e300995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:49.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 -- 172.21.15.31:0/250406662 shutdown_connections 2024-08-17T02:24:49.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.174+0000 7f6e35143700 1 -- 172.21.15.31:0/250406662 wait complete. 2024-08-17T02:24:49.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e35143700 1 Processor -- start 2024-08-17T02:24:49.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e35143700 1 -- start start 2024-08-17T02:24:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e35143700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6e300ad6f0 0x7f6e300b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e35143700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30159830 0x7f6e300d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e35143700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e3015ce20 0x7f6e300d0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e35143700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3016ada0 con 0x7f6e30159830 2024-08-17T02:24:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e35143700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3016d570 con 0x7f6e3015ce20 2024-08-17T02:24:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e35143700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3016d850 con 0x7f6e300ad6f0 2024-08-17T02:24:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e2f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30159830 0x7f6e300d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e2f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30159830 0x7f6e300d03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56518/0 (socket says 172.21.15.31:56518) 2024-08-17T02:24:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e2f7fe700 1 -- 172.21.15.31:0/3693338774 learned_addr learned my addr 172.21.15.31:0/3693338774 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e2ffff700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6e300ad6f0 0x7f6e300b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e34942700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e3015ce20 0x7f6e300d0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e2f7fe700 1 -- 172.21.15.31:0/3693338774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6e300ad6f0 msgr2=0x7f6e300b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e2f7fe700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6e300ad6f0 0x7f6e300b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e2f7fe700 1 -- 172.21.15.31:0/3693338774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e3015ce20 msgr2=0x7f6e300d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e2f7fe700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e3015ce20 0x7f6e300d0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.178+0000 7f6e2f7fe700 1 -- 172.21.15.31:0/3693338774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20009420 con 0x7f6e30159830 2024-08-17T02:24:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.182+0000 7f6e2f7fe700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30159830 0x7f6e300d03f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6e3006acd0 tx=0x7f6e20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.182+0000 7f6e17fff700 1 -- 172.21.15.31:0/3693338774 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20000d10 con 0x7f6e30159830 2024-08-17T02:24:49.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.182+0000 7f6e17fff700 1 -- 172.21.15.31:0/3693338774 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2000bb90 con 0x7f6e30159830 2024-08-17T02:24:49.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.182+0000 7f6e17fff700 1 -- 172.21.15.31:0/3693338774 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20011650 con 0x7f6e30159830 2024-08-17T02:24:49.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.182+0000 7f6e35143700 1 -- 172.21.15.31:0/3693338774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3016db30 con 0x7f6e30159830 2024-08-17T02:24:49.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.182+0000 7f6e35143700 1 -- 172.21.15.31:0/3693338774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e300b16b0 con 0x7f6e30159830 2024-08-17T02:24:49.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.182+0000 7f6e35143700 1 -- 172.21.15.31:0/3693338774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e300712b0 con 0x7f6e30159830 2024-08-17T02:24:49.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.182+0000 7f6e17fff700 1 -- 172.21.15.31:0/3693338774 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6e20011a40 con 0x7f6e30159830 2024-08-17T02:24:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.182+0000 7f6e17fff700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6e1c060860 0x7f6e1c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.186+0000 7f6e2ffff700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6e1c060860 0x7f6e1c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.186+0000 7f6e17fff700 1 -- 172.21.15.31:0/3693338774 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e2007e3e0 con 0x7f6e30159830 2024-08-17T02:24:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.186+0000 7f6e2ffff700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6e1c060860 0x7f6e1c062d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e24006f00 tx=0x7f6e24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.194+0000 7f6e17fff700 1 -- 172.21.15.31:0/3693338774 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6e2004e790 con 0x7f6e30159830 2024-08-17T02:24:49.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.362+0000 7f6e35143700 1 -- 172.21.15.31:0/3693338774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e30068280 con 0x7f6e30159830 2024-08-17T02:24:49.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e17fff700 1 -- 172.21.15.31:0/3693338774 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f6e20051db0 con 0x7f6e30159830 2024-08-17T02:24:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:49.372 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 -- 172.21.15.31:0/3693338774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6e1c060860 msgr2=0x7f6e1c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6e1c060860 0x7f6e1c062d10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e24006f00 tx=0x7f6e24008040 comp rx=0 tx=0).stop 2024-08-17T02:24:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 -- 172.21.15.31:0/3693338774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30159830 msgr2=0x7f6e300d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30159830 0x7f6e300d03f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6e3006acd0 tx=0x7f6e20017000 comp rx=0 tx=0).stop 2024-08-17T02:24:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 -- 172.21.15.31:0/3693338774 shutdown_connections 2024-08-17T02:24:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6e1c060860 0x7f6e1c062d10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e3015ce20 0x7f6e300d0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30159830 0x7f6e300d03f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 --2- 172.21.15.31:0/3693338774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6e300ad6f0 0x7f6e300b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 -- 172.21.15.31:0/3693338774 >> 172.21.15.31:0/3693338774 conn(0x7f6e30089cb0 msgr2=0x7f6e30068a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:49.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 -- 172.21.15.31:0/3693338774 shutdown_connections 2024-08-17T02:24:49.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.366+0000 7f6e35143700 1 -- 172.21.15.31:0/3693338774 wait complete. 2024-08-17T02:24:49.385 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:24:49.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:49.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367e3af700 1 Processor -- start 2024-08-17T02:24:49.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367e3af700 1 -- start start 2024-08-17T02:24:49.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367e3af700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 0x7f36780adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367e3af700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f367815b740 0x7f367815bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367e3af700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367815b2b0 con 0x7f367815ce20 2024-08-17T02:24:49.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367e3af700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36780ae410 con 0x7f367815b740 2024-08-17T02:24:49.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367e3af700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367815aca0 con 0x7f36780ad6f0 2024-08-17T02:24:49.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367d3ad700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f367815ce20 0x7f367815d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45758/0 (socket says 172.21.15.31:45758) 2024-08-17T02:24:49.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367d3ad700 1 -- 172.21.15.31:0/3916230279 learned_addr learned my addr 172.21.15.31:0/3916230279 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:49.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367cbac700 1 --2- 172.21.15.31:0/3916230279 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 0x7f36780adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367dbae700 1 --2- 172.21.15.31:0/3916230279 >> v2:172.21.15.92:3300/0 conn(0x7f367815b740 0x7f367815bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f366bfff700 1 -- 172.21.15.31:0/3916230279 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684359303 0 0) 0x7f367815b2b0 con 0x7f367815ce20 2024-08-17T02:24:49.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f366bfff700 1 -- 172.21.15.31:0/3916230279 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3664003570 con 0x7f367815ce20 2024-08-17T02:24:49.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367cbac700 1 -- 172.21.15.31:0/3916230279 >> v2:172.21.15.92:3300/0 conn(0x7f367815b740 msgr2=0x7f367815bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:49.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367cbac700 1 --2- 172.21.15.31:0/3916230279 >> v2:172.21.15.92:3300/0 conn(0x7f367815b740 0x7f367815bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367cbac700 1 -- 172.21.15.31:0/3916230279 >> v1:172.21.15.31:6789/0 conn(0x7f367815ce20 legacy=0x7f367815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367cbac700 1 -- 172.21.15.31:0/3916230279 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780ae6b0 con 0x7f36780ad6f0 2024-08-17T02:24:49.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f367cbac700 1 --2- 172.21.15.31:0/3916230279 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 0x7f36780adae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3674009e60 tx=0x7f3674009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a703d5d73daef13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f366bfff700 1 -- 172.21.15.31:0/3916230279 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400e070 con 0x7f36780ad6f0 2024-08-17T02:24:49.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f366bfff700 1 -- 172.21.15.31:0/3916230279 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367400bab0 con 0x7f36780ad6f0 2024-08-17T02:24:49.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.490+0000 7f366bfff700 1 -- 172.21.15.31:0/3916230279 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400be30 con 0x7f36780ad6f0 2024-08-17T02:24:49.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.494+0000 7f367e3af700 1 -- 172.21.15.31:0/3916230279 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 msgr2=0x7f36780adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.494+0000 7f367e3af700 1 --2- 172.21.15.31:0/3916230279 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 0x7f36780adae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3674009e60 tx=0x7f3674009780 comp rx=0 tx=0).stop 2024-08-17T02:24:49.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.494+0000 7f367e3af700 1 -- 172.21.15.31:0/3916230279 shutdown_connections 2024-08-17T02:24:49.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.494+0000 7f367e3af700 1 --2- 172.21.15.31:0/3916230279 >> v2:172.21.15.92:3300/0 conn(0x7f367815b740 0x7f367815bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.494+0000 7f367e3af700 1 --2- 172.21.15.31:0/3916230279 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 0x7f36780adae0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.494+0000 7f367e3af700 1 -- 172.21.15.31:0/3916230279 >> 172.21.15.31:0/3916230279 conn(0x7f3678089cb0 msgr2=0x7f36780995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:49.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.494+0000 7f367e3af700 1 -- 172.21.15.31:0/3916230279 shutdown_connections 2024-08-17T02:24:49.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.494+0000 7f367e3af700 1 -- 172.21.15.31:0/3916230279 wait complete. 2024-08-17T02:24:49.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.494+0000 7f367e3af700 1 Processor -- start 2024-08-17T02:24:49.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.494+0000 7f367e3af700 1 -- start start 2024-08-17T02:24:49.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367e3af700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 0x7f367816a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367e3af700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f367815b740 0x7f3678152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367e3af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f367815ce20 0x7f36780d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367e3af700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367816a990 con 0x7f367815ce20 2024-08-17T02:24:49.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367e3af700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36780af180 con 0x7f367815b740 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367e3af700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36780af460 con 0x7f36780ad6f0 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367dbae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f367815ce20 0x7f36780d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367dbae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f367815ce20 0x7f36780d01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56528/0 (socket says 172.21.15.31:56528) 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367dbae700 1 -- 172.21.15.31:0/2766910082 learned_addr learned my addr 172.21.15.31:0/2766910082 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367cbac700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f367815b740 0x7f3678152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367d3ad700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 0x7f367816a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367dbae700 1 -- 172.21.15.31:0/2766910082 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 msgr2=0x7f367816a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367dbae700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 0x7f367816a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367dbae700 1 -- 172.21.15.31:0/2766910082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f367815b740 msgr2=0x7f3678152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367dbae700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f367815b740 0x7f3678152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367dbae700 1 -- 172.21.15.31:0/2766910082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674009a20 con 0x7f367815ce20 2024-08-17T02:24:49.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367cbac700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f367815b740 0x7f3678152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:49.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367dbae700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f367815ce20 0x7f36780d01c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f367000e8d0 tx=0x7f36700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f36697fa700 1 -- 172.21.15.31:0/2766910082 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670013680 con 0x7f367815ce20 2024-08-17T02:24:49.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f36697fa700 1 -- 172.21.15.31:0/2766910082 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36700137e0 con 0x7f367815ce20 2024-08-17T02:24:49.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f36697fa700 1 -- 172.21.15.31:0/2766910082 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670013ba0 con 0x7f367815ce20 2024-08-17T02:24:49.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367e3af700 1 -- 172.21.15.31:0/2766910082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36780af740 con 0x7f367815ce20 2024-08-17T02:24:49.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.498+0000 7f367e3af700 1 -- 172.21.15.31:0/2766910082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36780afd90 con 0x7f367815ce20 2024-08-17T02:24:49.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.502+0000 7f36697fa700 1 -- 172.21.15.31:0/2766910082 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f36700123d0 con 0x7f367815ce20 2024-08-17T02:24:49.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.502+0000 7f367e3af700 1 -- 172.21.15.31:0/2766910082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36780712b0 con 0x7f367815ce20 2024-08-17T02:24:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.502+0000 7f36697fa700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f365c060890 0x7f365c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.502+0000 7f36697fa700 1 -- 172.21.15.31:0/2766910082 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f367007cca0 con 0x7f367815ce20 2024-08-17T02:24:49.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.502+0000 7f367d3ad700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f365c060890 0x7f365c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.502+0000 7f367d3ad700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f365c060890 0x7f365c062d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f366c007fd0 tx=0x7f366c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.506+0000 7f36697fa700 1 -- 172.21.15.31:0/2766910082 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f367004d0f0 con 0x7f367815ce20 2024-08-17T02:24:49.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.670+0000 7f367e3af700 1 -- 172.21.15.31:0/2766910082 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3678158e10 con 0x7f365c060890 2024-08-17T02:24:49.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.686+0000 7f36697fa700 1 -- 172.21.15.31:0/2766910082 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264001 (secure 0 0 0) 0x7f3678158e10 con 0x7f365c060890 2024-08-17T02:24:49.743 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:49.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 -- 172.21.15.31:0/2766910082 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f365c060890 msgr2=0x7f365c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f365c060890 0x7f365c062d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f366c007fd0 tx=0x7f366c009040 comp rx=0 tx=0).stop 2024-08-17T02:24:49.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 -- 172.21.15.31:0/2766910082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f367815ce20 msgr2=0x7f36780d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f367815ce20 0x7f36780d01c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f367000e8d0 tx=0x7f36700091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 -- 172.21.15.31:0/2766910082 shutdown_connections 2024-08-17T02:24:49.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f365c060890 0x7f365c062d40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f367815ce20 0x7f36780d01c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f367815b740 0x7f3678152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 --2- 172.21.15.31:0/2766910082 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36780ad6f0 0x7f367816a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 -- 172.21.15.31:0/2766910082 >> 172.21.15.31:0/2766910082 conn(0x7f3678089cb0 msgr2=0x7f3678069890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:49.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 -- 172.21.15.31:0/2766910082 shutdown_connections 2024-08-17T02:24:49.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.694+0000 7f367e3af700 1 -- 172.21.15.31:0/2766910082 wait complete. 2024-08-17T02:24:49.747 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:24:49.747 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:24:49.582877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592636,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381804,"kb_used_data":2932,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592916,"statfs":{"total":773094113280,"available":770655145984,"internally_reserved":0,"allocated":3002368,"data_stored":1773301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2268,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.927145"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711137+0000","last_change":"2024-08-17T02:24:46.711137+0000","last_active":"2024-08-17T02:24:46.711137+0000","last_peered":"2024-08-17T02:24:46.711137+0000","last_clean":"2024-08-17T02:24:46.711137+0000","last_became_active":"2024-08-17T02:24:46.710820+0000","last_became_peered":"2024-08-17T02:24:46.710820+0000","last_unstale":"2024-08-17T02:24:46.711137+0000","last_undegraded":"2024-08-17T02:24:46.711137+0000","last_fullsized":"2024-08-17T02:24:46.711137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.684833+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683020+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:15.827101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702343+0000","last_change":"2024-08-17T02:24:46.702343+0000","last_active":"2024-08-17T02:24:46.702343+0000","last_peered":"2024-08-17T02:24:46.702343+0000","last_clean":"2024-08-17T02:24:46.702343+0000","last_became_active":"2024-08-17T02:24:46.700536+0000","last_became_peered":"2024-08-17T02:24:46.700536+0000","last_unstale":"2024-08-17T02:24:46.702343+0000","last_undegraded":"2024-08-17T02:24:46.702343+0000","last_fullsized":"2024-08-17T02:24:46.702343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697977+0000","last_change":"2024-08-17T02:24:46.697977+0000","last_active":"2024-08-17T02:24:46.697977+0000","last_peered":"2024-08-17T02:24:46.697977+0000","last_clean":"2024-08-17T02:24:46.697977+0000","last_became_active":"2024-08-17T02:24:46.697680+0000","last_became_peered":"2024-08-17T02:24:46.697680+0000","last_unstale":"2024-08-17T02:24:46.697977+0000","last_undegraded":"2024-08-17T02:24:46.697977+0000","last_fullsized":"2024-08-17T02:24:46.697977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696070+0000","last_change":"2024-08-17T02:24:46.696070+0000","last_active":"2024-08-17T02:24:46.696070+0000","last_peered":"2024-08-17T02:24:46.696070+0000","last_clean":"2024-08-17T02:24:46.696070+0000","last_became_active":"2024-08-17T02:24:46.693809+0000","last_became_peered":"2024-08-17T02:24:46.693809+0000","last_unstale":"2024-08-17T02:24:46.696070+0000","last_undegraded":"2024-08-17T02:24:46.696070+0000","last_fullsized":"2024-08-17T02:24:46.696070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694034+0000","last_change":"2024-08-17T02:24:46.694034+0000","last_active":"2024-08-17T02:24:46.694034+0000","last_peered":"2024-08-17T02:24:46.694034+0000","last_clean":"2024-08-17T02:24:46.694034+0000","last_became_active":"2024-08-17T02:24:46.693720+0000","last_became_peered":"2024-08-17T02:24:46.693720+0000","last_unstale":"2024-08-17T02:24:46.694034+0000","last_undegraded":"2024-08-17T02:24:46.694034+0000","last_fullsized":"2024-08-17T02:24:46.694034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:25.120018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.687014+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:10.973372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710805+0000","last_change":"2024-08-17T02:24:46.710805+0000","last_active":"2024-08-17T02:24:46.710805+0000","last_peered":"2024-08-17T02:24:46.710805+0000","last_clean":"2024-08-17T02:24:46.710805+0000","last_became_active":"2024-08-17T02:24:46.710510+0000","last_became_peered":"2024-08-17T02:24:46.710510+0000","last_unstale":"2024-08-17T02:24:46.710805+0000","last_undegraded":"2024-08-17T02:24:46.710805+0000","last_fullsized":"2024-08-17T02:24:46.710805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695508+0000","last_change":"2024-08-17T02:24:46.695508+0000","last_active":"2024-08-17T02:24:46.695508+0000","last_peered":"2024-08-17T02:24:46.695508+0000","last_clean":"2024-08-17T02:24:46.695508+0000","last_became_active":"2024-08-17T02:24:46.695174+0000","last_became_peered":"2024-08-17T02:24:46.695174+0000","last_unstale":"2024-08-17T02:24:46.695508+0000","last_undegraded":"2024-08-17T02:24:46.695508+0000","last_fullsized":"2024-08-17T02:24:46.695508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:26.358220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711058+0000","last_change":"2024-08-17T02:24:46.711058+0000","last_active":"2024-08-17T02:24:46.711058+0000","last_peered":"2024-08-17T02:24:46.711058+0000","last_clean":"2024-08-17T02:24:46.711058+0000","last_became_active":"2024-08-17T02:24:46.710739+0000","last_became_peered":"2024-08-17T02:24:46.710739+0000","last_unstale":"2024-08-17T02:24:46.711058+0000","last_undegraded":"2024-08-17T02:24:46.711058+0000","last_fullsized":"2024-08-17T02:24:46.711058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695791+0000","last_change":"2024-08-17T02:24:46.695791+0000","last_active":"2024-08-17T02:24:46.695791+0000","last_peered":"2024-08-17T02:24:46.695791+0000","last_clean":"2024-08-17T02:24:46.695791+0000","last_became_active":"2024-08-17T02:24:46.695116+0000","last_became_peered":"2024-08-17T02:24:46.695116+0000","last_unstale":"2024-08-17T02:24:46.695791+0000","last_undegraded":"2024-08-17T02:24:46.695791+0000","last_fullsized":"2024-08-17T02:24:46.695791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699896+0000","last_change":"2024-08-17T02:24:46.699896+0000","last_active":"2024-08-17T02:24:46.699896+0000","last_peered":"2024-08-17T02:24:46.699896+0000","last_clean":"2024-08-17T02:24:46.699896+0000","last_became_active":"2024-08-17T02:24:46.699645+0000","last_became_peered":"2024-08-17T02:24:46.699645+0000","last_unstale":"2024-08-17T02:24:46.699896+0000","last_undegraded":"2024-08-17T02:24:46.699896+0000","last_fullsized":"2024-08-17T02:24:46.699896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:36.261958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690505+0000","last_change":"2024-08-17T02:24:46.690505+0000","last_active":"2024-08-17T02:24:46.690505+0000","last_peered":"2024-08-17T02:24:46.690505+0000","last_clean":"2024-08-17T02:24:46.690505+0000","last_became_active":"2024-08-17T02:24:46.690185+0000","last_became_peered":"2024-08-17T02:24:46.690185+0000","last_unstale":"2024-08-17T02:24:46.690505+0000","last_undegraded":"2024-08-17T02:24:46.690505+0000","last_fullsized":"2024-08-17T02:24:46.690505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.684166+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:15.861283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690550+0000","last_change":"2024-08-17T02:24:46.690550+0000","last_active":"2024-08-17T02:24:46.690550+0000","last_peered":"2024-08-17T02:24:46.690550+0000","last_clean":"2024-08-17T02:24:46.690550+0000","last_became_active":"2024-08-17T02:24:46.690231+0000","last_became_peered":"2024-08-17T02:24:46.690231+0000","last_unstale":"2024-08-17T02:24:46.690550+0000","last_undegraded":"2024-08-17T02:24:46.690550+0000","last_fullsized":"2024-08-17T02:24:46.690550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:40:04.175081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703443+0000","last_change":"2024-08-17T02:24:46.703443+0000","last_active":"2024-08-17T02:24:46.703443+0000","last_peered":"2024-08-17T02:24:46.703443+0000","last_clean":"2024-08-17T02:24:46.703443+0000","last_became_active":"2024-08-17T02:24:46.703111+0000","last_became_peered":"2024-08-17T02:24:46.703111+0000","last_unstale":"2024-08-17T02:24:46.703443+0000","last_undegraded":"2024-08-17T02:24:46.703443+0000","last_fullsized":"2024-08-17T02:24:46.703443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695275+0000","last_change":"2024-08-17T02:24:46.695275+0000","last_active":"2024-08-17T02:24:46.695275+0000","last_peered":"2024-08-17T02:24:46.695275+0000","last_clean":"2024-08-17T02:24:46.695275+0000","last_became_active":"2024-08-17T02:24:46.694600+0000","last_became_peered":"2024-08-17T02:24:46.694600+0000","last_unstale":"2024-08-17T02:24:46.695275+0000","last_undegraded":"2024-08-17T02:24:46.695275+0000","last_fullsized":"2024-08-17T02:24:46.695275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703289+0000","last_change":"2024-08-17T02:24:46.703289+0000","last_active":"2024-08-17T02:24:46.703289+0000","last_peered":"2024-08-17T02:24:46.703289+0000","last_clean":"2024-08-17T02:24:46.703289+0000","last_became_active":"2024-08-17T02:24:46.702961+0000","last_became_peered":"2024-08-17T02:24:46.702961+0000","last_unstale":"2024-08-17T02:24:46.703289+0000","last_undegraded":"2024-08-17T02:24:46.703289+0000","last_fullsized":"2024-08-17T02:24:46.703289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:26.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696080+0000","last_change":"2024-08-17T02:24:46.696080+0000","last_active":"2024-08-17T02:24:46.696080+0000","last_peered":"2024-08-17T02:24:46.696080+0000","last_clean":"2024-08-17T02:24:46.696080+0000","last_became_active":"2024-08-17T02:24:46.695753+0000","last_became_peered":"2024-08-17T02:24:46.695753+0000","last_unstale":"2024-08-17T02:24:46.696080+0000","last_undegraded":"2024-08-17T02:24:46.696080+0000","last_fullsized":"2024-08-17T02:24:46.696080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.692695+0000","last_change":"2024-08-17T02:24:46.692695+0000","last_active":"2024-08-17T02:24:46.692695+0000","last_peered":"2024-08-17T02:24:46.692695+0000","last_clean":"2024-08-17T02:24:46.692695+0000","last_became_active":"2024-08-17T02:24:46.691145+0000","last_became_peered":"2024-08-17T02:24:46.691145+0000","last_unstale":"2024-08-17T02:24:46.692695+0000","last_undegraded":"2024-08-17T02:24:46.692695+0000","last_fullsized":"2024-08-17T02:24:46.692695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:25.233681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696761+0000","last_change":"2024-08-17T02:24:46.696761+0000","last_active":"2024-08-17T02:24:46.696761+0000","last_peered":"2024-08-17T02:24:46.696761+0000","last_clean":"2024-08-17T02:24:46.696761+0000","last_became_active":"2024-08-17T02:24:46.695844+0000","last_became_peered":"2024-08-17T02:24:46.695844+0000","last_unstale":"2024-08-17T02:24:46.696761+0000","last_undegraded":"2024-08-17T02:24:46.696761+0000","last_fullsized":"2024-08-17T02:24:46.696761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683038+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:02.907069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.683686+0000","last_change":"2024-08-17T02:24:46.683686+0000","last_active":"2024-08-17T02:24:46.683686+0000","last_peered":"2024-08-17T02:24:46.683686+0000","last_clean":"2024-08-17T02:24:46.683686+0000","last_became_active":"2024-08-17T02:24:46.683416+0000","last_became_peered":"2024-08-17T02:24:46.683416+0000","last_unstale":"2024-08-17T02:24:46.683686+0000","last_undegraded":"2024-08-17T02:24:46.683686+0000","last_fullsized":"2024-08-17T02:24:46.683686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:38.075390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.686371+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:38.994029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707560+0000","last_change":"2024-08-17T02:24:46.707560+0000","last_active":"2024-08-17T02:24:46.707560+0000","last_peered":"2024-08-17T02:24:46.707560+0000","last_clean":"2024-08-17T02:24:46.707560+0000","last_became_active":"2024-08-17T02:24:46.707234+0000","last_became_peered":"2024-08-17T02:24:46.707234+0000","last_unstale":"2024-08-17T02:24:46.707560+0000","last_undegraded":"2024-08-17T02:24:46.707560+0000","last_fullsized":"2024-08-17T02:24:46.707560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:32.930431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691514+0000","last_change":"2024-08-17T02:24:46.691514+0000","last_active":"2024-08-17T02:24:46.691514+0000","last_peered":"2024-08-17T02:24:46.691514+0000","last_clean":"2024-08-17T02:24:46.691514+0000","last_became_active":"2024-08-17T02:24:46.691231+0000","last_became_peered":"2024-08-17T02:24:46.691231+0000","last_unstale":"2024-08-17T02:24:46.691514+0000","last_undegraded":"2024-08-17T02:24:46.691514+0000","last_fullsized":"2024-08-17T02:24:46.691514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698271+0000","last_change":"2024-08-17T02:24:46.698271+0000","last_active":"2024-08-17T02:24:46.698271+0000","last_peered":"2024-08-17T02:24:46.698271+0000","last_clean":"2024-08-17T02:24:46.698271+0000","last_became_active":"2024-08-17T02:24:46.698020+0000","last_became_peered":"2024-08-17T02:24:46.698020+0000","last_unstale":"2024-08-17T02:24:46.698271+0000","last_undegraded":"2024-08-17T02:24:46.698271+0000","last_fullsized":"2024-08-17T02:24:46.698271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:51.758557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.681671+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:33.547382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.684857+0000","last_change":"2024-08-17T02:24:46.684857+0000","last_active":"2024-08-17T02:24:46.684857+0000","last_peered":"2024-08-17T02:24:46.684857+0000","last_clean":"2024-08-17T02:24:46.684857+0000","last_became_active":"2024-08-17T02:24:46.683949+0000","last_became_peered":"2024-08-17T02:24:46.683949+0000","last_unstale":"2024-08-17T02:24:46.684857+0000","last_undegraded":"2024-08-17T02:24:46.684857+0000","last_fullsized":"2024-08-17T02:24:46.684857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:06.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698926+0000","last_change":"2024-08-17T02:24:46.698926+0000","last_active":"2024-08-17T02:24:46.698926+0000","last_peered":"2024-08-17T02:24:46.698926+0000","last_clean":"2024-08-17T02:24:46.698926+0000","last_became_active":"2024-08-17T02:24:46.698650+0000","last_became_peered":"2024-08-17T02:24:46.698650+0000","last_unstale":"2024-08-17T02:24:46.698926+0000","last_undegraded":"2024-08-17T02:24:46.698926+0000","last_fullsized":"2024-08-17T02:24:46.698926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697443+0000","last_change":"2024-08-17T02:24:46.697443+0000","last_active":"2024-08-17T02:24:46.697443+0000","last_peered":"2024-08-17T02:24:46.697443+0000","last_clean":"2024-08-17T02:24:46.697443+0000","last_became_active":"2024-08-17T02:24:46.696404+0000","last_became_peered":"2024-08-17T02:24:46.696404+0000","last_unstale":"2024-08-17T02:24:46.697443+0000","last_undegraded":"2024-08-17T02:24:46.697443+0000","last_fullsized":"2024-08-17T02:24:46.697443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701561+0000","last_change":"2024-08-17T02:24:46.701561+0000","last_active":"2024-08-17T02:24:46.701561+0000","last_peered":"2024-08-17T02:24:46.701561+0000","last_clean":"2024-08-17T02:24:46.701561+0000","last_became_active":"2024-08-17T02:24:46.696208+0000","last_became_peered":"2024-08-17T02:24:46.696208+0000","last_unstale":"2024-08-17T02:24:46.701561+0000","last_undegraded":"2024-08-17T02:24:46.701561+0000","last_fullsized":"2024-08-17T02:24:46.701561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693597+0000","last_change":"2024-08-17T02:24:45.693597+0000","last_active":"2024-08-17T02:24:45.693597+0000","last_peered":"2024-08-17T02:24:45.693597+0000","last_clean":"2024-08-17T02:24:45.693597+0000","last_became_active":"2024-08-17T02:24:45.692136+0000","last_became_peered":"2024-08-17T02:24:45.692136+0000","last_unstale":"2024-08-17T02:24:45.693597+0000","last_undegraded":"2024-08-17T02:24:45.693597+0000","last_fullsized":"2024-08-17T02:24:45.693597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:51.770625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700557+0000","last_change":"2024-08-17T02:24:46.700557+0000","last_active":"2024-08-17T02:24:46.700557+0000","last_peered":"2024-08-17T02:24:46.700557+0000","last_clean":"2024-08-17T02:24:46.700557+0000","last_became_active":"2024-08-17T02:24:46.700114+0000","last_became_peered":"2024-08-17T02:24:46.700114+0000","last_unstale":"2024-08-17T02:24:46.700557+0000","last_undegraded":"2024-08-17T02:24:46.700557+0000","last_fullsized":"2024-08-17T02:24:46.700557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673565+0000","last_change":"2024-08-17T02:24:45.685965+0000","last_active":"2024-08-17T02:24:46.673565+0000","last_peered":"2024-08-17T02:24:46.673565+0000","last_clean":"2024-08-17T02:24:46.673565+0000","last_became_active":"2024-08-17T02:24:45.685019+0000","last_became_peered":"2024-08-17T02:24:45.685019+0000","last_unstale":"2024-08-17T02:24:46.673565+0000","last_undegraded":"2024-08-17T02:24:46.673565+0000","last_fullsized":"2024-08-17T02:24:46.673565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:33.322093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.701270+0000","last_change":"2024-08-17T02:24:45.695657+0000","last_active":"2024-08-17T02:24:45.701270+0000","last_peered":"2024-08-17T02:24:45.701270+0000","last_clean":"2024-08-17T02:24:45.701270+0000","last_became_active":"2024-08-17T02:24:45.695337+0000","last_became_peered":"2024-08-17T02:24:45.695337+0000","last_unstale":"2024-08-17T02:24:45.701270+0000","last_undegraded":"2024-08-17T02:24:45.701270+0000","last_fullsized":"2024-08-17T02:24:45.701270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.680939+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:20:35.140243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.686595+0000","last_change":"2024-08-17T02:24:45.683302+0000","last_active":"2024-08-17T02:24:45.686595+0000","last_peered":"2024-08-17T02:24:45.686595+0000","last_clean":"2024-08-17T02:24:45.686595+0000","last_became_active":"2024-08-17T02:24:45.682641+0000","last_became_peered":"2024-08-17T02:24:45.682641+0000","last_unstale":"2024-08-17T02:24:45.686595+0000","last_undegraded":"2024-08-17T02:24:45.686595+0000","last_fullsized":"2024-08-17T02:24:45.686595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:36.581167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693180+0000","last_change":"2024-08-17T02:24:46.693180+0000","last_active":"2024-08-17T02:24:46.693180+0000","last_peered":"2024-08-17T02:24:46.693180+0000","last_clean":"2024-08-17T02:24:46.693180+0000","last_became_active":"2024-08-17T02:24:46.692910+0000","last_became_peered":"2024-08-17T02:24:46.692910+0000","last_unstale":"2024-08-17T02:24:46.693180+0000","last_undegraded":"2024-08-17T02:24:46.693180+0000","last_fullsized":"2024-08-17T02:24:46.693180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:20.305646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692682+0000","last_change":"2024-08-17T02:24:45.689693+0000","last_active":"2024-08-17T02:24:45.692682+0000","last_peered":"2024-08-17T02:24:45.692682+0000","last_clean":"2024-08-17T02:24:45.692682+0000","last_became_active":"2024-08-17T02:24:45.689396+0000","last_became_peered":"2024-08-17T02:24:45.689396+0000","last_unstale":"2024-08-17T02:24:45.692682+0000","last_undegraded":"2024-08-17T02:24:45.692682+0000","last_fullsized":"2024-08-17T02:24:45.692682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:03:27.829684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707529+0000","last_change":"2024-08-17T02:24:46.707529+0000","last_active":"2024-08-17T02:24:46.707529+0000","last_peered":"2024-08-17T02:24:46.707529+0000","last_clean":"2024-08-17T02:24:46.707529+0000","last_became_active":"2024-08-17T02:24:46.706887+0000","last_became_peered":"2024-08-17T02:24:46.706887+0000","last_unstale":"2024-08-17T02:24:46.707529+0000","last_undegraded":"2024-08-17T02:24:46.707529+0000","last_fullsized":"2024-08-17T02:24:46.707529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693785+0000","last_change":"2024-08-17T02:24:45.689053+0000","last_active":"2024-08-17T02:24:45.693785+0000","last_peered":"2024-08-17T02:24:45.693785+0000","last_clean":"2024-08-17T02:24:45.693785+0000","last_became_active":"2024-08-17T02:24:45.688643+0000","last_became_peered":"2024-08-17T02:24:45.688643+0000","last_unstale":"2024-08-17T02:24:45.693785+0000","last_undegraded":"2024-08-17T02:24:45.693785+0000","last_fullsized":"2024-08-17T02:24:45.693785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683528+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:53.636650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701087+0000","last_change":"2024-08-17T02:24:45.686140+0000","last_active":"2024-08-17T02:24:46.701087+0000","last_peered":"2024-08-17T02:24:46.701087+0000","last_clean":"2024-08-17T02:24:46.701087+0000","last_became_active":"2024-08-17T02:24:45.685732+0000","last_became_peered":"2024-08-17T02:24:45.685732+0000","last_unstale":"2024-08-17T02:24:46.701087+0000","last_undegraded":"2024-08-17T02:24:46.701087+0000","last_fullsized":"2024-08-17T02:24:46.701087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703995+0000","last_change":"2024-08-17T02:24:46.703995+0000","last_active":"2024-08-17T02:24:46.703995+0000","last_peered":"2024-08-17T02:24:46.703995+0000","last_clean":"2024-08-17T02:24:46.703995+0000","last_became_active":"2024-08-17T02:24:46.703632+0000","last_became_peered":"2024-08-17T02:24:46.703632+0000","last_unstale":"2024-08-17T02:24:46.703995+0000","last_undegraded":"2024-08-17T02:24:46.703995+0000","last_fullsized":"2024-08-17T02:24:46.703995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702401+0000","last_change":"2024-08-17T02:24:45.691026+0000","last_active":"2024-08-17T02:24:46.702401+0000","last_peered":"2024-08-17T02:24:46.702401+0000","last_clean":"2024-08-17T02:24:46.702401+0000","last_became_active":"2024-08-17T02:24:45.690499+0000","last_became_peered":"2024-08-17T02:24:45.690499+0000","last_unstale":"2024-08-17T02:24:46.702401+0000","last_undegraded":"2024-08-17T02:24:46.702401+0000","last_fullsized":"2024-08-17T02:24:46.702401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:14.230300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694359+0000","last_change":"2024-08-17T02:24:46.694359+0000","last_active":"2024-08-17T02:24:46.694359+0000","last_peered":"2024-08-17T02:24:46.694359+0000","last_clean":"2024-08-17T02:24:46.694359+0000","last_became_active":"2024-08-17T02:24:46.693812+0000","last_became_peered":"2024-08-17T02:24:46.693812+0000","last_unstale":"2024-08-17T02:24:46.694359+0000","last_undegraded":"2024-08-17T02:24:46.694359+0000","last_fullsized":"2024-08-17T02:24:46.694359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:48:49.063780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703380+0000","last_change":"2024-08-17T02:24:45.689928+0000","last_active":"2024-08-17T02:24:46.703380+0000","last_peered":"2024-08-17T02:24:46.703380+0000","last_clean":"2024-08-17T02:24:46.703380+0000","last_became_active":"2024-08-17T02:24:45.689519+0000","last_became_peered":"2024-08-17T02:24:45.689519+0000","last_unstale":"2024-08-17T02:24:46.703380+0000","last_undegraded":"2024-08-17T02:24:46.703380+0000","last_fullsized":"2024-08-17T02:24:46.703380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708134+0000","last_change":"2024-08-17T02:24:46.708134+0000","last_active":"2024-08-17T02:24:46.708134+0000","last_peered":"2024-08-17T02:24:46.708134+0000","last_clean":"2024-08-17T02:24:46.708134+0000","last_became_active":"2024-08-17T02:24:46.707822+0000","last_became_peered":"2024-08-17T02:24:46.707822+0000","last_unstale":"2024-08-17T02:24:46.708134+0000","last_undegraded":"2024-08-17T02:24:46.708134+0000","last_fullsized":"2024-08-17T02:24:46.708134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692541+0000","last_change":"2024-08-17T02:24:45.686232+0000","last_active":"2024-08-17T02:24:45.692541+0000","last_peered":"2024-08-17T02:24:45.692541+0000","last_clean":"2024-08-17T02:24:45.692541+0000","last_became_active":"2024-08-17T02:24:45.685407+0000","last_became_peered":"2024-08-17T02:24:45.685407+0000","last_unstale":"2024-08-17T02:24:45.692541+0000","last_undegraded":"2024-08-17T02:24:45.692541+0000","last_fullsized":"2024-08-17T02:24:45.692541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700959+0000","last_change":"2024-08-17T02:24:46.700959+0000","last_active":"2024-08-17T02:24:46.700959+0000","last_peered":"2024-08-17T02:24:46.700959+0000","last_clean":"2024-08-17T02:24:46.700959+0000","last_became_active":"2024-08-17T02:24:46.698769+0000","last_became_peered":"2024-08-17T02:24:46.698769+0000","last_unstale":"2024-08-17T02:24:46.700959+0000","last_undegraded":"2024-08-17T02:24:46.700959+0000","last_fullsized":"2024-08-17T02:24:46.700959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693729+0000","last_change":"2024-08-17T02:24:45.687633+0000","last_active":"2024-08-17T02:24:45.693729+0000","last_peered":"2024-08-17T02:24:45.693729+0000","last_clean":"2024-08-17T02:24:45.693729+0000","last_became_active":"2024-08-17T02:24:45.687078+0000","last_became_peered":"2024-08-17T02:24:45.687078+0000","last_unstale":"2024-08-17T02:24:45.693729+0000","last_undegraded":"2024-08-17T02:24:45.693729+0000","last_fullsized":"2024-08-17T02:24:45.693729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696374+0000","last_change":"2024-08-17T02:24:46.696374+0000","last_active":"2024-08-17T02:24:46.696374+0000","last_peered":"2024-08-17T02:24:46.696374+0000","last_clean":"2024-08-17T02:24:46.696374+0000","last_became_active":"2024-08-17T02:24:46.695792+0000","last_became_peered":"2024-08-17T02:24:46.695792+0000","last_unstale":"2024-08-17T02:24:46.696374+0000","last_undegraded":"2024-08-17T02:24:46.696374+0000","last_fullsized":"2024-08-17T02:24:46.696374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.709507+0000","last_change":"2024-08-17T02:24:45.686489+0000","last_active":"2024-08-17T02:24:46.709507+0000","last_peered":"2024-08-17T02:24:46.709507+0000","last_clean":"2024-08-17T02:24:46.709507+0000","last_became_active":"2024-08-17T02:24:45.684809+0000","last_became_peered":"2024-08-17T02:24:45.684809+0000","last_unstale":"2024-08-17T02:24:46.709507+0000","last_undegraded":"2024-08-17T02:24:46.709507+0000","last_fullsized":"2024-08-17T02:24:46.709507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699050+0000","last_change":"2024-08-17T02:24:46.699050+0000","last_active":"2024-08-17T02:24:46.699050+0000","last_peered":"2024-08-17T02:24:46.699050+0000","last_clean":"2024-08-17T02:24:46.699050+0000","last_became_active":"2024-08-17T02:24:46.697848+0000","last_became_peered":"2024-08-17T02:24:46.697848+0000","last_unstale":"2024-08-17T02:24:46.699050+0000","last_undegraded":"2024-08-17T02:24:46.699050+0000","last_fullsized":"2024-08-17T02:24:46.699050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.684337+0000","last_change":"2024-08-17T02:24:45.696348+0000","last_active":"2024-08-17T02:24:46.684337+0000","last_peered":"2024-08-17T02:24:46.684337+0000","last_clean":"2024-08-17T02:24:46.684337+0000","last_became_active":"2024-08-17T02:24:45.695978+0000","last_became_peered":"2024-08-17T02:24:45.695978+0000","last_unstale":"2024-08-17T02:24:46.684337+0000","last_undegraded":"2024-08-17T02:24:46.684337+0000","last_fullsized":"2024-08-17T02:24:46.684337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698921+0000","last_change":"2024-08-17T02:24:46.698921+0000","last_active":"2024-08-17T02:24:46.698921+0000","last_peered":"2024-08-17T02:24:46.698921+0000","last_clean":"2024-08-17T02:24:46.698921+0000","last_became_active":"2024-08-17T02:24:46.698688+0000","last_became_peered":"2024-08-17T02:24:46.698688+0000","last_unstale":"2024-08-17T02:24:46.698921+0000","last_undegraded":"2024-08-17T02:24:46.698921+0000","last_fullsized":"2024-08-17T02:24:46.698921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:37.590898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701719+0000","last_change":"2024-08-17T02:24:45.699315+0000","last_active":"2024-08-17T02:24:46.701719+0000","last_peered":"2024-08-17T02:24:46.701719+0000","last_clean":"2024-08-17T02:24:46.701719+0000","last_became_active":"2024-08-17T02:24:45.698964+0000","last_became_peered":"2024-08-17T02:24:45.698964+0000","last_unstale":"2024-08-17T02:24:46.701719+0000","last_undegraded":"2024-08-17T02:24:46.701719+0000","last_fullsized":"2024-08-17T02:24:46.701719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696697+0000","last_change":"2024-08-17T02:24:46.696697+0000","last_active":"2024-08-17T02:24:46.696697+0000","last_peered":"2024-08-17T02:24:46.696697+0000","last_clean":"2024-08-17T02:24:46.696697+0000","last_became_active":"2024-08-17T02:24:46.696387+0000","last_became_peered":"2024-08-17T02:24:46.696387+0000","last_unstale":"2024-08-17T02:24:46.696697+0000","last_undegraded":"2024-08-17T02:24:46.696697+0000","last_fullsized":"2024-08-17T02:24:46.696697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693896+0000","last_change":"2024-08-17T02:24:45.693896+0000","last_active":"2024-08-17T02:24:45.693896+0000","last_peered":"2024-08-17T02:24:45.693896+0000","last_clean":"2024-08-17T02:24:45.693896+0000","last_became_active":"2024-08-17T02:24:45.693694+0000","last_became_peered":"2024-08-17T02:24:45.693694+0000","last_unstale":"2024-08-17T02:24:45.693896+0000","last_undegraded":"2024-08-17T02:24:45.693896+0000","last_fullsized":"2024-08-17T02:24:45.693896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:25.447726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695064+0000","last_change":"2024-08-17T02:24:46.695064+0000","last_active":"2024-08-17T02:24:46.695064+0000","last_peered":"2024-08-17T02:24:46.695064+0000","last_clean":"2024-08-17T02:24:46.695064+0000","last_became_active":"2024-08-17T02:24:46.694303+0000","last_became_peered":"2024-08-17T02:24:46.694303+0000","last_unstale":"2024-08-17T02:24:46.695064+0000","last_undegraded":"2024-08-17T02:24:46.695064+0000","last_fullsized":"2024-08-17T02:24:46.695064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.695865+0000","last_change":"2024-08-17T02:24:45.693363+0000","last_active":"2024-08-17T02:24:45.695865+0000","last_peered":"2024-08-17T02:24:45.695865+0000","last_clean":"2024-08-17T02:24:45.695865+0000","last_became_active":"2024-08-17T02:24:45.693114+0000","last_became_peered":"2024-08-17T02:24:45.693114+0000","last_unstale":"2024-08-17T02:24:45.695865+0000","last_undegraded":"2024-08-17T02:24:45.695865+0000","last_fullsized":"2024-08-17T02:24:45.695865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703793+0000","last_change":"2024-08-17T02:24:46.703793+0000","last_active":"2024-08-17T02:24:46.703793+0000","last_peered":"2024-08-17T02:24:46.703793+0000","last_clean":"2024-08-17T02:24:46.703793+0000","last_became_active":"2024-08-17T02:24:46.703493+0000","last_became_peered":"2024-08-17T02:24:46.703493+0000","last_unstale":"2024-08-17T02:24:46.703793+0000","last_undegraded":"2024-08-17T02:24:46.703793+0000","last_fullsized":"2024-08-17T02:24:46.703793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.681783+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:24:45.681783+0000","last_peered":"2024-08-17T02:24:45.681783+0000","last_clean":"2024-08-17T02:24:45.681783+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:24:45.681783+0000","last_undegraded":"2024-08-17T02:24:45.681783+0000","last_fullsized":"2024-08-17T02:24:45.681783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.690926+0000","last_change":"2024-08-17T02:24:45.684657+0000","last_active":"2024-08-17T02:24:45.690926+0000","last_peered":"2024-08-17T02:24:45.690926+0000","last_clean":"2024-08-17T02:24:45.690926+0000","last_became_active":"2024-08-17T02:24:45.683930+0000","last_became_peered":"2024-08-17T02:24:45.683930+0000","last_unstale":"2024-08-17T02:24:45.690926+0000","last_undegraded":"2024-08-17T02:24:45.690926+0000","last_fullsized":"2024-08-17T02:24:45.690926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690032+0000","last_change":"2024-08-17T02:24:46.690032+0000","last_active":"2024-08-17T02:24:46.690032+0000","last_peered":"2024-08-17T02:24:46.690032+0000","last_clean":"2024-08-17T02:24:46.690032+0000","last_became_active":"2024-08-17T02:24:46.689692+0000","last_became_peered":"2024-08-17T02:24:46.689692+0000","last_unstale":"2024-08-17T02:24:46.690032+0000","last_undegraded":"2024-08-17T02:24:46.690032+0000","last_fullsized":"2024-08-17T02:24:46.690032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:49.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.696106+0000","last_change":"2024-08-17T02:24:45.695195+0000","last_active":"2024-08-17T02:24:45.696106+0000","last_peered":"2024-08-17T02:24:45.696106+0000","last_clean":"2024-08-17T02:24:45.696106+0000","last_became_active":"2024-08-17T02:24:45.694908+0000","last_became_peered":"2024-08-17T02:24:45.694908+0000","last_unstale":"2024-08-17T02:24:45.696106+0000","last_undegraded":"2024-08-17T02:24:45.696106+0000","last_fullsized":"2024-08-17T02:24:45.696106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698400+0000","last_change":"2024-08-17T02:24:46.698400+0000","last_active":"2024-08-17T02:24:46.698400+0000","last_peered":"2024-08-17T02:24:46.698400+0000","last_clean":"2024-08-17T02:24:46.698400+0000","last_became_active":"2024-08-17T02:24:46.697641+0000","last_became_peered":"2024-08-17T02:24:46.697641+0000","last_unstale":"2024-08-17T02:24:46.698400+0000","last_undegraded":"2024-08-17T02:24:46.698400+0000","last_fullsized":"2024-08-17T02:24:46.698400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.701104+0000","last_change":"2024-08-17T02:24:45.696585+0000","last_active":"2024-08-17T02:24:45.701104+0000","last_peered":"2024-08-17T02:24:45.701104+0000","last_clean":"2024-08-17T02:24:45.701104+0000","last_became_active":"2024-08-17T02:24:45.696243+0000","last_became_peered":"2024-08-17T02:24:45.696243+0000","last_unstale":"2024-08-17T02:24:45.701104+0000","last_undegraded":"2024-08-17T02:24:45.701104+0000","last_fullsized":"2024-08-17T02:24:45.701104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.685570+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:17.216750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692732+0000","last_change":"2024-08-17T02:24:45.689974+0000","last_active":"2024-08-17T02:24:45.692732+0000","last_peered":"2024-08-17T02:24:45.692732+0000","last_clean":"2024-08-17T02:24:45.692732+0000","last_became_active":"2024-08-17T02:24:45.689686+0000","last_became_peered":"2024-08-17T02:24:45.689686+0000","last_unstale":"2024-08-17T02:24:45.692732+0000","last_undegraded":"2024-08-17T02:24:45.692732+0000","last_fullsized":"2024-08-17T02:24:45.692732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:02.113673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695491+0000","last_change":"2024-08-17T02:24:46.695491+0000","last_active":"2024-08-17T02:24:46.695491+0000","last_peered":"2024-08-17T02:24:46.695491+0000","last_clean":"2024-08-17T02:24:46.695491+0000","last_became_active":"2024-08-17T02:24:46.694910+0000","last_became_peered":"2024-08-17T02:24:46.694910+0000","last_unstale":"2024-08-17T02:24:46.695491+0000","last_undegraded":"2024-08-17T02:24:46.695491+0000","last_fullsized":"2024-08-17T02:24:46.695491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:17.309712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693494+0000","last_change":"2024-08-17T02:24:45.693494+0000","last_active":"2024-08-17T02:24:45.693494+0000","last_peered":"2024-08-17T02:24:45.693494+0000","last_clean":"2024-08-17T02:24:45.693494+0000","last_became_active":"2024-08-17T02:24:45.691399+0000","last_became_peered":"2024-08-17T02:24:45.691399+0000","last_unstale":"2024-08-17T02:24:45.693494+0000","last_undegraded":"2024-08-17T02:24:45.693494+0000","last_fullsized":"2024-08-17T02:24:45.693494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:47.538687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697272+0000","last_change":"2024-08-17T02:24:46.697272+0000","last_active":"2024-08-17T02:24:46.697272+0000","last_peered":"2024-08-17T02:24:46.697272+0000","last_clean":"2024-08-17T02:24:46.697272+0000","last_became_active":"2024-08-17T02:24:46.696866+0000","last_became_peered":"2024-08-17T02:24:46.696866+0000","last_unstale":"2024-08-17T02:24:46.697272+0000","last_undegraded":"2024-08-17T02:24:46.697272+0000","last_fullsized":"2024-08-17T02:24:46.697272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692661+0000","last_change":"2024-08-17T02:24:45.689340+0000","last_active":"2024-08-17T02:24:45.692661+0000","last_peered":"2024-08-17T02:24:45.692661+0000","last_clean":"2024-08-17T02:24:45.692661+0000","last_became_active":"2024-08-17T02:24:45.687263+0000","last_became_peered":"2024-08-17T02:24:45.687263+0000","last_unstale":"2024-08-17T02:24:45.692661+0000","last_undegraded":"2024-08-17T02:24:45.692661+0000","last_fullsized":"2024-08-17T02:24:45.692661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.687663+0000","last_change":"2024-08-17T02:24:46.687663+0000","last_active":"2024-08-17T02:24:46.687663+0000","last_peered":"2024-08-17T02:24:46.687663+0000","last_clean":"2024-08-17T02:24:46.687663+0000","last_became_active":"2024-08-17T02:24:46.687285+0000","last_became_peered":"2024-08-17T02:24:46.687285+0000","last_unstale":"2024-08-17T02:24:46.687663+0000","last_undegraded":"2024-08-17T02:24:46.687663+0000","last_fullsized":"2024-08-17T02:24:46.687663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.695885+0000","last_change":"2024-08-17T02:24:45.692340+0000","last_active":"2024-08-17T02:24:45.695885+0000","last_peered":"2024-08-17T02:24:45.695885+0000","last_clean":"2024-08-17T02:24:45.695885+0000","last_became_active":"2024-08-17T02:24:45.691959+0000","last_became_peered":"2024-08-17T02:24:45.691959+0000","last_unstale":"2024-08-17T02:24:45.695885+0000","last_undegraded":"2024-08-17T02:24:45.695885+0000","last_fullsized":"2024-08-17T02:24:45.695885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699671+0000","last_change":"2024-08-17T02:24:46.699671+0000","last_active":"2024-08-17T02:24:46.699671+0000","last_peered":"2024-08-17T02:24:46.699671+0000","last_clean":"2024-08-17T02:24:46.699671+0000","last_became_active":"2024-08-17T02:24:46.699384+0000","last_became_peered":"2024-08-17T02:24:46.699384+0000","last_unstale":"2024-08-17T02:24:46.699671+0000","last_undegraded":"2024-08-17T02:24:46.699671+0000","last_fullsized":"2024-08-17T02:24:46.699671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706478+0000","last_change":"2024-08-17T02:24:45.689016+0000","last_active":"2024-08-17T02:24:46.706478+0000","last_peered":"2024-08-17T02:24:46.706478+0000","last_clean":"2024-08-17T02:24:46.706478+0000","last_became_active":"2024-08-17T02:24:45.688568+0000","last_became_peered":"2024-08-17T02:24:45.688568+0000","last_unstale":"2024-08-17T02:24:46.706478+0000","last_undegraded":"2024-08-17T02:24:46.706478+0000","last_fullsized":"2024-08-17T02:24:46.706478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:31.920700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690217+0000","last_change":"2024-08-17T02:24:46.690217+0000","last_active":"2024-08-17T02:24:46.690217+0000","last_peered":"2024-08-17T02:24:46.690217+0000","last_clean":"2024-08-17T02:24:46.690217+0000","last_became_active":"2024-08-17T02:24:46.689945+0000","last_became_peered":"2024-08-17T02:24:46.689945+0000","last_unstale":"2024-08-17T02:24:46.690217+0000","last_undegraded":"2024-08-17T02:24:46.690217+0000","last_fullsized":"2024-08-17T02:24:46.690217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.696490+0000","last_change":"2024-08-17T02:24:45.692162+0000","last_active":"2024-08-17T02:24:45.696490+0000","last_peered":"2024-08-17T02:24:45.696490+0000","last_clean":"2024-08-17T02:24:45.696490+0000","last_became_active":"2024-08-17T02:24:45.691864+0000","last_became_peered":"2024-08-17T02:24:45.691864+0000","last_unstale":"2024-08-17T02:24:45.696490+0000","last_undegraded":"2024-08-17T02:24:45.696490+0000","last_fullsized":"2024-08-17T02:24:45.696490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693752+0000","last_change":"2024-08-17T02:24:46.693752+0000","last_active":"2024-08-17T02:24:46.693752+0000","last_peered":"2024-08-17T02:24:46.693752+0000","last_clean":"2024-08-17T02:24:46.693752+0000","last_became_active":"2024-08-17T02:24:46.693452+0000","last_became_peered":"2024-08-17T02:24:46.693452+0000","last_unstale":"2024-08-17T02:24:46.693752+0000","last_undegraded":"2024-08-17T02:24:46.693752+0000","last_fullsized":"2024-08-17T02:24:46.693752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.504743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.698413+0000","last_change":"2024-08-17T02:24:45.695549+0000","last_active":"2024-08-17T02:24:45.698413+0000","last_peered":"2024-08-17T02:24:45.698413+0000","last_clean":"2024-08-17T02:24:45.698413+0000","last_became_active":"2024-08-17T02:24:45.695270+0000","last_became_peered":"2024-08-17T02:24:45.695270+0000","last_unstale":"2024-08-17T02:24:45.698413+0000","last_undegraded":"2024-08-17T02:24:45.698413+0000","last_fullsized":"2024-08-17T02:24:45.698413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.689650+0000","last_change":"2024-08-17T02:24:46.689650+0000","last_active":"2024-08-17T02:24:46.689650+0000","last_peered":"2024-08-17T02:24:46.689650+0000","last_clean":"2024-08-17T02:24:46.689650+0000","last_became_active":"2024-08-17T02:24:46.689361+0000","last_became_peered":"2024-08-17T02:24:46.689361+0000","last_unstale":"2024-08-17T02:24:46.689650+0000","last_undegraded":"2024-08-17T02:24:46.689650+0000","last_fullsized":"2024-08-17T02:24:46.689650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692092+0000","last_change":"2024-08-17T02:24:45.688479+0000","last_active":"2024-08-17T02:24:45.692092+0000","last_peered":"2024-08-17T02:24:45.692092+0000","last_clean":"2024-08-17T02:24:45.692092+0000","last_became_active":"2024-08-17T02:24:45.688105+0000","last_became_peered":"2024-08-17T02:24:45.688105+0000","last_unstale":"2024-08-17T02:24:45.692092+0000","last_undegraded":"2024-08-17T02:24:45.692092+0000","last_fullsized":"2024-08-17T02:24:45.692092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693894+0000","last_change":"2024-08-17T02:24:46.693894+0000","last_active":"2024-08-17T02:24:46.693894+0000","last_peered":"2024-08-17T02:24:46.693894+0000","last_clean":"2024-08-17T02:24:46.693894+0000","last_became_active":"2024-08-17T02:24:46.693611+0000","last_became_peered":"2024-08-17T02:24:46.693611+0000","last_unstale":"2024-08-17T02:24:46.693894+0000","last_undegraded":"2024-08-17T02:24:46.693894+0000","last_fullsized":"2024-08-17T02:24:46.693894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706309+0000","last_change":"2024-08-17T02:24:45.684136+0000","last_active":"2024-08-17T02:24:46.706309+0000","last_peered":"2024-08-17T02:24:46.706309+0000","last_clean":"2024-08-17T02:24:46.706309+0000","last_became_active":"2024-08-17T02:24:45.683723+0000","last_became_peered":"2024-08-17T02:24:45.683723+0000","last_unstale":"2024-08-17T02:24:46.706309+0000","last_undegraded":"2024-08-17T02:24:46.706309+0000","last_fullsized":"2024-08-17T02:24:46.706309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691308+0000","last_change":"2024-08-17T02:24:46.691308+0000","last_active":"2024-08-17T02:24:46.691308+0000","last_peered":"2024-08-17T02:24:46.691308+0000","last_clean":"2024-08-17T02:24:46.691308+0000","last_became_active":"2024-08-17T02:24:46.691046+0000","last_became_peered":"2024-08-17T02:24:46.691046+0000","last_unstale":"2024-08-17T02:24:46.691308+0000","last_undegraded":"2024-08-17T02:24:46.691308+0000","last_fullsized":"2024-08-17T02:24:46.691308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699150+0000","last_change":"2024-08-17T02:24:46.699150+0000","last_active":"2024-08-17T02:24:46.699150+0000","last_peered":"2024-08-17T02:24:46.699150+0000","last_clean":"2024-08-17T02:24:46.699150+0000","last_became_active":"2024-08-17T02:24:46.697504+0000","last_became_peered":"2024-08-17T02:24:46.697504+0000","last_unstale":"2024-08-17T02:24:46.699150+0000","last_undegraded":"2024-08-17T02:24:46.699150+0000","last_fullsized":"2024-08-17T02:24:46.699150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710964+0000","last_change":"2024-08-17T02:24:45.690864+0000","last_active":"2024-08-17T02:24:46.710964+0000","last_peered":"2024-08-17T02:24:46.710964+0000","last_clean":"2024-08-17T02:24:46.710964+0000","last_became_active":"2024-08-17T02:24:45.687405+0000","last_became_peered":"2024-08-17T02:24:45.687405+0000","last_unstale":"2024-08-17T02:24:46.710964+0000","last_undegraded":"2024-08-17T02:24:46.710964+0000","last_fullsized":"2024-08-17T02:24:46.710964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702644+0000","last_change":"2024-08-17T02:24:46.702644+0000","last_active":"2024-08-17T02:24:46.702644+0000","last_peered":"2024-08-17T02:24:46.702644+0000","last_clean":"2024-08-17T02:24:46.702644+0000","last_became_active":"2024-08-17T02:24:46.701576+0000","last_became_peered":"2024-08-17T02:24:46.701576+0000","last_unstale":"2024-08-17T02:24:46.702644+0000","last_undegraded":"2024-08-17T02:24:46.702644+0000","last_fullsized":"2024-08-17T02:24:46.702644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:12.393424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710485+0000","last_change":"2024-08-17T02:24:45.689395+0000","last_active":"2024-08-17T02:24:46.710485+0000","last_peered":"2024-08-17T02:24:46.710485+0000","last_clean":"2024-08-17T02:24:46.710485+0000","last_became_active":"2024-08-17T02:24:45.689082+0000","last_became_peered":"2024-08-17T02:24:45.689082+0000","last_unstale":"2024-08-17T02:24:46.710485+0000","last_undegraded":"2024-08-17T02:24:46.710485+0000","last_fullsized":"2024-08-17T02:24:46.710485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.685140+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:42.849100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.687064+0000","last_change":"2024-08-17T02:24:45.687064+0000","last_active":"2024-08-17T02:24:45.687064+0000","last_peered":"2024-08-17T02:24:45.687064+0000","last_clean":"2024-08-17T02:24:45.687064+0000","last_became_active":"2024-08-17T02:24:45.686543+0000","last_became_peered":"2024-08-17T02:24:45.686543+0000","last_unstale":"2024-08-17T02:24:45.687064+0000","last_undegraded":"2024-08-17T02:24:45.687064+0000","last_fullsized":"2024-08-17T02:24:45.687064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:47.125586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683230+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:27.265830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708733+0000","last_change":"2024-08-17T02:24:45.687257+0000","last_active":"2024-08-17T02:24:46.708733+0000","last_peered":"2024-08-17T02:24:46.708733+0000","last_clean":"2024-08-17T02:24:46.708733+0000","last_became_active":"2024-08-17T02:24:45.686911+0000","last_became_peered":"2024-08-17T02:24:45.686911+0000","last_unstale":"2024-08-17T02:24:46.708733+0000","last_undegraded":"2024-08-17T02:24:46.708733+0000","last_fullsized":"2024-08-17T02:24:46.708733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2268,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":74467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":74343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":241664,"data_stored":76555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":74913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":75895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":819200,"data_stored":664781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":74399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":802816,"data_stored":657948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:49.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:49.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.862+0000 7f03d24ec700 1 Processor -- start 2024-08-17T02:24:49.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.862+0000 7f03d24ec700 1 -- start start 2024-08-17T02:24:49.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.862+0000 7f03d24ec700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03cc0b0ff0 0x7f03cc0c9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d24ec700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc0af1f0 con 0x7f03cc0c90c0 2024-08-17T02:24:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d24ec700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc0b0450 con 0x7f03cc06dc00 2024-08-17T02:24:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d24ec700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0af840 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d14ea700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f03cc06dc00 0x7f03cc0ab8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:47596/0 (socket says 172.21.15.31:47596) 2024-08-17T02:24:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d14ea700 1 -- 172.21.15.31:0/3898335914 learned_addr learned my addr 172.21.15.31:0/3898335914 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d0ce9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f03cc0c90c0 0x7f03cc0b08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45774/0 (socket says 172.21.15.31:45774) 2024-08-17T02:24:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d1ceb700 1 --2- 172.21.15.31:0/3898335914 >> v2:172.21.15.31:3300/0 conn(0x7f03cc0b0ff0 0x7f03cc0c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03c3fff700 1 -- 172.21.15.31:0/3898335914 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383454997 0 0) 0x7f03cc0b0450 con 0x7f03cc06dc00 2024-08-17T02:24:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03c3fff700 1 -- 172.21.15.31:0/3898335914 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b8003570 con 0x7f03cc06dc00 2024-08-17T02:24:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d1ceb700 1 -- 172.21.15.31:0/3898335914 >> v1:172.21.15.92:6789/0 conn(0x7f03cc06dc00 legacy=0x7f03cc0ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03c3fff700 1 -- 172.21.15.31:0/3898335914 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751229688 0 0) 0x7f03cc0af1f0 con 0x7f03cc0c90c0 2024-08-17T02:24:49.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d1ceb700 1 -- 172.21.15.31:0/3898335914 >> v1:172.21.15.31:6789/0 conn(0x7f03cc0c90c0 legacy=0x7f03cc0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d1ceb700 1 -- 172.21.15.31:0/3898335914 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0afb20 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d1ceb700 1 --2- 172.21.15.31:0/3898335914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 0x7f03cc0c9500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009e60 tx=0x7f03c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b729865131d623e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03c3fff700 1 -- 172.21.15.31:0/3898335914 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c400e070 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03c3fff700 1 -- 172.21.15.31:0/3898335914 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c400bb60 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03c3fff700 1 -- 172.21.15.31:0/3898335914 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4012430 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d24ec700 1 -- 172.21.15.31:0/3898335914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 msgr2=0x7f03cc0c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d24ec700 1 --2- 172.21.15.31:0/3898335914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 0x7f03cc0c9500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009e60 tx=0x7f03c4009780 comp rx=0 tx=0).stop 2024-08-17T02:24:49.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d24ec700 1 -- 172.21.15.31:0/3898335914 shutdown_connections 2024-08-17T02:24:49.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d24ec700 1 --2- 172.21.15.31:0/3898335914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 0x7f03cc0c9500 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d24ec700 1 -- 172.21.15.31:0/3898335914 >> 172.21.15.31:0/3898335914 conn(0x7f03cc0cd090 msgr2=0x7f03cc0ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:49.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d24ec700 1 -- 172.21.15.31:0/3898335914 shutdown_connections 2024-08-17T02:24:49.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.866+0000 7f03d24ec700 1 -- 172.21.15.31:0/3898335914 wait complete. 2024-08-17T02:24:49.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.870+0000 7f03d24ec700 1 Processor -- start 2024-08-17T02:24:49.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.870+0000 7f03d24ec700 1 -- start start 2024-08-17T02:24:49.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.870+0000 7f03d24ec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03cc06dc00 0x7f03cc167a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.870+0000 7f03d24ec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 0x7f03cc0a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.870+0000 7f03d24ec700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03cc0c90c0 0x7f03cc1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d24ec700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0a9cb0 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d24ec700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc166ff0 con 0x7f03cc06dc00 2024-08-17T02:24:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d24ec700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc167fb0 con 0x7f03cc0c90c0 2024-08-17T02:24:49.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d0ce9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 0x7f03cc0a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d0ce9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 0x7f03cc0a8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56536/0 (socket says 172.21.15.31:56536) 2024-08-17T02:24:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d0ce9700 1 -- 172.21.15.31:0/1735428752 learned_addr learned my addr 172.21.15.31:0/1735428752 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d1ceb700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03cc0c90c0 0x7f03cc1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d14ea700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03cc06dc00 0x7f03cc167a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d0ce9700 1 -- 172.21.15.31:0/1735428752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03cc0c90c0 msgr2=0x7f03cc1491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d0ce9700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03cc0c90c0 0x7f03cc1491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d0ce9700 1 -- 172.21.15.31:0/1735428752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03cc06dc00 msgr2=0x7f03cc167a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d0ce9700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03cc06dc00 0x7f03cc167a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d0ce9700 1 -- 172.21.15.31:0/1735428752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4009a20 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d14ea700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03cc06dc00 0x7f03cc167a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d0ce9700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 0x7f03cc0a8ec0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c5b0 tx=0x7f03bc001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03c17fa700 1 -- 172.21.15.31:0/1735428752 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc005a70 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03c17fa700 1 -- 172.21.15.31:0/1735428752 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc005bd0 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d24ec700 1 -- 172.21.15.31:0/1735428752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc0a96f0 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03c17fa700 1 -- 172.21.15.31:0/1735428752 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0070d0 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d24ec700 1 -- 172.21.15.31:0/1735428752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc167550 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.874+0000 7f03d24ec700 1 -- 172.21.15.31:0/1735428752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc167770 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.878+0000 7f03c17fa700 1 -- 172.21.15.31:0/1735428752 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f03bc007440 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.878+0000 7f03c17fa700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f03b0060860 0x7f03b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:49.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.878+0000 7f03c17fa700 1 -- 172.21.15.31:0/1735428752 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03bc07c030 con 0x7f03cc0b0ff0 2024-08-17T02:24:49.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.878+0000 7f03d14ea700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f03b0060860 0x7f03b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:49.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.878+0000 7f03d14ea700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f03b0060860 0x7f03b0062d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03c80058d0 tx=0x7f03c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:49.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:49.882+0000 7f03c17fa700 1 -- 172.21.15.31:0/1735428752 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f03bc04c480 con 0x7f03cc0b0ff0 2024-08-17T02:24:50.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.042+0000 7f03d24ec700 1 -- 172.21.15.31:0/1735428752 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03cc0a9ae0 con 0x7f03b0060860 2024-08-17T02:24:50.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.058+0000 7f03c17fa700 1 -- 172.21.15.31:0/1735428752 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264001 (secure 0 0 0) 0x7f03cc0a9ae0 con 0x7f03b0060860 2024-08-17T02:24:50.068 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:50.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 -- 172.21.15.31:0/1735428752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f03b0060860 msgr2=0x7f03b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f03b0060860 0x7f03b0062d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03c80058d0 tx=0x7f03c8009040 comp rx=0 tx=0).stop 2024-08-17T02:24:50.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 -- 172.21.15.31:0/1735428752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 msgr2=0x7f03cc0a8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 0x7f03cc0a8ec0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c5b0 tx=0x7f03bc001040 comp rx=0 tx=0).stop 2024-08-17T02:24:50.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 -- 172.21.15.31:0/1735428752 shutdown_connections 2024-08-17T02:24:50.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f03b0060860 0x7f03b0062d10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03cc0c90c0 0x7f03cc1491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03cc0b0ff0 0x7f03cc0a8ec0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 --2- 172.21.15.31:0/1735428752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03cc06dc00 0x7f03cc167a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 -- 172.21.15.31:0/1735428752 >> 172.21.15.31:0/1735428752 conn(0x7f03cc0cd090 msgr2=0x7f03cc0b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:50.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.062+0000 7f03d24ec700 1 -- 172.21.15.31:0/1735428752 shutdown_connections 2024-08-17T02:24:50.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.066+0000 7f03d24ec700 1 -- 172.21.15.31:0/1735428752 wait complete. 2024-08-17T02:24:50.072 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:24:50.085 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:24:49.582877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592636,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381804,"kb_used_data":2932,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592916,"statfs":{"total":773094113280,"available":770655145984,"internally_reserved":0,"allocated":3002368,"data_stored":1773301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2268,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.927145"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711137+0000","last_change":"2024-08-17T02:24:46.711137+0000","last_active":"2024-08-17T02:24:46.711137+0000","last_peered":"2024-08-17T02:24:46.711137+0000","last_clean":"2024-08-17T02:24:46.711137+0000","last_became_active":"2024-08-17T02:24:46.710820+0000","last_became_peered":"2024-08-17T02:24:46.710820+0000","last_unstale":"2024-08-17T02:24:46.711137+0000","last_undegraded":"2024-08-17T02:24:46.711137+0000","last_fullsized":"2024-08-17T02:24:46.711137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.684833+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683020+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:15.827101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702343+0000","last_change":"2024-08-17T02:24:46.702343+0000","last_active":"2024-08-17T02:24:46.702343+0000","last_peered":"2024-08-17T02:24:46.702343+0000","last_clean":"2024-08-17T02:24:46.702343+0000","last_became_active":"2024-08-17T02:24:46.700536+0000","last_became_peered":"2024-08-17T02:24:46.700536+0000","last_unstale":"2024-08-17T02:24:46.702343+0000","last_undegraded":"2024-08-17T02:24:46.702343+0000","last_fullsized":"2024-08-17T02:24:46.702343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697977+0000","last_change":"2024-08-17T02:24:46.697977+0000","last_active":"2024-08-17T02:24:46.697977+0000","last_peered":"2024-08-17T02:24:46.697977+0000","last_clean":"2024-08-17T02:24:46.697977+0000","last_became_active":"2024-08-17T02:24:46.697680+0000","last_became_peered":"2024-08-17T02:24:46.697680+0000","last_unstale":"2024-08-17T02:24:46.697977+0000","last_undegraded":"2024-08-17T02:24:46.697977+0000","last_fullsized":"2024-08-17T02:24:46.697977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696070+0000","last_change":"2024-08-17T02:24:46.696070+0000","last_active":"2024-08-17T02:24:46.696070+0000","last_peered":"2024-08-17T02:24:46.696070+0000","last_clean":"2024-08-17T02:24:46.696070+0000","last_became_active":"2024-08-17T02:24:46.693809+0000","last_became_peered":"2024-08-17T02:24:46.693809+0000","last_unstale":"2024-08-17T02:24:46.696070+0000","last_undegraded":"2024-08-17T02:24:46.696070+0000","last_fullsized":"2024-08-17T02:24:46.696070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694034+0000","last_change":"2024-08-17T02:24:46.694034+0000","last_active":"2024-08-17T02:24:46.694034+0000","last_peered":"2024-08-17T02:24:46.694034+0000","last_clean":"2024-08-17T02:24:46.694034+0000","last_became_active":"2024-08-17T02:24:46.693720+0000","last_became_peered":"2024-08-17T02:24:46.693720+0000","last_unstale":"2024-08-17T02:24:46.694034+0000","last_undegraded":"2024-08-17T02:24:46.694034+0000","last_fullsized":"2024-08-17T02:24:46.694034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:25.120018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.687014+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:10.973372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710805+0000","last_change":"2024-08-17T02:24:46.710805+0000","last_active":"2024-08-17T02:24:46.710805+0000","last_peered":"2024-08-17T02:24:46.710805+0000","last_clean":"2024-08-17T02:24:46.710805+0000","last_became_active":"2024-08-17T02:24:46.710510+0000","last_became_peered":"2024-08-17T02:24:46.710510+0000","last_unstale":"2024-08-17T02:24:46.710805+0000","last_undegraded":"2024-08-17T02:24:46.710805+0000","last_fullsized":"2024-08-17T02:24:46.710805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695508+0000","last_change":"2024-08-17T02:24:46.695508+0000","last_active":"2024-08-17T02:24:46.695508+0000","last_peered":"2024-08-17T02:24:46.695508+0000","last_clean":"2024-08-17T02:24:46.695508+0000","last_became_active":"2024-08-17T02:24:46.695174+0000","last_became_peered":"2024-08-17T02:24:46.695174+0000","last_unstale":"2024-08-17T02:24:46.695508+0000","last_undegraded":"2024-08-17T02:24:46.695508+0000","last_fullsized":"2024-08-17T02:24:46.695508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:26.358220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711058+0000","last_change":"2024-08-17T02:24:46.711058+0000","last_active":"2024-08-17T02:24:46.711058+0000","last_peered":"2024-08-17T02:24:46.711058+0000","last_clean":"2024-08-17T02:24:46.711058+0000","last_became_active":"2024-08-17T02:24:46.710739+0000","last_became_peered":"2024-08-17T02:24:46.710739+0000","last_unstale":"2024-08-17T02:24:46.711058+0000","last_undegraded":"2024-08-17T02:24:46.711058+0000","last_fullsized":"2024-08-17T02:24:46.711058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695791+0000","last_change":"2024-08-17T02:24:46.695791+0000","last_active":"2024-08-17T02:24:46.695791+0000","last_peered":"2024-08-17T02:24:46.695791+0000","last_clean":"2024-08-17T02:24:46.695791+0000","last_became_active":"2024-08-17T02:24:46.695116+0000","last_became_peered":"2024-08-17T02:24:46.695116+0000","last_unstale":"2024-08-17T02:24:46.695791+0000","last_undegraded":"2024-08-17T02:24:46.695791+0000","last_fullsized":"2024-08-17T02:24:46.695791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699896+0000","last_change":"2024-08-17T02:24:46.699896+0000","last_active":"2024-08-17T02:24:46.699896+0000","last_peered":"2024-08-17T02:24:46.699896+0000","last_clean":"2024-08-17T02:24:46.699896+0000","last_became_active":"2024-08-17T02:24:46.699645+0000","last_became_peered":"2024-08-17T02:24:46.699645+0000","last_unstale":"2024-08-17T02:24:46.699896+0000","last_undegraded":"2024-08-17T02:24:46.699896+0000","last_fullsized":"2024-08-17T02:24:46.699896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:36.261958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690505+0000","last_change":"2024-08-17T02:24:46.690505+0000","last_active":"2024-08-17T02:24:46.690505+0000","last_peered":"2024-08-17T02:24:46.690505+0000","last_clean":"2024-08-17T02:24:46.690505+0000","last_became_active":"2024-08-17T02:24:46.690185+0000","last_became_peered":"2024-08-17T02:24:46.690185+0000","last_unstale":"2024-08-17T02:24:46.690505+0000","last_undegraded":"2024-08-17T02:24:46.690505+0000","last_fullsized":"2024-08-17T02:24:46.690505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.684166+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:15.861283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690550+0000","last_change":"2024-08-17T02:24:46.690550+0000","last_active":"2024-08-17T02:24:46.690550+0000","last_peered":"2024-08-17T02:24:46.690550+0000","last_clean":"2024-08-17T02:24:46.690550+0000","last_became_active":"2024-08-17T02:24:46.690231+0000","last_became_peered":"2024-08-17T02:24:46.690231+0000","last_unstale":"2024-08-17T02:24:46.690550+0000","last_undegraded":"2024-08-17T02:24:46.690550+0000","last_fullsized":"2024-08-17T02:24:46.690550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:40:04.175081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703443+0000","last_change":"2024-08-17T02:24:46.703443+0000","last_active":"2024-08-17T02:24:46.703443+0000","last_peered":"2024-08-17T02:24:46.703443+0000","last_clean":"2024-08-17T02:24:46.703443+0000","last_became_active":"2024-08-17T02:24:46.703111+0000","last_became_peered":"2024-08-17T02:24:46.703111+0000","last_unstale":"2024-08-17T02:24:46.703443+0000","last_undegraded":"2024-08-17T02:24:46.703443+0000","last_fullsized":"2024-08-17T02:24:46.703443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695275+0000","last_change":"2024-08-17T02:24:46.695275+0000","last_active":"2024-08-17T02:24:46.695275+0000","last_peered":"2024-08-17T02:24:46.695275+0000","last_clean":"2024-08-17T02:24:46.695275+0000","last_became_active":"2024-08-17T02:24:46.694600+0000","last_became_peered":"2024-08-17T02:24:46.694600+0000","last_unstale":"2024-08-17T02:24:46.695275+0000","last_undegraded":"2024-08-17T02:24:46.695275+0000","last_fullsized":"2024-08-17T02:24:46.695275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703289+0000","last_change":"2024-08-17T02:24:46.703289+0000","last_active":"2024-08-17T02:24:46.703289+0000","last_peered":"2024-08-17T02:24:46.703289+0000","last_clean":"2024-08-17T02:24:46.703289+0000","last_became_active":"2024-08-17T02:24:46.702961+0000","last_became_peered":"2024-08-17T02:24:46.702961+0000","last_unstale":"2024-08-17T02:24:46.703289+0000","last_undegraded":"2024-08-17T02:24:46.703289+0000","last_fullsized":"2024-08-17T02:24:46.703289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:26.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696080+0000","last_change":"2024-08-17T02:24:46.696080+0000","last_active":"2024-08-17T02:24:46.696080+0000","last_peered":"2024-08-17T02:24:46.696080+0000","last_clean":"2024-08-17T02:24:46.696080+0000","last_became_active":"2024-08-17T02:24:46.695753+0000","last_became_peered":"2024-08-17T02:24:46.695753+0000","last_unstale":"2024-08-17T02:24:46.696080+0000","last_undegraded":"2024-08-17T02:24:46.696080+0000","last_fullsized":"2024-08-17T02:24:46.696080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.692695+0000","last_change":"2024-08-17T02:24:46.692695+0000","last_active":"2024-08-17T02:24:46.692695+0000","last_peered":"2024-08-17T02:24:46.692695+0000","last_clean":"2024-08-17T02:24:46.692695+0000","last_became_active":"2024-08-17T02:24:46.691145+0000","last_became_peered":"2024-08-17T02:24:46.691145+0000","last_unstale":"2024-08-17T02:24:46.692695+0000","last_undegraded":"2024-08-17T02:24:46.692695+0000","last_fullsized":"2024-08-17T02:24:46.692695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:25.233681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696761+0000","last_change":"2024-08-17T02:24:46.696761+0000","last_active":"2024-08-17T02:24:46.696761+0000","last_peered":"2024-08-17T02:24:46.696761+0000","last_clean":"2024-08-17T02:24:46.696761+0000","last_became_active":"2024-08-17T02:24:46.695844+0000","last_became_peered":"2024-08-17T02:24:46.695844+0000","last_unstale":"2024-08-17T02:24:46.696761+0000","last_undegraded":"2024-08-17T02:24:46.696761+0000","last_fullsized":"2024-08-17T02:24:46.696761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683038+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:02.907069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.683686+0000","last_change":"2024-08-17T02:24:46.683686+0000","last_active":"2024-08-17T02:24:46.683686+0000","last_peered":"2024-08-17T02:24:46.683686+0000","last_clean":"2024-08-17T02:24:46.683686+0000","last_became_active":"2024-08-17T02:24:46.683416+0000","last_became_peered":"2024-08-17T02:24:46.683416+0000","last_unstale":"2024-08-17T02:24:46.683686+0000","last_undegraded":"2024-08-17T02:24:46.683686+0000","last_fullsized":"2024-08-17T02:24:46.683686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:38.075390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.686371+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:38.994029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707560+0000","last_change":"2024-08-17T02:24:46.707560+0000","last_active":"2024-08-17T02:24:46.707560+0000","last_peered":"2024-08-17T02:24:46.707560+0000","last_clean":"2024-08-17T02:24:46.707560+0000","last_became_active":"2024-08-17T02:24:46.707234+0000","last_became_peered":"2024-08-17T02:24:46.707234+0000","last_unstale":"2024-08-17T02:24:46.707560+0000","last_undegraded":"2024-08-17T02:24:46.707560+0000","last_fullsized":"2024-08-17T02:24:46.707560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:32.930431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691514+0000","last_change":"2024-08-17T02:24:46.691514+0000","last_active":"2024-08-17T02:24:46.691514+0000","last_peered":"2024-08-17T02:24:46.691514+0000","last_clean":"2024-08-17T02:24:46.691514+0000","last_became_active":"2024-08-17T02:24:46.691231+0000","last_became_peered":"2024-08-17T02:24:46.691231+0000","last_unstale":"2024-08-17T02:24:46.691514+0000","last_undegraded":"2024-08-17T02:24:46.691514+0000","last_fullsized":"2024-08-17T02:24:46.691514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698271+0000","last_change":"2024-08-17T02:24:46.698271+0000","last_active":"2024-08-17T02:24:46.698271+0000","last_peered":"2024-08-17T02:24:46.698271+0000","last_clean":"2024-08-17T02:24:46.698271+0000","last_became_active":"2024-08-17T02:24:46.698020+0000","last_became_peered":"2024-08-17T02:24:46.698020+0000","last_unstale":"2024-08-17T02:24:46.698271+0000","last_undegraded":"2024-08-17T02:24:46.698271+0000","last_fullsized":"2024-08-17T02:24:46.698271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:51.758557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.681671+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:33.547382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.684857+0000","last_change":"2024-08-17T02:24:46.684857+0000","last_active":"2024-08-17T02:24:46.684857+0000","last_peered":"2024-08-17T02:24:46.684857+0000","last_clean":"2024-08-17T02:24:46.684857+0000","last_became_active":"2024-08-17T02:24:46.683949+0000","last_became_peered":"2024-08-17T02:24:46.683949+0000","last_unstale":"2024-08-17T02:24:46.684857+0000","last_undegraded":"2024-08-17T02:24:46.684857+0000","last_fullsized":"2024-08-17T02:24:46.684857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:06.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698926+0000","last_change":"2024-08-17T02:24:46.698926+0000","last_active":"2024-08-17T02:24:46.698926+0000","last_peered":"2024-08-17T02:24:46.698926+0000","last_clean":"2024-08-17T02:24:46.698926+0000","last_became_active":"2024-08-17T02:24:46.698650+0000","last_became_peered":"2024-08-17T02:24:46.698650+0000","last_unstale":"2024-08-17T02:24:46.698926+0000","last_undegraded":"2024-08-17T02:24:46.698926+0000","last_fullsized":"2024-08-17T02:24:46.698926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697443+0000","last_change":"2024-08-17T02:24:46.697443+0000","last_active":"2024-08-17T02:24:46.697443+0000","last_peered":"2024-08-17T02:24:46.697443+0000","last_clean":"2024-08-17T02:24:46.697443+0000","last_became_active":"2024-08-17T02:24:46.696404+0000","last_became_peered":"2024-08-17T02:24:46.696404+0000","last_unstale":"2024-08-17T02:24:46.697443+0000","last_undegraded":"2024-08-17T02:24:46.697443+0000","last_fullsized":"2024-08-17T02:24:46.697443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701561+0000","last_change":"2024-08-17T02:24:46.701561+0000","last_active":"2024-08-17T02:24:46.701561+0000","last_peered":"2024-08-17T02:24:46.701561+0000","last_clean":"2024-08-17T02:24:46.701561+0000","last_became_active":"2024-08-17T02:24:46.696208+0000","last_became_peered":"2024-08-17T02:24:46.696208+0000","last_unstale":"2024-08-17T02:24:46.701561+0000","last_undegraded":"2024-08-17T02:24:46.701561+0000","last_fullsized":"2024-08-17T02:24:46.701561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693597+0000","last_change":"2024-08-17T02:24:45.693597+0000","last_active":"2024-08-17T02:24:45.693597+0000","last_peered":"2024-08-17T02:24:45.693597+0000","last_clean":"2024-08-17T02:24:45.693597+0000","last_became_active":"2024-08-17T02:24:45.692136+0000","last_became_peered":"2024-08-17T02:24:45.692136+0000","last_unstale":"2024-08-17T02:24:45.693597+0000","last_undegraded":"2024-08-17T02:24:45.693597+0000","last_fullsized":"2024-08-17T02:24:45.693597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:51.770625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700557+0000","last_change":"2024-08-17T02:24:46.700557+0000","last_active":"2024-08-17T02:24:46.700557+0000","last_peered":"2024-08-17T02:24:46.700557+0000","last_clean":"2024-08-17T02:24:46.700557+0000","last_became_active":"2024-08-17T02:24:46.700114+0000","last_became_peered":"2024-08-17T02:24:46.700114+0000","last_unstale":"2024-08-17T02:24:46.700557+0000","last_undegraded":"2024-08-17T02:24:46.700557+0000","last_fullsized":"2024-08-17T02:24:46.700557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673565+0000","last_change":"2024-08-17T02:24:45.685965+0000","last_active":"2024-08-17T02:24:46.673565+0000","last_peered":"2024-08-17T02:24:46.673565+0000","last_clean":"2024-08-17T02:24:46.673565+0000","last_became_active":"2024-08-17T02:24:45.685019+0000","last_became_peered":"2024-08-17T02:24:45.685019+0000","last_unstale":"2024-08-17T02:24:46.673565+0000","last_undegraded":"2024-08-17T02:24:46.673565+0000","last_fullsized":"2024-08-17T02:24:46.673565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:33.322093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.701270+0000","last_change":"2024-08-17T02:24:45.695657+0000","last_active":"2024-08-17T02:24:45.701270+0000","last_peered":"2024-08-17T02:24:45.701270+0000","last_clean":"2024-08-17T02:24:45.701270+0000","last_became_active":"2024-08-17T02:24:45.695337+0000","last_became_peered":"2024-08-17T02:24:45.695337+0000","last_unstale":"2024-08-17T02:24:45.701270+0000","last_undegraded":"2024-08-17T02:24:45.701270+0000","last_fullsized":"2024-08-17T02:24:45.701270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.680939+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:20:35.140243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.686595+0000","last_change":"2024-08-17T02:24:45.683302+0000","last_active":"2024-08-17T02:24:45.686595+0000","last_peered":"2024-08-17T02:24:45.686595+0000","last_clean":"2024-08-17T02:24:45.686595+0000","last_became_active":"2024-08-17T02:24:45.682641+0000","last_became_peered":"2024-08-17T02:24:45.682641+0000","last_unstale":"2024-08-17T02:24:45.686595+0000","last_undegraded":"2024-08-17T02:24:45.686595+0000","last_fullsized":"2024-08-17T02:24:45.686595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:36.581167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693180+0000","last_change":"2024-08-17T02:24:46.693180+0000","last_active":"2024-08-17T02:24:46.693180+0000","last_peered":"2024-08-17T02:24:46.693180+0000","last_clean":"2024-08-17T02:24:46.693180+0000","last_became_active":"2024-08-17T02:24:46.692910+0000","last_became_peered":"2024-08-17T02:24:46.692910+0000","last_unstale":"2024-08-17T02:24:46.693180+0000","last_undegraded":"2024-08-17T02:24:46.693180+0000","last_fullsized":"2024-08-17T02:24:46.693180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:20.305646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692682+0000","last_change":"2024-08-17T02:24:45.689693+0000","last_active":"2024-08-17T02:24:45.692682+0000","last_peered":"2024-08-17T02:24:45.692682+0000","last_clean":"2024-08-17T02:24:45.692682+0000","last_became_active":"2024-08-17T02:24:45.689396+0000","last_became_peered":"2024-08-17T02:24:45.689396+0000","last_unstale":"2024-08-17T02:24:45.692682+0000","last_undegraded":"2024-08-17T02:24:45.692682+0000","last_fullsized":"2024-08-17T02:24:45.692682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:03:27.829684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707529+0000","last_change":"2024-08-17T02:24:46.707529+0000","last_active":"2024-08-17T02:24:46.707529+0000","last_peered":"2024-08-17T02:24:46.707529+0000","last_clean":"2024-08-17T02:24:46.707529+0000","last_became_active":"2024-08-17T02:24:46.706887+0000","last_became_peered":"2024-08-17T02:24:46.706887+0000","last_unstale":"2024-08-17T02:24:46.707529+0000","last_undegraded":"2024-08-17T02:24:46.707529+0000","last_fullsized":"2024-08-17T02:24:46.707529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693785+0000","last_change":"2024-08-17T02:24:45.689053+0000","last_active":"2024-08-17T02:24:45.693785+0000","last_peered":"2024-08-17T02:24:45.693785+0000","last_clean":"2024-08-17T02:24:45.693785+0000","last_became_active":"2024-08-17T02:24:45.688643+0000","last_became_peered":"2024-08-17T02:24:45.688643+0000","last_unstale":"2024-08-17T02:24:45.693785+0000","last_undegraded":"2024-08-17T02:24:45.693785+0000","last_fullsized":"2024-08-17T02:24:45.693785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683528+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:53.636650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701087+0000","last_change":"2024-08-17T02:24:45.686140+0000","last_active":"2024-08-17T02:24:46.701087+0000","last_peered":"2024-08-17T02:24:46.701087+0000","last_clean":"2024-08-17T02:24:46.701087+0000","last_became_active":"2024-08-17T02:24:45.685732+0000","last_became_peered":"2024-08-17T02:24:45.685732+0000","last_unstale":"2024-08-17T02:24:46.701087+0000","last_undegraded":"2024-08-17T02:24:46.701087+0000","last_fullsized":"2024-08-17T02:24:46.701087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703995+0000","last_change":"2024-08-17T02:24:46.703995+0000","last_active":"2024-08-17T02:24:46.703995+0000","last_peered":"2024-08-17T02:24:46.703995+0000","last_clean":"2024-08-17T02:24:46.703995+0000","last_became_active":"2024-08-17T02:24:46.703632+0000","last_became_peered":"2024-08-17T02:24:46.703632+0000","last_unstale":"2024-08-17T02:24:46.703995+0000","last_undegraded":"2024-08-17T02:24:46.703995+0000","last_fullsized":"2024-08-17T02:24:46.703995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702401+0000","last_change":"2024-08-17T02:24:45.691026+0000","last_active":"2024-08-17T02:24:46.702401+0000","last_peered":"2024-08-17T02:24:46.702401+0000","last_clean":"2024-08-17T02:24:46.702401+0000","last_became_active":"2024-08-17T02:24:45.690499+0000","last_became_peered":"2024-08-17T02:24:45.690499+0000","last_unstale":"2024-08-17T02:24:46.702401+0000","last_undegraded":"2024-08-17T02:24:46.702401+0000","last_fullsized":"2024-08-17T02:24:46.702401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:14.230300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694359+0000","last_change":"2024-08-17T02:24:46.694359+0000","last_active":"2024-08-17T02:24:46.694359+0000","last_peered":"2024-08-17T02:24:46.694359+0000","last_clean":"2024-08-17T02:24:46.694359+0000","last_became_active":"2024-08-17T02:24:46.693812+0000","last_became_peered":"2024-08-17T02:24:46.693812+0000","last_unstale":"2024-08-17T02:24:46.694359+0000","last_undegraded":"2024-08-17T02:24:46.694359+0000","last_fullsized":"2024-08-17T02:24:46.694359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:48:49.063780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703380+0000","last_change":"2024-08-17T02:24:45.689928+0000","last_active":"2024-08-17T02:24:46.703380+0000","last_peered":"2024-08-17T02:24:46.703380+0000","last_clean":"2024-08-17T02:24:46.703380+0000","last_became_active":"2024-08-17T02:24:45.689519+0000","last_became_peered":"2024-08-17T02:24:45.689519+0000","last_unstale":"2024-08-17T02:24:46.703380+0000","last_undegraded":"2024-08-17T02:24:46.703380+0000","last_fullsized":"2024-08-17T02:24:46.703380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708134+0000","last_change":"2024-08-17T02:24:46.708134+0000","last_active":"2024-08-17T02:24:46.708134+0000","last_peered":"2024-08-17T02:24:46.708134+0000","last_clean":"2024-08-17T02:24:46.708134+0000","last_became_active":"2024-08-17T02:24:46.707822+0000","last_became_peered":"2024-08-17T02:24:46.707822+0000","last_unstale":"2024-08-17T02:24:46.708134+0000","last_undegraded":"2024-08-17T02:24:46.708134+0000","last_fullsized":"2024-08-17T02:24:46.708134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692541+0000","last_change":"2024-08-17T02:24:45.686232+0000","last_active":"2024-08-17T02:24:45.692541+0000","last_peered":"2024-08-17T02:24:45.692541+0000","last_clean":"2024-08-17T02:24:45.692541+0000","last_became_active":"2024-08-17T02:24:45.685407+0000","last_became_peered":"2024-08-17T02:24:45.685407+0000","last_unstale":"2024-08-17T02:24:45.692541+0000","last_undegraded":"2024-08-17T02:24:45.692541+0000","last_fullsized":"2024-08-17T02:24:45.692541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700959+0000","last_change":"2024-08-17T02:24:46.700959+0000","last_active":"2024-08-17T02:24:46.700959+0000","last_peered":"2024-08-17T02:24:46.700959+0000","last_clean":"2024-08-17T02:24:46.700959+0000","last_became_active":"2024-08-17T02:24:46.698769+0000","last_became_peered":"2024-08-17T02:24:46.698769+0000","last_unstale":"2024-08-17T02:24:46.700959+0000","last_undegraded":"2024-08-17T02:24:46.700959+0000","last_fullsized":"2024-08-17T02:24:46.700959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693729+0000","last_change":"2024-08-17T02:24:45.687633+0000","last_active":"2024-08-17T02:24:45.693729+0000","last_peered":"2024-08-17T02:24:45.693729+0000","last_clean":"2024-08-17T02:24:45.693729+0000","last_became_active":"2024-08-17T02:24:45.687078+0000","last_became_peered":"2024-08-17T02:24:45.687078+0000","last_unstale":"2024-08-17T02:24:45.693729+0000","last_undegraded":"2024-08-17T02:24:45.693729+0000","last_fullsized":"2024-08-17T02:24:45.693729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696374+0000","last_change":"2024-08-17T02:24:46.696374+0000","last_active":"2024-08-17T02:24:46.696374+0000","last_peered":"2024-08-17T02:24:46.696374+0000","last_clean":"2024-08-17T02:24:46.696374+0000","last_became_active":"2024-08-17T02:24:46.695792+0000","last_became_peered":"2024-08-17T02:24:46.695792+0000","last_unstale":"2024-08-17T02:24:46.696374+0000","last_undegraded":"2024-08-17T02:24:46.696374+0000","last_fullsized":"2024-08-17T02:24:46.696374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.709507+0000","last_change":"2024-08-17T02:24:45.686489+0000","last_active":"2024-08-17T02:24:46.709507+0000","last_peered":"2024-08-17T02:24:46.709507+0000","last_clean":"2024-08-17T02:24:46.709507+0000","last_became_active":"2024-08-17T02:24:45.684809+0000","last_became_peered":"2024-08-17T02:24:45.684809+0000","last_unstale":"2024-08-17T02:24:46.709507+0000","last_undegraded":"2024-08-17T02:24:46.709507+0000","last_fullsized":"2024-08-17T02:24:46.709507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699050+0000","last_change":"2024-08-17T02:24:46.699050+0000","last_active":"2024-08-17T02:24:46.699050+0000","last_peered":"2024-08-17T02:24:46.699050+0000","last_clean":"2024-08-17T02:24:46.699050+0000","last_became_active":"2024-08-17T02:24:46.697848+0000","last_became_peered":"2024-08-17T02:24:46.697848+0000","last_unstale":"2024-08-17T02:24:46.699050+0000","last_undegraded":"2024-08-17T02:24:46.699050+0000","last_fullsized":"2024-08-17T02:24:46.699050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.684337+0000","last_change":"2024-08-17T02:24:45.696348+0000","last_active":"2024-08-17T02:24:46.684337+0000","last_peered":"2024-08-17T02:24:46.684337+0000","last_clean":"2024-08-17T02:24:46.684337+0000","last_became_active":"2024-08-17T02:24:45.695978+0000","last_became_peered":"2024-08-17T02:24:45.695978+0000","last_unstale":"2024-08-17T02:24:46.684337+0000","last_undegraded":"2024-08-17T02:24:46.684337+0000","last_fullsized":"2024-08-17T02:24:46.684337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698921+0000","last_change":"2024-08-17T02:24:46.698921+0000","last_active":"2024-08-17T02:24:46.698921+0000","last_peered":"2024-08-17T02:24:46.698921+0000","last_clean":"2024-08-17T02:24:46.698921+0000","last_became_active":"2024-08-17T02:24:46.698688+0000","last_became_peered":"2024-08-17T02:24:46.698688+0000","last_unstale":"2024-08-17T02:24:46.698921+0000","last_undegraded":"2024-08-17T02:24:46.698921+0000","last_fullsized":"2024-08-17T02:24:46.698921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:37.590898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701719+0000","last_change":"2024-08-17T02:24:45.699315+0000","last_active":"2024-08-17T02:24:46.701719+0000","last_peered":"2024-08-17T02:24:46.701719+0000","last_clean":"2024-08-17T02:24:46.701719+0000","last_became_active":"2024-08-17T02:24:45.698964+0000","last_became_peered":"2024-08-17T02:24:45.698964+0000","last_unstale":"2024-08-17T02:24:46.701719+0000","last_undegraded":"2024-08-17T02:24:46.701719+0000","last_fullsized":"2024-08-17T02:24:46.701719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696697+0000","last_change":"2024-08-17T02:24:46.696697+0000","last_active":"2024-08-17T02:24:46.696697+0000","last_peered":"2024-08-17T02:24:46.696697+0000","last_clean":"2024-08-17T02:24:46.696697+0000","last_became_active":"2024-08-17T02:24:46.696387+0000","last_became_peered":"2024-08-17T02:24:46.696387+0000","last_unstale":"2024-08-17T02:24:46.696697+0000","last_undegraded":"2024-08-17T02:24:46.696697+0000","last_fullsized":"2024-08-17T02:24:46.696697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693896+0000","last_change":"2024-08-17T02:24:45.693896+0000","last_active":"2024-08-17T02:24:45.693896+0000","last_peered":"2024-08-17T02:24:45.693896+0000","last_clean":"2024-08-17T02:24:45.693896+0000","last_became_active":"2024-08-17T02:24:45.693694+0000","last_became_peered":"2024-08-17T02:24:45.693694+0000","last_unstale":"2024-08-17T02:24:45.693896+0000","last_undegraded":"2024-08-17T02:24:45.693896+0000","last_fullsized":"2024-08-17T02:24:45.693896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:25.447726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695064+0000","last_change":"2024-08-17T02:24:46.695064+0000","last_active":"2024-08-17T02:24:46.695064+0000","last_peered":"2024-08-17T02:24:46.695064+0000","last_clean":"2024-08-17T02:24:46.695064+0000","last_became_active":"2024-08-17T02:24:46.694303+0000","last_became_peered":"2024-08-17T02:24:46.694303+0000","last_unstale":"2024-08-17T02:24:46.695064+0000","last_undegraded":"2024-08-17T02:24:46.695064+0000","last_fullsized":"2024-08-17T02:24:46.695064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.695865+0000","last_change":"2024-08-17T02:24:45.693363+0000","last_active":"2024-08-17T02:24:45.695865+0000","last_peered":"2024-08-17T02:24:45.695865+0000","last_clean":"2024-08-17T02:24:45.695865+0000","last_became_active":"2024-08-17T02:24:45.693114+0000","last_became_peered":"2024-08-17T02:24:45.693114+0000","last_unstale":"2024-08-17T02:24:45.695865+0000","last_undegraded":"2024-08-17T02:24:45.695865+0000","last_fullsized":"2024-08-17T02:24:45.695865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703793+0000","last_change":"2024-08-17T02:24:46.703793+0000","last_active":"2024-08-17T02:24:46.703793+0000","last_peered":"2024-08-17T02:24:46.703793+0000","last_clean":"2024-08-17T02:24:46.703793+0000","last_became_active":"2024-08-17T02:24:46.703493+0000","last_became_peered":"2024-08-17T02:24:46.703493+0000","last_unstale":"2024-08-17T02:24:46.703793+0000","last_undegraded":"2024-08-17T02:24:46.703793+0000","last_fullsized":"2024-08-17T02:24:46.703793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.681783+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:24:45.681783+0000","last_peered":"2024-08-17T02:24:45.681783+0000","last_clean":"2024-08-17T02:24:45.681783+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:24:45.681783+0000","last_undegraded":"2024-08-17T02:24:45.681783+0000","last_fullsized":"2024-08-17T02:24:45.681783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.690926+0000","last_change":"2024-08-17T02:24:45.684657+0000","last_active":"2024-08-17T02:24:45.690926+0000","last_peered":"2024-08-17T02:24:45.690926+0000","last_clean":"2024-08-17T02:24:45.690926+0000","last_became_active":"2024-08-17T02:24:45.683930+0000","last_became_peered":"2024-08-17T02:24:45.683930+0000","last_unstale":"2024-08-17T02:24:45.690926+0000","last_undegraded":"2024-08-17T02:24:45.690926+0000","last_fullsized":"2024-08-17T02:24:45.690926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690032+0000","last_change":"2024-08-17T02:24:46.690032+0000","last_active":"2024-08-17T02:24:46.690032+0000","last_peered":"2024-08-17T02:24:46.690032+0000","last_clean":"2024-08-17T02:24:46.690032+0000","last_became_active":"2024-08-17T02:24:46.689692+0000","last_became_peered":"2024-08-17T02:24:46.689692+0000","last_unstale":"2024-08-17T02:24:46.690032+0000","last_undegraded":"2024-08-17T02:24:46.690032+0000","last_fullsized":"2024-08-17T02:24:46.690032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:49.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.696106+0000","last_change":"2024-08-17T02:24:45.695195+0000","last_active":"2024-08-17T02:24:45.696106+0000","last_peered":"2024-08-17T02:24:45.696106+0000","last_clean":"2024-08-17T02:24:45.696106+0000","last_became_active":"2024-08-17T02:24:45.694908+0000","last_became_peered":"2024-08-17T02:24:45.694908+0000","last_unstale":"2024-08-17T02:24:45.696106+0000","last_undegraded":"2024-08-17T02:24:45.696106+0000","last_fullsized":"2024-08-17T02:24:45.696106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698400+0000","last_change":"2024-08-17T02:24:46.698400+0000","last_active":"2024-08-17T02:24:46.698400+0000","last_peered":"2024-08-17T02:24:46.698400+0000","last_clean":"2024-08-17T02:24:46.698400+0000","last_became_active":"2024-08-17T02:24:46.697641+0000","last_became_peered":"2024-08-17T02:24:46.697641+0000","last_unstale":"2024-08-17T02:24:46.698400+0000","last_undegraded":"2024-08-17T02:24:46.698400+0000","last_fullsized":"2024-08-17T02:24:46.698400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.701104+0000","last_change":"2024-08-17T02:24:45.696585+0000","last_active":"2024-08-17T02:24:45.701104+0000","last_peered":"2024-08-17T02:24:45.701104+0000","last_clean":"2024-08-17T02:24:45.701104+0000","last_became_active":"2024-08-17T02:24:45.696243+0000","last_became_peered":"2024-08-17T02:24:45.696243+0000","last_unstale":"2024-08-17T02:24:45.701104+0000","last_undegraded":"2024-08-17T02:24:45.701104+0000","last_fullsized":"2024-08-17T02:24:45.701104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.685570+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:17.216750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692732+0000","last_change":"2024-08-17T02:24:45.689974+0000","last_active":"2024-08-17T02:24:45.692732+0000","last_peered":"2024-08-17T02:24:45.692732+0000","last_clean":"2024-08-17T02:24:45.692732+0000","last_became_active":"2024-08-17T02:24:45.689686+0000","last_became_peered":"2024-08-17T02:24:45.689686+0000","last_unstale":"2024-08-17T02:24:45.692732+0000","last_undegraded":"2024-08-17T02:24:45.692732+0000","last_fullsized":"2024-08-17T02:24:45.692732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:02.113673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695491+0000","last_change":"2024-08-17T02:24:46.695491+0000","last_active":"2024-08-17T02:24:46.695491+0000","last_peered":"2024-08-17T02:24:46.695491+0000","last_clean":"2024-08-17T02:24:46.695491+0000","last_became_active":"2024-08-17T02:24:46.694910+0000","last_became_peered":"2024-08-17T02:24:46.694910+0000","last_unstale":"2024-08-17T02:24:46.695491+0000","last_undegraded":"2024-08-17T02:24:46.695491+0000","last_fullsized":"2024-08-17T02:24:46.695491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:17.309712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693494+0000","last_change":"2024-08-17T02:24:45.693494+0000","last_active":"2024-08-17T02:24:45.693494+0000","last_peered":"2024-08-17T02:24:45.693494+0000","last_clean":"2024-08-17T02:24:45.693494+0000","last_became_active":"2024-08-17T02:24:45.691399+0000","last_became_peered":"2024-08-17T02:24:45.691399+0000","last_unstale":"2024-08-17T02:24:45.693494+0000","last_undegraded":"2024-08-17T02:24:45.693494+0000","last_fullsized":"2024-08-17T02:24:45.693494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:47.538687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697272+0000","last_change":"2024-08-17T02:24:46.697272+0000","last_active":"2024-08-17T02:24:46.697272+0000","last_peered":"2024-08-17T02:24:46.697272+0000","last_clean":"2024-08-17T02:24:46.697272+0000","last_became_active":"2024-08-17T02:24:46.696866+0000","last_became_peered":"2024-08-17T02:24:46.696866+0000","last_unstale":"2024-08-17T02:24:46.697272+0000","last_undegraded":"2024-08-17T02:24:46.697272+0000","last_fullsized":"2024-08-17T02:24:46.697272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692661+0000","last_change":"2024-08-17T02:24:45.689340+0000","last_active":"2024-08-17T02:24:45.692661+0000","last_peered":"2024-08-17T02:24:45.692661+0000","last_clean":"2024-08-17T02:24:45.692661+0000","last_became_active":"2024-08-17T02:24:45.687263+0000","last_became_peered":"2024-08-17T02:24:45.687263+0000","last_unstale":"2024-08-17T02:24:45.692661+0000","last_undegraded":"2024-08-17T02:24:45.692661+0000","last_fullsized":"2024-08-17T02:24:45.692661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.687663+0000","last_change":"2024-08-17T02:24:46.687663+0000","last_active":"2024-08-17T02:24:46.687663+0000","last_peered":"2024-08-17T02:24:46.687663+0000","last_clean":"2024-08-17T02:24:46.687663+0000","last_became_active":"2024-08-17T02:24:46.687285+0000","last_became_peered":"2024-08-17T02:24:46.687285+0000","last_unstale":"2024-08-17T02:24:46.687663+0000","last_undegraded":"2024-08-17T02:24:46.687663+0000","last_fullsized":"2024-08-17T02:24:46.687663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.695885+0000","last_change":"2024-08-17T02:24:45.692340+0000","last_active":"2024-08-17T02:24:45.695885+0000","last_peered":"2024-08-17T02:24:45.695885+0000","last_clean":"2024-08-17T02:24:45.695885+0000","last_became_active":"2024-08-17T02:24:45.691959+0000","last_became_peered":"2024-08-17T02:24:45.691959+0000","last_unstale":"2024-08-17T02:24:45.695885+0000","last_undegraded":"2024-08-17T02:24:45.695885+0000","last_fullsized":"2024-08-17T02:24:45.695885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699671+0000","last_change":"2024-08-17T02:24:46.699671+0000","last_active":"2024-08-17T02:24:46.699671+0000","last_peered":"2024-08-17T02:24:46.699671+0000","last_clean":"2024-08-17T02:24:46.699671+0000","last_became_active":"2024-08-17T02:24:46.699384+0000","last_became_peered":"2024-08-17T02:24:46.699384+0000","last_unstale":"2024-08-17T02:24:46.699671+0000","last_undegraded":"2024-08-17T02:24:46.699671+0000","last_fullsized":"2024-08-17T02:24:46.699671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706478+0000","last_change":"2024-08-17T02:24:45.689016+0000","last_active":"2024-08-17T02:24:46.706478+0000","last_peered":"2024-08-17T02:24:46.706478+0000","last_clean":"2024-08-17T02:24:46.706478+0000","last_became_active":"2024-08-17T02:24:45.688568+0000","last_became_peered":"2024-08-17T02:24:45.688568+0000","last_unstale":"2024-08-17T02:24:46.706478+0000","last_undegraded":"2024-08-17T02:24:46.706478+0000","last_fullsized":"2024-08-17T02:24:46.706478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:31.920700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690217+0000","last_change":"2024-08-17T02:24:46.690217+0000","last_active":"2024-08-17T02:24:46.690217+0000","last_peered":"2024-08-17T02:24:46.690217+0000","last_clean":"2024-08-17T02:24:46.690217+0000","last_became_active":"2024-08-17T02:24:46.689945+0000","last_became_peered":"2024-08-17T02:24:46.689945+0000","last_unstale":"2024-08-17T02:24:46.690217+0000","last_undegraded":"2024-08-17T02:24:46.690217+0000","last_fullsized":"2024-08-17T02:24:46.690217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.696490+0000","last_change":"2024-08-17T02:24:45.692162+0000","last_active":"2024-08-17T02:24:45.696490+0000","last_peered":"2024-08-17T02:24:45.696490+0000","last_clean":"2024-08-17T02:24:45.696490+0000","last_became_active":"2024-08-17T02:24:45.691864+0000","last_became_peered":"2024-08-17T02:24:45.691864+0000","last_unstale":"2024-08-17T02:24:45.696490+0000","last_undegraded":"2024-08-17T02:24:45.696490+0000","last_fullsized":"2024-08-17T02:24:45.696490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693752+0000","last_change":"2024-08-17T02:24:46.693752+0000","last_active":"2024-08-17T02:24:46.693752+0000","last_peered":"2024-08-17T02:24:46.693752+0000","last_clean":"2024-08-17T02:24:46.693752+0000","last_became_active":"2024-08-17T02:24:46.693452+0000","last_became_peered":"2024-08-17T02:24:46.693452+0000","last_unstale":"2024-08-17T02:24:46.693752+0000","last_undegraded":"2024-08-17T02:24:46.693752+0000","last_fullsized":"2024-08-17T02:24:46.693752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.504743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.698413+0000","last_change":"2024-08-17T02:24:45.695549+0000","last_active":"2024-08-17T02:24:45.698413+0000","last_peered":"2024-08-17T02:24:45.698413+0000","last_clean":"2024-08-17T02:24:45.698413+0000","last_became_active":"2024-08-17T02:24:45.695270+0000","last_became_peered":"2024-08-17T02:24:45.695270+0000","last_unstale":"2024-08-17T02:24:45.698413+0000","last_undegraded":"2024-08-17T02:24:45.698413+0000","last_fullsized":"2024-08-17T02:24:45.698413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.689650+0000","last_change":"2024-08-17T02:24:46.689650+0000","last_active":"2024-08-17T02:24:46.689650+0000","last_peered":"2024-08-17T02:24:46.689650+0000","last_clean":"2024-08-17T02:24:46.689650+0000","last_became_active":"2024-08-17T02:24:46.689361+0000","last_became_peered":"2024-08-17T02:24:46.689361+0000","last_unstale":"2024-08-17T02:24:46.689650+0000","last_undegraded":"2024-08-17T02:24:46.689650+0000","last_fullsized":"2024-08-17T02:24:46.689650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692092+0000","last_change":"2024-08-17T02:24:45.688479+0000","last_active":"2024-08-17T02:24:45.692092+0000","last_peered":"2024-08-17T02:24:45.692092+0000","last_clean":"2024-08-17T02:24:45.692092+0000","last_became_active":"2024-08-17T02:24:45.688105+0000","last_became_peered":"2024-08-17T02:24:45.688105+0000","last_unstale":"2024-08-17T02:24:45.692092+0000","last_undegraded":"2024-08-17T02:24:45.692092+0000","last_fullsized":"2024-08-17T02:24:45.692092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693894+0000","last_change":"2024-08-17T02:24:46.693894+0000","last_active":"2024-08-17T02:24:46.693894+0000","last_peered":"2024-08-17T02:24:46.693894+0000","last_clean":"2024-08-17T02:24:46.693894+0000","last_became_active":"2024-08-17T02:24:46.693611+0000","last_became_peered":"2024-08-17T02:24:46.693611+0000","last_unstale":"2024-08-17T02:24:46.693894+0000","last_undegraded":"2024-08-17T02:24:46.693894+0000","last_fullsized":"2024-08-17T02:24:46.693894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706309+0000","last_change":"2024-08-17T02:24:45.684136+0000","last_active":"2024-08-17T02:24:46.706309+0000","last_peered":"2024-08-17T02:24:46.706309+0000","last_clean":"2024-08-17T02:24:46.706309+0000","last_became_active":"2024-08-17T02:24:45.683723+0000","last_became_peered":"2024-08-17T02:24:45.683723+0000","last_unstale":"2024-08-17T02:24:46.706309+0000","last_undegraded":"2024-08-17T02:24:46.706309+0000","last_fullsized":"2024-08-17T02:24:46.706309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691308+0000","last_change":"2024-08-17T02:24:46.691308+0000","last_active":"2024-08-17T02:24:46.691308+0000","last_peered":"2024-08-17T02:24:46.691308+0000","last_clean":"2024-08-17T02:24:46.691308+0000","last_became_active":"2024-08-17T02:24:46.691046+0000","last_became_peered":"2024-08-17T02:24:46.691046+0000","last_unstale":"2024-08-17T02:24:46.691308+0000","last_undegraded":"2024-08-17T02:24:46.691308+0000","last_fullsized":"2024-08-17T02:24:46.691308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699150+0000","last_change":"2024-08-17T02:24:46.699150+0000","last_active":"2024-08-17T02:24:46.699150+0000","last_peered":"2024-08-17T02:24:46.699150+0000","last_clean":"2024-08-17T02:24:46.699150+0000","last_became_active":"2024-08-17T02:24:46.697504+0000","last_became_peered":"2024-08-17T02:24:46.697504+0000","last_unstale":"2024-08-17T02:24:46.699150+0000","last_undegraded":"2024-08-17T02:24:46.699150+0000","last_fullsized":"2024-08-17T02:24:46.699150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710964+0000","last_change":"2024-08-17T02:24:45.690864+0000","last_active":"2024-08-17T02:24:46.710964+0000","last_peered":"2024-08-17T02:24:46.710964+0000","last_clean":"2024-08-17T02:24:46.710964+0000","last_became_active":"2024-08-17T02:24:45.687405+0000","last_became_peered":"2024-08-17T02:24:45.687405+0000","last_unstale":"2024-08-17T02:24:46.710964+0000","last_undegraded":"2024-08-17T02:24:46.710964+0000","last_fullsized":"2024-08-17T02:24:46.710964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702644+0000","last_change":"2024-08-17T02:24:46.702644+0000","last_active":"2024-08-17T02:24:46.702644+0000","last_peered":"2024-08-17T02:24:46.702644+0000","last_clean":"2024-08-17T02:24:46.702644+0000","last_became_active":"2024-08-17T02:24:46.701576+0000","last_became_peered":"2024-08-17T02:24:46.701576+0000","last_unstale":"2024-08-17T02:24:46.702644+0000","last_undegraded":"2024-08-17T02:24:46.702644+0000","last_fullsized":"2024-08-17T02:24:46.702644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:12.393424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710485+0000","last_change":"2024-08-17T02:24:45.689395+0000","last_active":"2024-08-17T02:24:46.710485+0000","last_peered":"2024-08-17T02:24:46.710485+0000","last_clean":"2024-08-17T02:24:46.710485+0000","last_became_active":"2024-08-17T02:24:45.689082+0000","last_became_peered":"2024-08-17T02:24:45.689082+0000","last_unstale":"2024-08-17T02:24:46.710485+0000","last_undegraded":"2024-08-17T02:24:46.710485+0000","last_fullsized":"2024-08-17T02:24:46.710485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.685140+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:42.849100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.687064+0000","last_change":"2024-08-17T02:24:45.687064+0000","last_active":"2024-08-17T02:24:45.687064+0000","last_peered":"2024-08-17T02:24:45.687064+0000","last_clean":"2024-08-17T02:24:45.687064+0000","last_became_active":"2024-08-17T02:24:45.686543+0000","last_became_peered":"2024-08-17T02:24:45.686543+0000","last_unstale":"2024-08-17T02:24:45.687064+0000","last_undegraded":"2024-08-17T02:24:45.687064+0000","last_fullsized":"2024-08-17T02:24:45.687064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:47.125586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683230+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:27.265830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708733+0000","last_change":"2024-08-17T02:24:45.687257+0000","last_active":"2024-08-17T02:24:46.708733+0000","last_peered":"2024-08-17T02:24:46.708733+0000","last_clean":"2024-08-17T02:24:46.708733+0000","last_became_active":"2024-08-17T02:24:45.686911+0000","last_became_peered":"2024-08-17T02:24:45.686911+0000","last_unstale":"2024-08-17T02:24:46.708733+0000","last_undegraded":"2024-08-17T02:24:46.708733+0000","last_fullsized":"2024-08-17T02:24:46.708733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2268,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":74467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":74343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":241664,"data_stored":76555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":74913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":75895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":819200,"data_stored":664781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":74399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":802816,"data_stored":657948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:50.090 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:50.198 INFO:tasks.ceph.mds.c.smithi031.stderr:2024-08-17T02:24:50.190+0000 7f8467524700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:24:50.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 Processor -- start 2024-08-17T02:24:50.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 -- start start 2024-08-17T02:24:50.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40680aed20 0x7f40680afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f40680b0060 0x7f4068160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40680b04a0 con 0x7f4068140aa0 2024-08-17T02:24:50.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40680b29f0 con 0x7f40680b0060 2024-08-17T02:24:50.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40680b2cd0 con 0x7f40680aed20 2024-08-17T02:24:50.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406ebde700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f40680b0060 0x7f4068160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406ebde700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f40680b0060 0x7f4068160dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56550/0 (socket says 172.21.15.31:56550) 2024-08-17T02:24:50.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406ebde700 1 -- 172.21.15.31:0/3337817320 learned_addr learned my addr 172.21.15.31:0/3337817320 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:50.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406dbdc700 1 --2- 172.21.15.31:0/3337817320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40680aed20 0x7f40680afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406ebde700 1 -- 172.21.15.31:0/3337817320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40680aed20 msgr2=0x7f40680afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:50.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406ebde700 1 --2- 172.21.15.31:0/3337817320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40680aed20 0x7f40680afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406ebde700 1 -- 172.21.15.31:0/3337817320 >> v1:172.21.15.92:6789/0 conn(0x7f4068140aa0 legacy=0x7f40680b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406ebde700 1 -- 172.21.15.31:0/3337817320 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680b2fb0 con 0x7f40680b0060 2024-08-17T02:24:50.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406ebde700 1 --2- 172.21.15.31:0/3337817320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40680b0060 0x7f4068160dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4060009f20 tx=0x7f4060009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85a27adcc61011f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:50.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406d3db700 1 -- 172.21.15.31:0/3337817320 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406000e070 con 0x7f40680b0060 2024-08-17T02:24:50.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406d3db700 1 -- 172.21.15.31:0/3337817320 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406000b9d0 con 0x7f40680b0060 2024-08-17T02:24:50.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f406d3db700 1 -- 172.21.15.31:0/3337817320 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600092e0 con 0x7f40680b0060 2024-08-17T02:24:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 -- 172.21.15.31:0/3337817320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40680b0060 msgr2=0x7f4068160dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 --2- 172.21.15.31:0/3337817320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40680b0060 0x7f4068160dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4060009f20 tx=0x7f4060009840 comp rx=0 tx=0).stop 2024-08-17T02:24:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 -- 172.21.15.31:0/3337817320 shutdown_connections 2024-08-17T02:24:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 --2- 172.21.15.31:0/3337817320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40680b0060 0x7f4068160dd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 --2- 172.21.15.31:0/3337817320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40680aed20 0x7f40680afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 -- 172.21.15.31:0/3337817320 >> 172.21.15.31:0/3337817320 conn(0x7f4068067400 msgr2=0x7f40680677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 -- 172.21.15.31:0/3337817320 shutdown_connections 2024-08-17T02:24:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.194+0000 7f4070641700 1 -- 172.21.15.31:0/3337817320 wait complete. 2024-08-17T02:24:50.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f4070641700 1 Processor -- start 2024-08-17T02:24:50.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f4070641700 1 -- start start 2024-08-17T02:24:50.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f4070641700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40680aed20 0x7f40680c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f4070641700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40680b0060 0x7f40680ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f4070641700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4068140aa0 0x7f40680cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f4070641700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40680ca960 con 0x7f4068140aa0 2024-08-17T02:24:50.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f4070641700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40680c4710 con 0x7f40680b0060 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f4070641700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40680cab70 con 0x7f40680aed20 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406ebde700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4068140aa0 0x7f40680cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406ebde700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4068140aa0 0x7f40680cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56564/0 (socket says 172.21.15.31:56564) 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406ebde700 1 -- 172.21.15.31:0/3591302999 learned_addr learned my addr 172.21.15.31:0/3591302999 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406dbdc700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40680b0060 0x7f40680ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406e3dd700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40680aed20 0x7f40680c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406ebde700 1 -- 172.21.15.31:0/3591302999 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40680aed20 msgr2=0x7f40680c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406ebde700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40680aed20 0x7f40680c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406ebde700 1 -- 172.21.15.31:0/3591302999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40680b0060 msgr2=0x7f40680ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406ebde700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40680b0060 0x7f40680ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406ebde700 1 -- 172.21.15.31:0/3591302999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4060009ae0 con 0x7f4068140aa0 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f406ebde700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4068140aa0 0x7f40680cd1f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4068070b00 tx=0x7f4060018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:50.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f405e7fc700 1 -- 172.21.15.31:0/3591302999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060008c70 con 0x7f4068140aa0 2024-08-17T02:24:50.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f405e7fc700 1 -- 172.21.15.31:0/3591302999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4060008e10 con 0x7f4068140aa0 2024-08-17T02:24:50.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f4070641700 1 -- 172.21.15.31:0/3591302999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40680c3de0 con 0x7f4068140aa0 2024-08-17T02:24:50.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f405e7fc700 1 -- 172.21.15.31:0/3591302999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600266b0 con 0x7f4068140aa0 2024-08-17T02:24:50.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.198+0000 7f4070641700 1 -- 172.21.15.31:0/3591302999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40680c43a0 con 0x7f4068140aa0 2024-08-17T02:24:50.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.202+0000 7f4070641700 1 -- 172.21.15.31:0/3591302999 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40680712b0 con 0x7f4068140aa0 2024-08-17T02:24:50.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.202+0000 7f405e7fc700 1 -- 172.21.15.31:0/3591302999 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4060003040 con 0x7f4068140aa0 2024-08-17T02:24:50.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.202+0000 7f405e7fc700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f404c060860 0x7f404c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.202+0000 7f405e7fc700 1 -- 172.21.15.31:0/3591302999 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f406007ed20 con 0x7f4068140aa0 2024-08-17T02:24:50.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.202+0000 7f406e3dd700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f404c060860 0x7f404c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.202+0000 7f406e3dd700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f404c060860 0x7f404c062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f40680b0630 tx=0x7f4064009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:50.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.210+0000 7f405e7fc700 1 -- 172.21.15.31:0/3591302999 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f406004f0d0 con 0x7f4068140aa0 2024-08-17T02:24:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.386+0000 7f4070641700 1 -- 172.21.15.31:0/3591302999 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40680c4850 con 0x7f404c060860 2024-08-17T02:24:50.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.398+0000 7f405e7fc700 1 -- 172.21.15.31:0/3591302999 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264001 (secure 0 0 0) 0x7f40680c4850 con 0x7f404c060860 2024-08-17T02:24:50.409 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:50.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 -- 172.21.15.31:0/3591302999 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f404c060860 msgr2=0x7f404c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f404c060860 0x7f404c062d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f40680b0630 tx=0x7f4064009040 comp rx=0 tx=0).stop 2024-08-17T02:24:50.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 -- 172.21.15.31:0/3591302999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4068140aa0 msgr2=0x7f40680cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4068140aa0 0x7f40680cd1f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4068070b00 tx=0x7f4060018000 comp rx=0 tx=0).stop 2024-08-17T02:24:50.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 -- 172.21.15.31:0/3591302999 shutdown_connections 2024-08-17T02:24:50.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f404c060860 0x7f404c062d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4068140aa0 0x7f40680cd1f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40680b0060 0x7f40680ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 --2- 172.21.15.31:0/3591302999 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f40680aed20 0x7f40680c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 -- 172.21.15.31:0/3591302999 >> 172.21.15.31:0/3591302999 conn(0x7f4068067400 msgr2=0x7f406815a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:50.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 -- 172.21.15.31:0/3591302999 shutdown_connections 2024-08-17T02:24:50.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.402+0000 7f4070641700 1 -- 172.21.15.31:0/3591302999 wait complete. 2024-08-17T02:24:50.412 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:24:50.421 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:24:49.582877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592636,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381804,"kb_used_data":2932,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592916,"statfs":{"total":773094113280,"available":770655145984,"internally_reserved":0,"allocated":3002368,"data_stored":1773301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2268,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.927145"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711137+0000","last_change":"2024-08-17T02:24:46.711137+0000","last_active":"2024-08-17T02:24:46.711137+0000","last_peered":"2024-08-17T02:24:46.711137+0000","last_clean":"2024-08-17T02:24:46.711137+0000","last_became_active":"2024-08-17T02:24:46.710820+0000","last_became_peered":"2024-08-17T02:24:46.710820+0000","last_unstale":"2024-08-17T02:24:46.711137+0000","last_undegraded":"2024-08-17T02:24:46.711137+0000","last_fullsized":"2024-08-17T02:24:46.711137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.684833+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683020+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:15.827101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702343+0000","last_change":"2024-08-17T02:24:46.702343+0000","last_active":"2024-08-17T02:24:46.702343+0000","last_peered":"2024-08-17T02:24:46.702343+0000","last_clean":"2024-08-17T02:24:46.702343+0000","last_became_active":"2024-08-17T02:24:46.700536+0000","last_became_peered":"2024-08-17T02:24:46.700536+0000","last_unstale":"2024-08-17T02:24:46.702343+0000","last_undegraded":"2024-08-17T02:24:46.702343+0000","last_fullsized":"2024-08-17T02:24:46.702343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697977+0000","last_change":"2024-08-17T02:24:46.697977+0000","last_active":"2024-08-17T02:24:46.697977+0000","last_peered":"2024-08-17T02:24:46.697977+0000","last_clean":"2024-08-17T02:24:46.697977+0000","last_became_active":"2024-08-17T02:24:46.697680+0000","last_became_peered":"2024-08-17T02:24:46.697680+0000","last_unstale":"2024-08-17T02:24:46.697977+0000","last_undegraded":"2024-08-17T02:24:46.697977+0000","last_fullsized":"2024-08-17T02:24:46.697977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696070+0000","last_change":"2024-08-17T02:24:46.696070+0000","last_active":"2024-08-17T02:24:46.696070+0000","last_peered":"2024-08-17T02:24:46.696070+0000","last_clean":"2024-08-17T02:24:46.696070+0000","last_became_active":"2024-08-17T02:24:46.693809+0000","last_became_peered":"2024-08-17T02:24:46.693809+0000","last_unstale":"2024-08-17T02:24:46.696070+0000","last_undegraded":"2024-08-17T02:24:46.696070+0000","last_fullsized":"2024-08-17T02:24:46.696070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694034+0000","last_change":"2024-08-17T02:24:46.694034+0000","last_active":"2024-08-17T02:24:46.694034+0000","last_peered":"2024-08-17T02:24:46.694034+0000","last_clean":"2024-08-17T02:24:46.694034+0000","last_became_active":"2024-08-17T02:24:46.693720+0000","last_became_peered":"2024-08-17T02:24:46.693720+0000","last_unstale":"2024-08-17T02:24:46.694034+0000","last_undegraded":"2024-08-17T02:24:46.694034+0000","last_fullsized":"2024-08-17T02:24:46.694034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:25.120018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.687014+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:10.973372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710805+0000","last_change":"2024-08-17T02:24:46.710805+0000","last_active":"2024-08-17T02:24:46.710805+0000","last_peered":"2024-08-17T02:24:46.710805+0000","last_clean":"2024-08-17T02:24:46.710805+0000","last_became_active":"2024-08-17T02:24:46.710510+0000","last_became_peered":"2024-08-17T02:24:46.710510+0000","last_unstale":"2024-08-17T02:24:46.710805+0000","last_undegraded":"2024-08-17T02:24:46.710805+0000","last_fullsized":"2024-08-17T02:24:46.710805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695508+0000","last_change":"2024-08-17T02:24:46.695508+0000","last_active":"2024-08-17T02:24:46.695508+0000","last_peered":"2024-08-17T02:24:46.695508+0000","last_clean":"2024-08-17T02:24:46.695508+0000","last_became_active":"2024-08-17T02:24:46.695174+0000","last_became_peered":"2024-08-17T02:24:46.695174+0000","last_unstale":"2024-08-17T02:24:46.695508+0000","last_undegraded":"2024-08-17T02:24:46.695508+0000","last_fullsized":"2024-08-17T02:24:46.695508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:26.358220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711058+0000","last_change":"2024-08-17T02:24:46.711058+0000","last_active":"2024-08-17T02:24:46.711058+0000","last_peered":"2024-08-17T02:24:46.711058+0000","last_clean":"2024-08-17T02:24:46.711058+0000","last_became_active":"2024-08-17T02:24:46.710739+0000","last_became_peered":"2024-08-17T02:24:46.710739+0000","last_unstale":"2024-08-17T02:24:46.711058+0000","last_undegraded":"2024-08-17T02:24:46.711058+0000","last_fullsized":"2024-08-17T02:24:46.711058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695791+0000","last_change":"2024-08-17T02:24:46.695791+0000","last_active":"2024-08-17T02:24:46.695791+0000","last_peered":"2024-08-17T02:24:46.695791+0000","last_clean":"2024-08-17T02:24:46.695791+0000","last_became_active":"2024-08-17T02:24:46.695116+0000","last_became_peered":"2024-08-17T02:24:46.695116+0000","last_unstale":"2024-08-17T02:24:46.695791+0000","last_undegraded":"2024-08-17T02:24:46.695791+0000","last_fullsized":"2024-08-17T02:24:46.695791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699896+0000","last_change":"2024-08-17T02:24:46.699896+0000","last_active":"2024-08-17T02:24:46.699896+0000","last_peered":"2024-08-17T02:24:46.699896+0000","last_clean":"2024-08-17T02:24:46.699896+0000","last_became_active":"2024-08-17T02:24:46.699645+0000","last_became_peered":"2024-08-17T02:24:46.699645+0000","last_unstale":"2024-08-17T02:24:46.699896+0000","last_undegraded":"2024-08-17T02:24:46.699896+0000","last_fullsized":"2024-08-17T02:24:46.699896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:36.261958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690505+0000","last_change":"2024-08-17T02:24:46.690505+0000","last_active":"2024-08-17T02:24:46.690505+0000","last_peered":"2024-08-17T02:24:46.690505+0000","last_clean":"2024-08-17T02:24:46.690505+0000","last_became_active":"2024-08-17T02:24:46.690185+0000","last_became_peered":"2024-08-17T02:24:46.690185+0000","last_unstale":"2024-08-17T02:24:46.690505+0000","last_undegraded":"2024-08-17T02:24:46.690505+0000","last_fullsized":"2024-08-17T02:24:46.690505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.684166+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:15.861283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690550+0000","last_change":"2024-08-17T02:24:46.690550+0000","last_active":"2024-08-17T02:24:46.690550+0000","last_peered":"2024-08-17T02:24:46.690550+0000","last_clean":"2024-08-17T02:24:46.690550+0000","last_became_active":"2024-08-17T02:24:46.690231+0000","last_became_peered":"2024-08-17T02:24:46.690231+0000","last_unstale":"2024-08-17T02:24:46.690550+0000","last_undegraded":"2024-08-17T02:24:46.690550+0000","last_fullsized":"2024-08-17T02:24:46.690550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:40:04.175081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703443+0000","last_change":"2024-08-17T02:24:46.703443+0000","last_active":"2024-08-17T02:24:46.703443+0000","last_peered":"2024-08-17T02:24:46.703443+0000","last_clean":"2024-08-17T02:24:46.703443+0000","last_became_active":"2024-08-17T02:24:46.703111+0000","last_became_peered":"2024-08-17T02:24:46.703111+0000","last_unstale":"2024-08-17T02:24:46.703443+0000","last_undegraded":"2024-08-17T02:24:46.703443+0000","last_fullsized":"2024-08-17T02:24:46.703443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695275+0000","last_change":"2024-08-17T02:24:46.695275+0000","last_active":"2024-08-17T02:24:46.695275+0000","last_peered":"2024-08-17T02:24:46.695275+0000","last_clean":"2024-08-17T02:24:46.695275+0000","last_became_active":"2024-08-17T02:24:46.694600+0000","last_became_peered":"2024-08-17T02:24:46.694600+0000","last_unstale":"2024-08-17T02:24:46.695275+0000","last_undegraded":"2024-08-17T02:24:46.695275+0000","last_fullsized":"2024-08-17T02:24:46.695275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703289+0000","last_change":"2024-08-17T02:24:46.703289+0000","last_active":"2024-08-17T02:24:46.703289+0000","last_peered":"2024-08-17T02:24:46.703289+0000","last_clean":"2024-08-17T02:24:46.703289+0000","last_became_active":"2024-08-17T02:24:46.702961+0000","last_became_peered":"2024-08-17T02:24:46.702961+0000","last_unstale":"2024-08-17T02:24:46.703289+0000","last_undegraded":"2024-08-17T02:24:46.703289+0000","last_fullsized":"2024-08-17T02:24:46.703289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:26.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696080+0000","last_change":"2024-08-17T02:24:46.696080+0000","last_active":"2024-08-17T02:24:46.696080+0000","last_peered":"2024-08-17T02:24:46.696080+0000","last_clean":"2024-08-17T02:24:46.696080+0000","last_became_active":"2024-08-17T02:24:46.695753+0000","last_became_peered":"2024-08-17T02:24:46.695753+0000","last_unstale":"2024-08-17T02:24:46.696080+0000","last_undegraded":"2024-08-17T02:24:46.696080+0000","last_fullsized":"2024-08-17T02:24:46.696080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.692695+0000","last_change":"2024-08-17T02:24:46.692695+0000","last_active":"2024-08-17T02:24:46.692695+0000","last_peered":"2024-08-17T02:24:46.692695+0000","last_clean":"2024-08-17T02:24:46.692695+0000","last_became_active":"2024-08-17T02:24:46.691145+0000","last_became_peered":"2024-08-17T02:24:46.691145+0000","last_unstale":"2024-08-17T02:24:46.692695+0000","last_undegraded":"2024-08-17T02:24:46.692695+0000","last_fullsized":"2024-08-17T02:24:46.692695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:25.233681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696761+0000","last_change":"2024-08-17T02:24:46.696761+0000","last_active":"2024-08-17T02:24:46.696761+0000","last_peered":"2024-08-17T02:24:46.696761+0000","last_clean":"2024-08-17T02:24:46.696761+0000","last_became_active":"2024-08-17T02:24:46.695844+0000","last_became_peered":"2024-08-17T02:24:46.695844+0000","last_unstale":"2024-08-17T02:24:46.696761+0000","last_undegraded":"2024-08-17T02:24:46.696761+0000","last_fullsized":"2024-08-17T02:24:46.696761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683038+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:02.907069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.683686+0000","last_change":"2024-08-17T02:24:46.683686+0000","last_active":"2024-08-17T02:24:46.683686+0000","last_peered":"2024-08-17T02:24:46.683686+0000","last_clean":"2024-08-17T02:24:46.683686+0000","last_became_active":"2024-08-17T02:24:46.683416+0000","last_became_peered":"2024-08-17T02:24:46.683416+0000","last_unstale":"2024-08-17T02:24:46.683686+0000","last_undegraded":"2024-08-17T02:24:46.683686+0000","last_fullsized":"2024-08-17T02:24:46.683686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:38.075390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.686371+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:38.994029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707560+0000","last_change":"2024-08-17T02:24:46.707560+0000","last_active":"2024-08-17T02:24:46.707560+0000","last_peered":"2024-08-17T02:24:46.707560+0000","last_clean":"2024-08-17T02:24:46.707560+0000","last_became_active":"2024-08-17T02:24:46.707234+0000","last_became_peered":"2024-08-17T02:24:46.707234+0000","last_unstale":"2024-08-17T02:24:46.707560+0000","last_undegraded":"2024-08-17T02:24:46.707560+0000","last_fullsized":"2024-08-17T02:24:46.707560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:32.930431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691514+0000","last_change":"2024-08-17T02:24:46.691514+0000","last_active":"2024-08-17T02:24:46.691514+0000","last_peered":"2024-08-17T02:24:46.691514+0000","last_clean":"2024-08-17T02:24:46.691514+0000","last_became_active":"2024-08-17T02:24:46.691231+0000","last_became_peered":"2024-08-17T02:24:46.691231+0000","last_unstale":"2024-08-17T02:24:46.691514+0000","last_undegraded":"2024-08-17T02:24:46.691514+0000","last_fullsized":"2024-08-17T02:24:46.691514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698271+0000","last_change":"2024-08-17T02:24:46.698271+0000","last_active":"2024-08-17T02:24:46.698271+0000","last_peered":"2024-08-17T02:24:46.698271+0000","last_clean":"2024-08-17T02:24:46.698271+0000","last_became_active":"2024-08-17T02:24:46.698020+0000","last_became_peered":"2024-08-17T02:24:46.698020+0000","last_unstale":"2024-08-17T02:24:46.698271+0000","last_undegraded":"2024-08-17T02:24:46.698271+0000","last_fullsized":"2024-08-17T02:24:46.698271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:51.758557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.681671+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:33.547382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.684857+0000","last_change":"2024-08-17T02:24:46.684857+0000","last_active":"2024-08-17T02:24:46.684857+0000","last_peered":"2024-08-17T02:24:46.684857+0000","last_clean":"2024-08-17T02:24:46.684857+0000","last_became_active":"2024-08-17T02:24:46.683949+0000","last_became_peered":"2024-08-17T02:24:46.683949+0000","last_unstale":"2024-08-17T02:24:46.684857+0000","last_undegraded":"2024-08-17T02:24:46.684857+0000","last_fullsized":"2024-08-17T02:24:46.684857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:06.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698926+0000","last_change":"2024-08-17T02:24:46.698926+0000","last_active":"2024-08-17T02:24:46.698926+0000","last_peered":"2024-08-17T02:24:46.698926+0000","last_clean":"2024-08-17T02:24:46.698926+0000","last_became_active":"2024-08-17T02:24:46.698650+0000","last_became_peered":"2024-08-17T02:24:46.698650+0000","last_unstale":"2024-08-17T02:24:46.698926+0000","last_undegraded":"2024-08-17T02:24:46.698926+0000","last_fullsized":"2024-08-17T02:24:46.698926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697443+0000","last_change":"2024-08-17T02:24:46.697443+0000","last_active":"2024-08-17T02:24:46.697443+0000","last_peered":"2024-08-17T02:24:46.697443+0000","last_clean":"2024-08-17T02:24:46.697443+0000","last_became_active":"2024-08-17T02:24:46.696404+0000","last_became_peered":"2024-08-17T02:24:46.696404+0000","last_unstale":"2024-08-17T02:24:46.697443+0000","last_undegraded":"2024-08-17T02:24:46.697443+0000","last_fullsized":"2024-08-17T02:24:46.697443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701561+0000","last_change":"2024-08-17T02:24:46.701561+0000","last_active":"2024-08-17T02:24:46.701561+0000","last_peered":"2024-08-17T02:24:46.701561+0000","last_clean":"2024-08-17T02:24:46.701561+0000","last_became_active":"2024-08-17T02:24:46.696208+0000","last_became_peered":"2024-08-17T02:24:46.696208+0000","last_unstale":"2024-08-17T02:24:46.701561+0000","last_undegraded":"2024-08-17T02:24:46.701561+0000","last_fullsized":"2024-08-17T02:24:46.701561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693597+0000","last_change":"2024-08-17T02:24:45.693597+0000","last_active":"2024-08-17T02:24:45.693597+0000","last_peered":"2024-08-17T02:24:45.693597+0000","last_clean":"2024-08-17T02:24:45.693597+0000","last_became_active":"2024-08-17T02:24:45.692136+0000","last_became_peered":"2024-08-17T02:24:45.692136+0000","last_unstale":"2024-08-17T02:24:45.693597+0000","last_undegraded":"2024-08-17T02:24:45.693597+0000","last_fullsized":"2024-08-17T02:24:45.693597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:51.770625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700557+0000","last_change":"2024-08-17T02:24:46.700557+0000","last_active":"2024-08-17T02:24:46.700557+0000","last_peered":"2024-08-17T02:24:46.700557+0000","last_clean":"2024-08-17T02:24:46.700557+0000","last_became_active":"2024-08-17T02:24:46.700114+0000","last_became_peered":"2024-08-17T02:24:46.700114+0000","last_unstale":"2024-08-17T02:24:46.700557+0000","last_undegraded":"2024-08-17T02:24:46.700557+0000","last_fullsized":"2024-08-17T02:24:46.700557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673565+0000","last_change":"2024-08-17T02:24:45.685965+0000","last_active":"2024-08-17T02:24:46.673565+0000","last_peered":"2024-08-17T02:24:46.673565+0000","last_clean":"2024-08-17T02:24:46.673565+0000","last_became_active":"2024-08-17T02:24:45.685019+0000","last_became_peered":"2024-08-17T02:24:45.685019+0000","last_unstale":"2024-08-17T02:24:46.673565+0000","last_undegraded":"2024-08-17T02:24:46.673565+0000","last_fullsized":"2024-08-17T02:24:46.673565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:33.322093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.701270+0000","last_change":"2024-08-17T02:24:45.695657+0000","last_active":"2024-08-17T02:24:45.701270+0000","last_peered":"2024-08-17T02:24:45.701270+0000","last_clean":"2024-08-17T02:24:45.701270+0000","last_became_active":"2024-08-17T02:24:45.695337+0000","last_became_peered":"2024-08-17T02:24:45.695337+0000","last_unstale":"2024-08-17T02:24:45.701270+0000","last_undegraded":"2024-08-17T02:24:45.701270+0000","last_fullsized":"2024-08-17T02:24:45.701270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.680939+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:20:35.140243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.686595+0000","last_change":"2024-08-17T02:24:45.683302+0000","last_active":"2024-08-17T02:24:45.686595+0000","last_peered":"2024-08-17T02:24:45.686595+0000","last_clean":"2024-08-17T02:24:45.686595+0000","last_became_active":"2024-08-17T02:24:45.682641+0000","last_became_peered":"2024-08-17T02:24:45.682641+0000","last_unstale":"2024-08-17T02:24:45.686595+0000","last_undegraded":"2024-08-17T02:24:45.686595+0000","last_fullsized":"2024-08-17T02:24:45.686595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:36.581167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693180+0000","last_change":"2024-08-17T02:24:46.693180+0000","last_active":"2024-08-17T02:24:46.693180+0000","last_peered":"2024-08-17T02:24:46.693180+0000","last_clean":"2024-08-17T02:24:46.693180+0000","last_became_active":"2024-08-17T02:24:46.692910+0000","last_became_peered":"2024-08-17T02:24:46.692910+0000","last_unstale":"2024-08-17T02:24:46.693180+0000","last_undegraded":"2024-08-17T02:24:46.693180+0000","last_fullsized":"2024-08-17T02:24:46.693180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:20.305646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692682+0000","last_change":"2024-08-17T02:24:45.689693+0000","last_active":"2024-08-17T02:24:45.692682+0000","last_peered":"2024-08-17T02:24:45.692682+0000","last_clean":"2024-08-17T02:24:45.692682+0000","last_became_active":"2024-08-17T02:24:45.689396+0000","last_became_peered":"2024-08-17T02:24:45.689396+0000","last_unstale":"2024-08-17T02:24:45.692682+0000","last_undegraded":"2024-08-17T02:24:45.692682+0000","last_fullsized":"2024-08-17T02:24:45.692682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:03:27.829684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707529+0000","last_change":"2024-08-17T02:24:46.707529+0000","last_active":"2024-08-17T02:24:46.707529+0000","last_peered":"2024-08-17T02:24:46.707529+0000","last_clean":"2024-08-17T02:24:46.707529+0000","last_became_active":"2024-08-17T02:24:46.706887+0000","last_became_peered":"2024-08-17T02:24:46.706887+0000","last_unstale":"2024-08-17T02:24:46.707529+0000","last_undegraded":"2024-08-17T02:24:46.707529+0000","last_fullsized":"2024-08-17T02:24:46.707529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693785+0000","last_change":"2024-08-17T02:24:45.689053+0000","last_active":"2024-08-17T02:24:45.693785+0000","last_peered":"2024-08-17T02:24:45.693785+0000","last_clean":"2024-08-17T02:24:45.693785+0000","last_became_active":"2024-08-17T02:24:45.688643+0000","last_became_peered":"2024-08-17T02:24:45.688643+0000","last_unstale":"2024-08-17T02:24:45.693785+0000","last_undegraded":"2024-08-17T02:24:45.693785+0000","last_fullsized":"2024-08-17T02:24:45.693785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683528+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:53.636650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701087+0000","last_change":"2024-08-17T02:24:45.686140+0000","last_active":"2024-08-17T02:24:46.701087+0000","last_peered":"2024-08-17T02:24:46.701087+0000","last_clean":"2024-08-17T02:24:46.701087+0000","last_became_active":"2024-08-17T02:24:45.685732+0000","last_became_peered":"2024-08-17T02:24:45.685732+0000","last_unstale":"2024-08-17T02:24:46.701087+0000","last_undegraded":"2024-08-17T02:24:46.701087+0000","last_fullsized":"2024-08-17T02:24:46.701087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703995+0000","last_change":"2024-08-17T02:24:46.703995+0000","last_active":"2024-08-17T02:24:46.703995+0000","last_peered":"2024-08-17T02:24:46.703995+0000","last_clean":"2024-08-17T02:24:46.703995+0000","last_became_active":"2024-08-17T02:24:46.703632+0000","last_became_peered":"2024-08-17T02:24:46.703632+0000","last_unstale":"2024-08-17T02:24:46.703995+0000","last_undegraded":"2024-08-17T02:24:46.703995+0000","last_fullsized":"2024-08-17T02:24:46.703995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702401+0000","last_change":"2024-08-17T02:24:45.691026+0000","last_active":"2024-08-17T02:24:46.702401+0000","last_peered":"2024-08-17T02:24:46.702401+0000","last_clean":"2024-08-17T02:24:46.702401+0000","last_became_active":"2024-08-17T02:24:45.690499+0000","last_became_peered":"2024-08-17T02:24:45.690499+0000","last_unstale":"2024-08-17T02:24:46.702401+0000","last_undegraded":"2024-08-17T02:24:46.702401+0000","last_fullsized":"2024-08-17T02:24:46.702401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:14.230300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694359+0000","last_change":"2024-08-17T02:24:46.694359+0000","last_active":"2024-08-17T02:24:46.694359+0000","last_peered":"2024-08-17T02:24:46.694359+0000","last_clean":"2024-08-17T02:24:46.694359+0000","last_became_active":"2024-08-17T02:24:46.693812+0000","last_became_peered":"2024-08-17T02:24:46.693812+0000","last_unstale":"2024-08-17T02:24:46.694359+0000","last_undegraded":"2024-08-17T02:24:46.694359+0000","last_fullsized":"2024-08-17T02:24:46.694359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:48:49.063780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703380+0000","last_change":"2024-08-17T02:24:45.689928+0000","last_active":"2024-08-17T02:24:46.703380+0000","last_peered":"2024-08-17T02:24:46.703380+0000","last_clean":"2024-08-17T02:24:46.703380+0000","last_became_active":"2024-08-17T02:24:45.689519+0000","last_became_peered":"2024-08-17T02:24:45.689519+0000","last_unstale":"2024-08-17T02:24:46.703380+0000","last_undegraded":"2024-08-17T02:24:46.703380+0000","last_fullsized":"2024-08-17T02:24:46.703380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708134+0000","last_change":"2024-08-17T02:24:46.708134+0000","last_active":"2024-08-17T02:24:46.708134+0000","last_peered":"2024-08-17T02:24:46.708134+0000","last_clean":"2024-08-17T02:24:46.708134+0000","last_became_active":"2024-08-17T02:24:46.707822+0000","last_became_peered":"2024-08-17T02:24:46.707822+0000","last_unstale":"2024-08-17T02:24:46.708134+0000","last_undegraded":"2024-08-17T02:24:46.708134+0000","last_fullsized":"2024-08-17T02:24:46.708134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692541+0000","last_change":"2024-08-17T02:24:45.686232+0000","last_active":"2024-08-17T02:24:45.692541+0000","last_peered":"2024-08-17T02:24:45.692541+0000","last_clean":"2024-08-17T02:24:45.692541+0000","last_became_active":"2024-08-17T02:24:45.685407+0000","last_became_peered":"2024-08-17T02:24:45.685407+0000","last_unstale":"2024-08-17T02:24:45.692541+0000","last_undegraded":"2024-08-17T02:24:45.692541+0000","last_fullsized":"2024-08-17T02:24:45.692541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700959+0000","last_change":"2024-08-17T02:24:46.700959+0000","last_active":"2024-08-17T02:24:46.700959+0000","last_peered":"2024-08-17T02:24:46.700959+0000","last_clean":"2024-08-17T02:24:46.700959+0000","last_became_active":"2024-08-17T02:24:46.698769+0000","last_became_peered":"2024-08-17T02:24:46.698769+0000","last_unstale":"2024-08-17T02:24:46.700959+0000","last_undegraded":"2024-08-17T02:24:46.700959+0000","last_fullsized":"2024-08-17T02:24:46.700959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693729+0000","last_change":"2024-08-17T02:24:45.687633+0000","last_active":"2024-08-17T02:24:45.693729+0000","last_peered":"2024-08-17T02:24:45.693729+0000","last_clean":"2024-08-17T02:24:45.693729+0000","last_became_active":"2024-08-17T02:24:45.687078+0000","last_became_peered":"2024-08-17T02:24:45.687078+0000","last_unstale":"2024-08-17T02:24:45.693729+0000","last_undegraded":"2024-08-17T02:24:45.693729+0000","last_fullsized":"2024-08-17T02:24:45.693729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696374+0000","last_change":"2024-08-17T02:24:46.696374+0000","last_active":"2024-08-17T02:24:46.696374+0000","last_peered":"2024-08-17T02:24:46.696374+0000","last_clean":"2024-08-17T02:24:46.696374+0000","last_became_active":"2024-08-17T02:24:46.695792+0000","last_became_peered":"2024-08-17T02:24:46.695792+0000","last_unstale":"2024-08-17T02:24:46.696374+0000","last_undegraded":"2024-08-17T02:24:46.696374+0000","last_fullsized":"2024-08-17T02:24:46.696374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.709507+0000","last_change":"2024-08-17T02:24:45.686489+0000","last_active":"2024-08-17T02:24:46.709507+0000","last_peered":"2024-08-17T02:24:46.709507+0000","last_clean":"2024-08-17T02:24:46.709507+0000","last_became_active":"2024-08-17T02:24:45.684809+0000","last_became_peered":"2024-08-17T02:24:45.684809+0000","last_unstale":"2024-08-17T02:24:46.709507+0000","last_undegraded":"2024-08-17T02:24:46.709507+0000","last_fullsized":"2024-08-17T02:24:46.709507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699050+0000","last_change":"2024-08-17T02:24:46.699050+0000","last_active":"2024-08-17T02:24:46.699050+0000","last_peered":"2024-08-17T02:24:46.699050+0000","last_clean":"2024-08-17T02:24:46.699050+0000","last_became_active":"2024-08-17T02:24:46.697848+0000","last_became_peered":"2024-08-17T02:24:46.697848+0000","last_unstale":"2024-08-17T02:24:46.699050+0000","last_undegraded":"2024-08-17T02:24:46.699050+0000","last_fullsized":"2024-08-17T02:24:46.699050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.684337+0000","last_change":"2024-08-17T02:24:45.696348+0000","last_active":"2024-08-17T02:24:46.684337+0000","last_peered":"2024-08-17T02:24:46.684337+0000","last_clean":"2024-08-17T02:24:46.684337+0000","last_became_active":"2024-08-17T02:24:45.695978+0000","last_became_peered":"2024-08-17T02:24:45.695978+0000","last_unstale":"2024-08-17T02:24:46.684337+0000","last_undegraded":"2024-08-17T02:24:46.684337+0000","last_fullsized":"2024-08-17T02:24:46.684337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698921+0000","last_change":"2024-08-17T02:24:46.698921+0000","last_active":"2024-08-17T02:24:46.698921+0000","last_peered":"2024-08-17T02:24:46.698921+0000","last_clean":"2024-08-17T02:24:46.698921+0000","last_became_active":"2024-08-17T02:24:46.698688+0000","last_became_peered":"2024-08-17T02:24:46.698688+0000","last_unstale":"2024-08-17T02:24:46.698921+0000","last_undegraded":"2024-08-17T02:24:46.698921+0000","last_fullsized":"2024-08-17T02:24:46.698921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:37.590898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701719+0000","last_change":"2024-08-17T02:24:45.699315+0000","last_active":"2024-08-17T02:24:46.701719+0000","last_peered":"2024-08-17T02:24:46.701719+0000","last_clean":"2024-08-17T02:24:46.701719+0000","last_became_active":"2024-08-17T02:24:45.698964+0000","last_became_peered":"2024-08-17T02:24:45.698964+0000","last_unstale":"2024-08-17T02:24:46.701719+0000","last_undegraded":"2024-08-17T02:24:46.701719+0000","last_fullsized":"2024-08-17T02:24:46.701719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696697+0000","last_change":"2024-08-17T02:24:46.696697+0000","last_active":"2024-08-17T02:24:46.696697+0000","last_peered":"2024-08-17T02:24:46.696697+0000","last_clean":"2024-08-17T02:24:46.696697+0000","last_became_active":"2024-08-17T02:24:46.696387+0000","last_became_peered":"2024-08-17T02:24:46.696387+0000","last_unstale":"2024-08-17T02:24:46.696697+0000","last_undegraded":"2024-08-17T02:24:46.696697+0000","last_fullsized":"2024-08-17T02:24:46.696697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693896+0000","last_change":"2024-08-17T02:24:45.693896+0000","last_active":"2024-08-17T02:24:45.693896+0000","last_peered":"2024-08-17T02:24:45.693896+0000","last_clean":"2024-08-17T02:24:45.693896+0000","last_became_active":"2024-08-17T02:24:45.693694+0000","last_became_peered":"2024-08-17T02:24:45.693694+0000","last_unstale":"2024-08-17T02:24:45.693896+0000","last_undegraded":"2024-08-17T02:24:45.693896+0000","last_fullsized":"2024-08-17T02:24:45.693896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:25.447726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695064+0000","last_change":"2024-08-17T02:24:46.695064+0000","last_active":"2024-08-17T02:24:46.695064+0000","last_peered":"2024-08-17T02:24:46.695064+0000","last_clean":"2024-08-17T02:24:46.695064+0000","last_became_active":"2024-08-17T02:24:46.694303+0000","last_became_peered":"2024-08-17T02:24:46.694303+0000","last_unstale":"2024-08-17T02:24:46.695064+0000","last_undegraded":"2024-08-17T02:24:46.695064+0000","last_fullsized":"2024-08-17T02:24:46.695064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.695865+0000","last_change":"2024-08-17T02:24:45.693363+0000","last_active":"2024-08-17T02:24:45.695865+0000","last_peered":"2024-08-17T02:24:45.695865+0000","last_clean":"2024-08-17T02:24:45.695865+0000","last_became_active":"2024-08-17T02:24:45.693114+0000","last_became_peered":"2024-08-17T02:24:45.693114+0000","last_unstale":"2024-08-17T02:24:45.695865+0000","last_undegraded":"2024-08-17T02:24:45.695865+0000","last_fullsized":"2024-08-17T02:24:45.695865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703793+0000","last_change":"2024-08-17T02:24:46.703793+0000","last_active":"2024-08-17T02:24:46.703793+0000","last_peered":"2024-08-17T02:24:46.703793+0000","last_clean":"2024-08-17T02:24:46.703793+0000","last_became_active":"2024-08-17T02:24:46.703493+0000","last_became_peered":"2024-08-17T02:24:46.703493+0000","last_unstale":"2024-08-17T02:24:46.703793+0000","last_undegraded":"2024-08-17T02:24:46.703793+0000","last_fullsized":"2024-08-17T02:24:46.703793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.681783+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:24:45.681783+0000","last_peered":"2024-08-17T02:24:45.681783+0000","last_clean":"2024-08-17T02:24:45.681783+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:24:45.681783+0000","last_undegraded":"2024-08-17T02:24:45.681783+0000","last_fullsized":"2024-08-17T02:24:45.681783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.690926+0000","last_change":"2024-08-17T02:24:45.684657+0000","last_active":"2024-08-17T02:24:45.690926+0000","last_peered":"2024-08-17T02:24:45.690926+0000","last_clean":"2024-08-17T02:24:45.690926+0000","last_became_active":"2024-08-17T02:24:45.683930+0000","last_became_peered":"2024-08-17T02:24:45.683930+0000","last_unstale":"2024-08-17T02:24:45.690926+0000","last_undegraded":"2024-08-17T02:24:45.690926+0000","last_fullsized":"2024-08-17T02:24:45.690926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690032+0000","last_change":"2024-08-17T02:24:46.690032+0000","last_active":"2024-08-17T02:24:46.690032+0000","last_peered":"2024-08-17T02:24:46.690032+0000","last_clean":"2024-08-17T02:24:46.690032+0000","last_became_active":"2024-08-17T02:24:46.689692+0000","last_became_peered":"2024-08-17T02:24:46.689692+0000","last_unstale":"2024-08-17T02:24:46.690032+0000","last_undegraded":"2024-08-17T02:24:46.690032+0000","last_fullsized":"2024-08-17T02:24:46.690032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:49.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.696106+0000","last_change":"2024-08-17T02:24:45.695195+0000","last_active":"2024-08-17T02:24:45.696106+0000","last_peered":"2024-08-17T02:24:45.696106+0000","last_clean":"2024-08-17T02:24:45.696106+0000","last_became_active":"2024-08-17T02:24:45.694908+0000","last_became_peered":"2024-08-17T02:24:45.694908+0000","last_unstale":"2024-08-17T02:24:45.696106+0000","last_undegraded":"2024-08-17T02:24:45.696106+0000","last_fullsized":"2024-08-17T02:24:45.696106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698400+0000","last_change":"2024-08-17T02:24:46.698400+0000","last_active":"2024-08-17T02:24:46.698400+0000","last_peered":"2024-08-17T02:24:46.698400+0000","last_clean":"2024-08-17T02:24:46.698400+0000","last_became_active":"2024-08-17T02:24:46.697641+0000","last_became_peered":"2024-08-17T02:24:46.697641+0000","last_unstale":"2024-08-17T02:24:46.698400+0000","last_undegraded":"2024-08-17T02:24:46.698400+0000","last_fullsized":"2024-08-17T02:24:46.698400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.701104+0000","last_change":"2024-08-17T02:24:45.696585+0000","last_active":"2024-08-17T02:24:45.701104+0000","last_peered":"2024-08-17T02:24:45.701104+0000","last_clean":"2024-08-17T02:24:45.701104+0000","last_became_active":"2024-08-17T02:24:45.696243+0000","last_became_peered":"2024-08-17T02:24:45.696243+0000","last_unstale":"2024-08-17T02:24:45.701104+0000","last_undegraded":"2024-08-17T02:24:45.701104+0000","last_fullsized":"2024-08-17T02:24:45.701104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.685570+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:17.216750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692732+0000","last_change":"2024-08-17T02:24:45.689974+0000","last_active":"2024-08-17T02:24:45.692732+0000","last_peered":"2024-08-17T02:24:45.692732+0000","last_clean":"2024-08-17T02:24:45.692732+0000","last_became_active":"2024-08-17T02:24:45.689686+0000","last_became_peered":"2024-08-17T02:24:45.689686+0000","last_unstale":"2024-08-17T02:24:45.692732+0000","last_undegraded":"2024-08-17T02:24:45.692732+0000","last_fullsized":"2024-08-17T02:24:45.692732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:02.113673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695491+0000","last_change":"2024-08-17T02:24:46.695491+0000","last_active":"2024-08-17T02:24:46.695491+0000","last_peered":"2024-08-17T02:24:46.695491+0000","last_clean":"2024-08-17T02:24:46.695491+0000","last_became_active":"2024-08-17T02:24:46.694910+0000","last_became_peered":"2024-08-17T02:24:46.694910+0000","last_unstale":"2024-08-17T02:24:46.695491+0000","last_undegraded":"2024-08-17T02:24:46.695491+0000","last_fullsized":"2024-08-17T02:24:46.695491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:17.309712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693494+0000","last_change":"2024-08-17T02:24:45.693494+0000","last_active":"2024-08-17T02:24:45.693494+0000","last_peered":"2024-08-17T02:24:45.693494+0000","last_clean":"2024-08-17T02:24:45.693494+0000","last_became_active":"2024-08-17T02:24:45.691399+0000","last_became_peered":"2024-08-17T02:24:45.691399+0000","last_unstale":"2024-08-17T02:24:45.693494+0000","last_undegraded":"2024-08-17T02:24:45.693494+0000","last_fullsized":"2024-08-17T02:24:45.693494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:47.538687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697272+0000","last_change":"2024-08-17T02:24:46.697272+0000","last_active":"2024-08-17T02:24:46.697272+0000","last_peered":"2024-08-17T02:24:46.697272+0000","last_clean":"2024-08-17T02:24:46.697272+0000","last_became_active":"2024-08-17T02:24:46.696866+0000","last_became_peered":"2024-08-17T02:24:46.696866+0000","last_unstale":"2024-08-17T02:24:46.697272+0000","last_undegraded":"2024-08-17T02:24:46.697272+0000","last_fullsized":"2024-08-17T02:24:46.697272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692661+0000","last_change":"2024-08-17T02:24:45.689340+0000","last_active":"2024-08-17T02:24:45.692661+0000","last_peered":"2024-08-17T02:24:45.692661+0000","last_clean":"2024-08-17T02:24:45.692661+0000","last_became_active":"2024-08-17T02:24:45.687263+0000","last_became_peered":"2024-08-17T02:24:45.687263+0000","last_unstale":"2024-08-17T02:24:45.692661+0000","last_undegraded":"2024-08-17T02:24:45.692661+0000","last_fullsized":"2024-08-17T02:24:45.692661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.687663+0000","last_change":"2024-08-17T02:24:46.687663+0000","last_active":"2024-08-17T02:24:46.687663+0000","last_peered":"2024-08-17T02:24:46.687663+0000","last_clean":"2024-08-17T02:24:46.687663+0000","last_became_active":"2024-08-17T02:24:46.687285+0000","last_became_peered":"2024-08-17T02:24:46.687285+0000","last_unstale":"2024-08-17T02:24:46.687663+0000","last_undegraded":"2024-08-17T02:24:46.687663+0000","last_fullsized":"2024-08-17T02:24:46.687663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.695885+0000","last_change":"2024-08-17T02:24:45.692340+0000","last_active":"2024-08-17T02:24:45.695885+0000","last_peered":"2024-08-17T02:24:45.695885+0000","last_clean":"2024-08-17T02:24:45.695885+0000","last_became_active":"2024-08-17T02:24:45.691959+0000","last_became_peered":"2024-08-17T02:24:45.691959+0000","last_unstale":"2024-08-17T02:24:45.695885+0000","last_undegraded":"2024-08-17T02:24:45.695885+0000","last_fullsized":"2024-08-17T02:24:45.695885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699671+0000","last_change":"2024-08-17T02:24:46.699671+0000","last_active":"2024-08-17T02:24:46.699671+0000","last_peered":"2024-08-17T02:24:46.699671+0000","last_clean":"2024-08-17T02:24:46.699671+0000","last_became_active":"2024-08-17T02:24:46.699384+0000","last_became_peered":"2024-08-17T02:24:46.699384+0000","last_unstale":"2024-08-17T02:24:46.699671+0000","last_undegraded":"2024-08-17T02:24:46.699671+0000","last_fullsized":"2024-08-17T02:24:46.699671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706478+0000","last_change":"2024-08-17T02:24:45.689016+0000","last_active":"2024-08-17T02:24:46.706478+0000","last_peered":"2024-08-17T02:24:46.706478+0000","last_clean":"2024-08-17T02:24:46.706478+0000","last_became_active":"2024-08-17T02:24:45.688568+0000","last_became_peered":"2024-08-17T02:24:45.688568+0000","last_unstale":"2024-08-17T02:24:46.706478+0000","last_undegraded":"2024-08-17T02:24:46.706478+0000","last_fullsized":"2024-08-17T02:24:46.706478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:31.920700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690217+0000","last_change":"2024-08-17T02:24:46.690217+0000","last_active":"2024-08-17T02:24:46.690217+0000","last_peered":"2024-08-17T02:24:46.690217+0000","last_clean":"2024-08-17T02:24:46.690217+0000","last_became_active":"2024-08-17T02:24:46.689945+0000","last_became_peered":"2024-08-17T02:24:46.689945+0000","last_unstale":"2024-08-17T02:24:46.690217+0000","last_undegraded":"2024-08-17T02:24:46.690217+0000","last_fullsized":"2024-08-17T02:24:46.690217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.696490+0000","last_change":"2024-08-17T02:24:45.692162+0000","last_active":"2024-08-17T02:24:45.696490+0000","last_peered":"2024-08-17T02:24:45.696490+0000","last_clean":"2024-08-17T02:24:45.696490+0000","last_became_active":"2024-08-17T02:24:45.691864+0000","last_became_peered":"2024-08-17T02:24:45.691864+0000","last_unstale":"2024-08-17T02:24:45.696490+0000","last_undegraded":"2024-08-17T02:24:45.696490+0000","last_fullsized":"2024-08-17T02:24:45.696490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693752+0000","last_change":"2024-08-17T02:24:46.693752+0000","last_active":"2024-08-17T02:24:46.693752+0000","last_peered":"2024-08-17T02:24:46.693752+0000","last_clean":"2024-08-17T02:24:46.693752+0000","last_became_active":"2024-08-17T02:24:46.693452+0000","last_became_peered":"2024-08-17T02:24:46.693452+0000","last_unstale":"2024-08-17T02:24:46.693752+0000","last_undegraded":"2024-08-17T02:24:46.693752+0000","last_fullsized":"2024-08-17T02:24:46.693752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.504743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.698413+0000","last_change":"2024-08-17T02:24:45.695549+0000","last_active":"2024-08-17T02:24:45.698413+0000","last_peered":"2024-08-17T02:24:45.698413+0000","last_clean":"2024-08-17T02:24:45.698413+0000","last_became_active":"2024-08-17T02:24:45.695270+0000","last_became_peered":"2024-08-17T02:24:45.695270+0000","last_unstale":"2024-08-17T02:24:45.698413+0000","last_undegraded":"2024-08-17T02:24:45.698413+0000","last_fullsized":"2024-08-17T02:24:45.698413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.689650+0000","last_change":"2024-08-17T02:24:46.689650+0000","last_active":"2024-08-17T02:24:46.689650+0000","last_peered":"2024-08-17T02:24:46.689650+0000","last_clean":"2024-08-17T02:24:46.689650+0000","last_became_active":"2024-08-17T02:24:46.689361+0000","last_became_peered":"2024-08-17T02:24:46.689361+0000","last_unstale":"2024-08-17T02:24:46.689650+0000","last_undegraded":"2024-08-17T02:24:46.689650+0000","last_fullsized":"2024-08-17T02:24:46.689650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692092+0000","last_change":"2024-08-17T02:24:45.688479+0000","last_active":"2024-08-17T02:24:45.692092+0000","last_peered":"2024-08-17T02:24:45.692092+0000","last_clean":"2024-08-17T02:24:45.692092+0000","last_became_active":"2024-08-17T02:24:45.688105+0000","last_became_peered":"2024-08-17T02:24:45.688105+0000","last_unstale":"2024-08-17T02:24:45.692092+0000","last_undegraded":"2024-08-17T02:24:45.692092+0000","last_fullsized":"2024-08-17T02:24:45.692092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693894+0000","last_change":"2024-08-17T02:24:46.693894+0000","last_active":"2024-08-17T02:24:46.693894+0000","last_peered":"2024-08-17T02:24:46.693894+0000","last_clean":"2024-08-17T02:24:46.693894+0000","last_became_active":"2024-08-17T02:24:46.693611+0000","last_became_peered":"2024-08-17T02:24:46.693611+0000","last_unstale":"2024-08-17T02:24:46.693894+0000","last_undegraded":"2024-08-17T02:24:46.693894+0000","last_fullsized":"2024-08-17T02:24:46.693894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706309+0000","last_change":"2024-08-17T02:24:45.684136+0000","last_active":"2024-08-17T02:24:46.706309+0000","last_peered":"2024-08-17T02:24:46.706309+0000","last_clean":"2024-08-17T02:24:46.706309+0000","last_became_active":"2024-08-17T02:24:45.683723+0000","last_became_peered":"2024-08-17T02:24:45.683723+0000","last_unstale":"2024-08-17T02:24:46.706309+0000","last_undegraded":"2024-08-17T02:24:46.706309+0000","last_fullsized":"2024-08-17T02:24:46.706309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691308+0000","last_change":"2024-08-17T02:24:46.691308+0000","last_active":"2024-08-17T02:24:46.691308+0000","last_peered":"2024-08-17T02:24:46.691308+0000","last_clean":"2024-08-17T02:24:46.691308+0000","last_became_active":"2024-08-17T02:24:46.691046+0000","last_became_peered":"2024-08-17T02:24:46.691046+0000","last_unstale":"2024-08-17T02:24:46.691308+0000","last_undegraded":"2024-08-17T02:24:46.691308+0000","last_fullsized":"2024-08-17T02:24:46.691308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699150+0000","last_change":"2024-08-17T02:24:46.699150+0000","last_active":"2024-08-17T02:24:46.699150+0000","last_peered":"2024-08-17T02:24:46.699150+0000","last_clean":"2024-08-17T02:24:46.699150+0000","last_became_active":"2024-08-17T02:24:46.697504+0000","last_became_peered":"2024-08-17T02:24:46.697504+0000","last_unstale":"2024-08-17T02:24:46.699150+0000","last_undegraded":"2024-08-17T02:24:46.699150+0000","last_fullsized":"2024-08-17T02:24:46.699150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710964+0000","last_change":"2024-08-17T02:24:45.690864+0000","last_active":"2024-08-17T02:24:46.710964+0000","last_peered":"2024-08-17T02:24:46.710964+0000","last_clean":"2024-08-17T02:24:46.710964+0000","last_became_active":"2024-08-17T02:24:45.687405+0000","last_became_peered":"2024-08-17T02:24:45.687405+0000","last_unstale":"2024-08-17T02:24:46.710964+0000","last_undegraded":"2024-08-17T02:24:46.710964+0000","last_fullsized":"2024-08-17T02:24:46.710964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702644+0000","last_change":"2024-08-17T02:24:46.702644+0000","last_active":"2024-08-17T02:24:46.702644+0000","last_peered":"2024-08-17T02:24:46.702644+0000","last_clean":"2024-08-17T02:24:46.702644+0000","last_became_active":"2024-08-17T02:24:46.701576+0000","last_became_peered":"2024-08-17T02:24:46.701576+0000","last_unstale":"2024-08-17T02:24:46.702644+0000","last_undegraded":"2024-08-17T02:24:46.702644+0000","last_fullsized":"2024-08-17T02:24:46.702644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:12.393424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710485+0000","last_change":"2024-08-17T02:24:45.689395+0000","last_active":"2024-08-17T02:24:46.710485+0000","last_peered":"2024-08-17T02:24:46.710485+0000","last_clean":"2024-08-17T02:24:46.710485+0000","last_became_active":"2024-08-17T02:24:45.689082+0000","last_became_peered":"2024-08-17T02:24:45.689082+0000","last_unstale":"2024-08-17T02:24:46.710485+0000","last_undegraded":"2024-08-17T02:24:46.710485+0000","last_fullsized":"2024-08-17T02:24:46.710485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.685140+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:42.849100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.687064+0000","last_change":"2024-08-17T02:24:45.687064+0000","last_active":"2024-08-17T02:24:45.687064+0000","last_peered":"2024-08-17T02:24:45.687064+0000","last_clean":"2024-08-17T02:24:45.687064+0000","last_became_active":"2024-08-17T02:24:45.686543+0000","last_became_peered":"2024-08-17T02:24:45.686543+0000","last_unstale":"2024-08-17T02:24:45.687064+0000","last_undegraded":"2024-08-17T02:24:45.687064+0000","last_fullsized":"2024-08-17T02:24:45.687064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:47.125586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683230+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:27.265830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708733+0000","last_change":"2024-08-17T02:24:45.687257+0000","last_active":"2024-08-17T02:24:46.708733+0000","last_peered":"2024-08-17T02:24:46.708733+0000","last_clean":"2024-08-17T02:24:46.708733+0000","last_became_active":"2024-08-17T02:24:45.686911+0000","last_became_peered":"2024-08-17T02:24:45.686911+0000","last_unstale":"2024-08-17T02:24:46.708733+0000","last_undegraded":"2024-08-17T02:24:46.708733+0000","last_fullsized":"2024-08-17T02:24:46.708733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2268,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":74467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":74343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":241664,"data_stored":76555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":74913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":75895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":819200,"data_stored":664781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":74399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":802816,"data_stored":657948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:50.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-08-17T02:24:50.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.684833+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T11:11:01.185641+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-08-17T02:24:50.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.683020+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T09:35:15.827101+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-08-17T02:24:50.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.687014+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T09:53:10.973372+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-08-17T02:24:50.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.684166+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:41:15.861283+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-08-17T02:24:50.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.683038+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T03:45:02.907069+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-08-17T02:24:50.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.686371+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:04:38.994029+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-08-17T02:24:50.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.681671+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T07:25:33.547382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-08-17T02:24:50.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.680939+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T11:20:35.140243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-08-17T02:24:50.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.683528+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T05:32:53.636650+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-08-17T02:24:50.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.685570+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T05:38:17.216750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-08-17T02:24:50.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.685140+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T06:57:42.849100+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-08-17T02:24:50.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:24:45.654560+0000', 'last_change': '2024-08-17T02:24:45.683230+0000', 'last_active': '2024-08-17T02:24:45.654560+0000', 'last_peered': '2024-08-17T02:24:45.654560+0000', 'last_clean': '2024-08-17T02:24:45.654560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:24:45.654560+0000', 'last_undegraded': '2024-08-17T02:24:45.654560+0000', 'last_fullsized': '2024-08-17T02:24:45.654560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'last_clean_scrub_stamp': '2024-08-17T02:24:45.654560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T04:10:27.265830+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:24:50.429 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-17T02:24:50.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.558+0000 7fcac2bd5700 1 Processor -- start 2024-08-17T02:24:50.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.558+0000 7fcac2bd5700 1 -- start start 2024-08-17T02:24:50.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcabc0cd770 0x7fcabc162270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 0x7fcabc0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcabc161de0 con 0x7fcabc160e10 2024-08-17T02:24:50.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcabc06ed20 con 0x7fcabc0cd770 2024-08-17T02:24:50.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0b21d0 con 0x7fcabc1611e0 2024-08-17T02:24:50.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac13d2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcabc0cd770 0x7fcabc162270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac1bd3700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcabc160e10 0x7fcabc0cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45790/0 (socket says 172.21.15.31:45790) 2024-08-17T02:24:50.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac1bd3700 1 -- 172.21.15.31:0/3879969435 learned_addr learned my addr 172.21.15.31:0/3879969435 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:50.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac23d4700 1 --2- 172.21.15.31:0/3879969435 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 0x7fcabc0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac0bd1700 1 -- 172.21.15.31:0/3879969435 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521123719 0 0) 0x7fcabc161de0 con 0x7fcabc160e10 2024-08-17T02:24:50.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac0bd1700 1 -- 172.21.15.31:0/3879969435 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaa8003570 con 0x7fcabc160e10 2024-08-17T02:24:50.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac0bd1700 1 -- 172.21.15.31:0/3879969435 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2105789883 0 0) 0x7fcaa8003570 con 0x7fcabc160e10 2024-08-17T02:24:50.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac13d2700 1 -- 172.21.15.31:0/3879969435 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 msgr2=0x7fcabc0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:50.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac13d2700 1 --2- 172.21.15.31:0/3879969435 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 0x7fcabc0b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac13d2700 1 -- 172.21.15.31:0/3879969435 >> v1:172.21.15.31:6789/0 conn(0x7fcabc160e10 legacy=0x7fcabc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac13d2700 1 -- 172.21.15.31:0/3879969435 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc0b24b0 con 0x7fcabc0cd770 2024-08-17T02:24:50.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac13d2700 1 --2- 172.21.15.31:0/3879969435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc0cd770 0x7fcabc162270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0098e0 tx=0x7fcaac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a479bd93d74bc93 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:50.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac0bd1700 1 -- 172.21.15.31:0/3879969435 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8001470 con 0x7fcabc0cd770 2024-08-17T02:24:50.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac0bd1700 1 -- 172.21.15.31:0/3879969435 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac011420 con 0x7fcabc0cd770 2024-08-17T02:24:50.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac0bd1700 1 -- 172.21.15.31:0/3879969435 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac0117c0 con 0x7fcabc0cd770 2024-08-17T02:24:50.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 -- 172.21.15.31:0/3879969435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc0cd770 msgr2=0x7fcabc162270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 --2- 172.21.15.31:0/3879969435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc0cd770 0x7fcabc162270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0098e0 tx=0x7fcaac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 -- 172.21.15.31:0/3879969435 shutdown_connections 2024-08-17T02:24:50.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 --2- 172.21.15.31:0/3879969435 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 0x7fcabc0b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 --2- 172.21.15.31:0/3879969435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc0cd770 0x7fcabc162270 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 -- 172.21.15.31:0/3879969435 >> 172.21.15.31:0/3879969435 conn(0x7fcabc06c340 msgr2=0x7fcabc06c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:50.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 -- 172.21.15.31:0/3879969435 shutdown_connections 2024-08-17T02:24:50.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.562+0000 7fcac2bd5700 1 -- 172.21.15.31:0/3879969435 wait complete. 2024-08-17T02:24:50.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 Processor -- start 2024-08-17T02:24:50.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 -- start start 2024-08-17T02:24:50.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcabc0cd770 0x7fcabc16eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc160e10 0x7fcabc159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 0x7fcabc0c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc16e610 con 0x7fcabc160e10 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0c3ae0 con 0x7fcabc0cd770 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc0c2ba0 con 0x7fcabc1611e0 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac13d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc160e10 0x7fcabc159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac13d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc160e10 0x7fcabc159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56584/0 (socket says 172.21.15.31:56584) 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac13d2700 1 -- 172.21.15.31:0/1516072342 learned_addr learned my addr 172.21.15.31:0/1516072342 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac1bd3700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcabc0cd770 0x7fcabc16eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac23d4700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 0x7fcabc0c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac13d2700 1 -- 172.21.15.31:0/1516072342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 msgr2=0x7fcabc0c2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac13d2700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 0x7fcabc0c2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac13d2700 1 -- 172.21.15.31:0/1516072342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcabc0cd770 msgr2=0x7fcabc16eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac13d2700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcabc0cd770 0x7fcabc16eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac13d2700 1 -- 172.21.15.31:0/1516072342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac009420 con 0x7fcabc160e10 2024-08-17T02:24:50.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac1bd3700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcabc0cd770 0x7fcabc16eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:50.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac23d4700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 0x7fcabc0c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:50.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac13d2700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc160e10 0x7fcabc159b90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcabc06af50 tx=0x7fcaac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:50.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcab1ffb700 1 -- 172.21.15.31:0/1516072342 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac01cc50 con 0x7fcabc160e10 2024-08-17T02:24:50.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcab1ffb700 1 -- 172.21.15.31:0/1516072342 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac01cdb0 con 0x7fcabc160e10 2024-08-17T02:24:50.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 -- 172.21.15.31:0/1516072342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcabc0c2e80 con 0x7fcabc160e10 2024-08-17T02:24:50.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcab1ffb700 1 -- 172.21.15.31:0/1516072342 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac01a6a0 con 0x7fcabc160e10 2024-08-17T02:24:50.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 -- 172.21.15.31:0/1516072342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcabc16e2a0 con 0x7fcabc160e10 2024-08-17T02:24:50.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.566+0000 7fcac2bd5700 1 -- 172.21.15.31:0/1516072342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcabc16e780 con 0x7fcabc160e10 2024-08-17T02:24:50.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.570+0000 7fcab1ffb700 1 -- 172.21.15.31:0/1516072342 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcaac01aa50 con 0x7fcabc160e10 2024-08-17T02:24:50.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.570+0000 7fcab1ffb700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcaa0060860 0x7fcaa0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.570+0000 7fcab1ffb700 1 -- 172.21.15.31:0/1516072342 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcaac07e5d0 con 0x7fcabc160e10 2024-08-17T02:24:50.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.570+0000 7fcac1bd3700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcaa0060860 0x7fcaa0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.570+0000 7fcac1bd3700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcaa0060860 0x7fcaa0062d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcab8007c40 tx=0x7fcab8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:50.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.578+0000 7fcab1ffb700 1 -- 172.21.15.31:0/1516072342 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcaac04ea60 con 0x7fcabc160e10 2024-08-17T02:24:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.786+0000 7fcac2bd5700 1 -- 172.21.15.31:0/1516072342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcabc0712b0 con 0x7fcabc160e10 2024-08-17T02:24:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcab1ffb700 1 -- 172.21.15.31:0/1516072342 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1099 (secure 0 0 0) 0x7fcaac052040 con 0x7fcabc160e10 2024-08-17T02:24:50.795 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:50.795 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1723861472,"num_in_osds":8,"osd_in_since":1723861463,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"creating+peering","count":12}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592636,"bytes_used":2438967296,"bytes_avail":770655145984,"bytes_total":773094113280,"inactive_pgs_ratio":0.12371134012937546,"write_bytes_sec":2493,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4293}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-08-17T02:24:21.327502+0000","services":{}},"progress_events":{}} 2024-08-17T02:24:50.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 -- 172.21.15.31:0/1516072342 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcaa0060860 msgr2=0x7fcaa0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcaa0060860 0x7fcaa0062d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcab8007c40 tx=0x7fcab8009040 comp rx=0 tx=0).stop 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 -- 172.21.15.31:0/1516072342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc160e10 msgr2=0x7fcabc159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc160e10 0x7fcabc159b90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcabc06af50 tx=0x7fcaac016000 comp rx=0 tx=0).stop 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 -- 172.21.15.31:0/1516072342 shutdown_connections 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcaa0060860 0x7fcaa0062d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcabc1611e0 0x7fcabc0c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcabc160e10 0x7fcabc159b90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 --2- 172.21.15.31:0/1516072342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcabc0cd770 0x7fcabc16eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 -- 172.21.15.31:0/1516072342 >> 172.21.15.31:0/1516072342 conn(0x7fcabc06c340 msgr2=0x7fcabc0cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:50.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 -- 172.21.15.31:0/1516072342 shutdown_connections 2024-08-17T02:24:50.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.790+0000 7fcac2bd5700 1 -- 172.21.15.31:0/1516072342 wait complete. 2024-08-17T02:24:50.807 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-17T02:24:50.807 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:50.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 Processor -- start 2024-08-17T02:24:50.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 -- start start 2024-08-17T02:24:50.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f574015c8e0 0x7f574015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57400ce370 con 0x7f574015d360 2024-08-17T02:24:50.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574006a380 con 0x7f574015c510 2024-08-17T02:24:50.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574015dca0 con 0x7f574015c8e0 2024-08-17T02:24:50.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573dd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f574015c8e0 0x7f574015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573dd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f574015c8e0 0x7f574015ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48520/0 (socket says 172.21.15.31:48520) 2024-08-17T02:24:50.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573dd9b700 1 -- 172.21.15.31:0/2614666519 learned_addr learned my addr 172.21.15.31:0/2614666519 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:50.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573dd9b700 1 -- 172.21.15.31:0/2614666519 >> v1:172.21.15.92:6789/0 conn(0x7f574015c510 legacy=0x7f57400b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:50.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573dd9b700 1 -- 172.21.15.31:0/2614666519 >> v1:172.21.15.31:6789/0 conn(0x7f574015d360 legacy=0x7f57400ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573dd9b700 1 -- 172.21.15.31:0/2614666519 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740069ae0 con 0x7f574015c8e0 2024-08-17T02:24:50.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573dd9b700 1 --2- 172.21.15.31:0/2614666519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 0x7f574015ce20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5730009f20 tx=0x7f5730009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cd5e32a492d32d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:50.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573d59a700 1 -- 172.21.15.31:0/2614666519 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000e070 con 0x7f574015c8e0 2024-08-17T02:24:50.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573d59a700 1 -- 172.21.15.31:0/2614666519 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573000ba80 con 0x7f574015c8e0 2024-08-17T02:24:50.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573d59a700 1 -- 172.21.15.31:0/2614666519 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300092e0 con 0x7f574015c8e0 2024-08-17T02:24:50.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 -- 172.21.15.31:0/2614666519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 msgr2=0x7f574015ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 --2- 172.21.15.31:0/2614666519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 0x7f574015ce20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5730009f20 tx=0x7f5730009840 comp rx=0 tx=0).stop 2024-08-17T02:24:50.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 -- 172.21.15.31:0/2614666519 shutdown_connections 2024-08-17T02:24:50.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 --2- 172.21.15.31:0/2614666519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 0x7f574015ce20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 -- 172.21.15.31:0/2614666519 >> 172.21.15.31:0/2614666519 conn(0x7f57400b5e40 msgr2=0x7f5740067400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:50.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 -- 172.21.15.31:0/2614666519 shutdown_connections 2024-08-17T02:24:50.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.906+0000 7f573f59e700 1 -- 172.21.15.31:0/2614666519 wait complete. 2024-08-17T02:24:50.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573f59e700 1 Processor -- start 2024-08-17T02:24:50.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573f59e700 1 -- start start 2024-08-17T02:24:50.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573f59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f574015c510 0x7f57401598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 0x7f574009d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573f59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f574015d360 0x7f574009ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57400aead0 con 0x7f574015c8e0 2024-08-17T02:24:50.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573f59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57400adf50 con 0x7f574015c510 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573f59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400ae230 con 0x7f574015d360 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 0x7f574009d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 0x7f574009d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48528/0 (socket says 172.21.15.31:48528) 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573dd9b700 1 -- 172.21.15.31:0/2598245675 learned_addr learned my addr 172.21.15.31:0/2598245675 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573dd9b700 1 -- 172.21.15.31:0/2598245675 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f574015d360 msgr2=0x7f574009ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573ed9d700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f574015d360 0x7f574009ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573e59c700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f574015c510 0x7f57401598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573dd9b700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f574015d360 0x7f574009ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573dd9b700 1 -- 172.21.15.31:0/2598245675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f574015c510 msgr2=0x7f57401598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573dd9b700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f574015c510 0x7f57401598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573dd9b700 1 -- 172.21.15.31:0/2598245675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009ae0 con 0x7f574015c8e0 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573e59c700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f574015c510 0x7f57401598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:50.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573ed9d700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f574015d360 0x7f574009ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573dd9b700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 0x7f574009d060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5740088d20 tx=0x7f5730018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f57367fc700 1 -- 172.21.15.31:0/2598245675 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730008bb0 con 0x7f574015c8e0 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f57367fc700 1 -- 172.21.15.31:0/2598245675 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5730008d10 con 0x7f574015c8e0 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573f59e700 1 -- 172.21.15.31:0/2598245675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57400ae510 con 0x7f574015c8e0 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f57367fc700 1 -- 172.21.15.31:0/2598245675 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300266b0 con 0x7f574015c8e0 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.910+0000 7f573f59e700 1 -- 172.21.15.31:0/2598245675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57400adb80 con 0x7f574015c8e0 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.914+0000 7f573f59e700 1 -- 172.21.15.31:0/2598245675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5740098220 con 0x7f574015c8e0 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.914+0000 7f57367fc700 1 -- 172.21.15.31:0/2598245675 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5730003040 con 0x7f574015c8e0 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.914+0000 7f57367fc700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5724060860 0x7f5724062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.914+0000 7f57367fc700 1 -- 172.21.15.31:0/2598245675 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f573007eb50 con 0x7f574015c8e0 2024-08-17T02:24:50.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.914+0000 7f573e59c700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5724060860 0x7f5724062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.914+0000 7f573e59c700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5724060860 0x7f5724062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5728001840 tx=0x7f5728009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:50.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:50.922+0000 7f57367fc700 1 -- 172.21.15.31:0/2598245675 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5740098220 con 0x7f574015c8e0 2024-08-17T02:24:51.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.078+0000 7f573f59e700 1 -- 172.21.15.31:0/2598245675 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5740098220 con 0x7f5724060860 2024-08-17T02:24:51.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.094+0000 7f57367fc700 1 -- 172.21.15.31:0/2598245675 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264001 (secure 0 0 0) 0x7f5740098220 con 0x7f5724060860 2024-08-17T02:24:51.105 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 -- 172.21.15.31:0/2598245675 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5724060860 msgr2=0x7f5724062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5724060860 0x7f5724062d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5728001840 tx=0x7f5728009040 comp rx=0 tx=0).stop 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 -- 172.21.15.31:0/2598245675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 msgr2=0x7f574009d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 0x7f574009d060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5740088d20 tx=0x7f5730018000 comp rx=0 tx=0).stop 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 -- 172.21.15.31:0/2598245675 shutdown_connections 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5724060860 0x7f5724062d10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f574015d360 0x7f574009ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574015c8e0 0x7f574009d060 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 --2- 172.21.15.31:0/2598245675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f574015c510 0x7f57401598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 -- 172.21.15.31:0/2598245675 >> 172.21.15.31:0/2598245675 conn(0x7f57400b5e40 msgr2=0x7f574015a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:51.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 -- 172.21.15.31:0/2598245675 shutdown_connections 2024-08-17T02:24:51.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:51.098+0000 7f573f59e700 1 -- 172.21.15.31:0/2598245675 wait complete. 2024-08-17T02:24:51.110 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:24:51.118 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:24:49.582877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592636,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381804,"kb_used_data":2932,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592916,"statfs":{"total":773094113280,"available":770655145984,"internally_reserved":0,"allocated":3002368,"data_stored":1773301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2268,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.927145"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711137+0000","last_change":"2024-08-17T02:24:46.711137+0000","last_active":"2024-08-17T02:24:46.711137+0000","last_peered":"2024-08-17T02:24:46.711137+0000","last_clean":"2024-08-17T02:24:46.711137+0000","last_became_active":"2024-08-17T02:24:46.710820+0000","last_became_peered":"2024-08-17T02:24:46.710820+0000","last_unstale":"2024-08-17T02:24:46.711137+0000","last_undegraded":"2024-08-17T02:24:46.711137+0000","last_fullsized":"2024-08-17T02:24:46.711137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.684833+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:01.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683020+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:15.827101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702343+0000","last_change":"2024-08-17T02:24:46.702343+0000","last_active":"2024-08-17T02:24:46.702343+0000","last_peered":"2024-08-17T02:24:46.702343+0000","last_clean":"2024-08-17T02:24:46.702343+0000","last_became_active":"2024-08-17T02:24:46.700536+0000","last_became_peered":"2024-08-17T02:24:46.700536+0000","last_unstale":"2024-08-17T02:24:46.702343+0000","last_undegraded":"2024-08-17T02:24:46.702343+0000","last_fullsized":"2024-08-17T02:24:46.702343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697977+0000","last_change":"2024-08-17T02:24:46.697977+0000","last_active":"2024-08-17T02:24:46.697977+0000","last_peered":"2024-08-17T02:24:46.697977+0000","last_clean":"2024-08-17T02:24:46.697977+0000","last_became_active":"2024-08-17T02:24:46.697680+0000","last_became_peered":"2024-08-17T02:24:46.697680+0000","last_unstale":"2024-08-17T02:24:46.697977+0000","last_undegraded":"2024-08-17T02:24:46.697977+0000","last_fullsized":"2024-08-17T02:24:46.697977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696070+0000","last_change":"2024-08-17T02:24:46.696070+0000","last_active":"2024-08-17T02:24:46.696070+0000","last_peered":"2024-08-17T02:24:46.696070+0000","last_clean":"2024-08-17T02:24:46.696070+0000","last_became_active":"2024-08-17T02:24:46.693809+0000","last_became_peered":"2024-08-17T02:24:46.693809+0000","last_unstale":"2024-08-17T02:24:46.696070+0000","last_undegraded":"2024-08-17T02:24:46.696070+0000","last_fullsized":"2024-08-17T02:24:46.696070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694034+0000","last_change":"2024-08-17T02:24:46.694034+0000","last_active":"2024-08-17T02:24:46.694034+0000","last_peered":"2024-08-17T02:24:46.694034+0000","last_clean":"2024-08-17T02:24:46.694034+0000","last_became_active":"2024-08-17T02:24:46.693720+0000","last_became_peered":"2024-08-17T02:24:46.693720+0000","last_unstale":"2024-08-17T02:24:46.694034+0000","last_undegraded":"2024-08-17T02:24:46.694034+0000","last_fullsized":"2024-08-17T02:24:46.694034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:25.120018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.687014+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:53:10.973372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710805+0000","last_change":"2024-08-17T02:24:46.710805+0000","last_active":"2024-08-17T02:24:46.710805+0000","last_peered":"2024-08-17T02:24:46.710805+0000","last_clean":"2024-08-17T02:24:46.710805+0000","last_became_active":"2024-08-17T02:24:46.710510+0000","last_became_peered":"2024-08-17T02:24:46.710510+0000","last_unstale":"2024-08-17T02:24:46.710805+0000","last_undegraded":"2024-08-17T02:24:46.710805+0000","last_fullsized":"2024-08-17T02:24:46.710805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695508+0000","last_change":"2024-08-17T02:24:46.695508+0000","last_active":"2024-08-17T02:24:46.695508+0000","last_peered":"2024-08-17T02:24:46.695508+0000","last_clean":"2024-08-17T02:24:46.695508+0000","last_became_active":"2024-08-17T02:24:46.695174+0000","last_became_peered":"2024-08-17T02:24:46.695174+0000","last_unstale":"2024-08-17T02:24:46.695508+0000","last_undegraded":"2024-08-17T02:24:46.695508+0000","last_fullsized":"2024-08-17T02:24:46.695508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:26.358220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711058+0000","last_change":"2024-08-17T02:24:46.711058+0000","last_active":"2024-08-17T02:24:46.711058+0000","last_peered":"2024-08-17T02:24:46.711058+0000","last_clean":"2024-08-17T02:24:46.711058+0000","last_became_active":"2024-08-17T02:24:46.710739+0000","last_became_peered":"2024-08-17T02:24:46.710739+0000","last_unstale":"2024-08-17T02:24:46.711058+0000","last_undegraded":"2024-08-17T02:24:46.711058+0000","last_fullsized":"2024-08-17T02:24:46.711058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695791+0000","last_change":"2024-08-17T02:24:46.695791+0000","last_active":"2024-08-17T02:24:46.695791+0000","last_peered":"2024-08-17T02:24:46.695791+0000","last_clean":"2024-08-17T02:24:46.695791+0000","last_became_active":"2024-08-17T02:24:46.695116+0000","last_became_peered":"2024-08-17T02:24:46.695116+0000","last_unstale":"2024-08-17T02:24:46.695791+0000","last_undegraded":"2024-08-17T02:24:46.695791+0000","last_fullsized":"2024-08-17T02:24:46.695791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699896+0000","last_change":"2024-08-17T02:24:46.699896+0000","last_active":"2024-08-17T02:24:46.699896+0000","last_peered":"2024-08-17T02:24:46.699896+0000","last_clean":"2024-08-17T02:24:46.699896+0000","last_became_active":"2024-08-17T02:24:46.699645+0000","last_became_peered":"2024-08-17T02:24:46.699645+0000","last_unstale":"2024-08-17T02:24:46.699896+0000","last_undegraded":"2024-08-17T02:24:46.699896+0000","last_fullsized":"2024-08-17T02:24:46.699896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:36.261958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690505+0000","last_change":"2024-08-17T02:24:46.690505+0000","last_active":"2024-08-17T02:24:46.690505+0000","last_peered":"2024-08-17T02:24:46.690505+0000","last_clean":"2024-08-17T02:24:46.690505+0000","last_became_active":"2024-08-17T02:24:46.690185+0000","last_became_peered":"2024-08-17T02:24:46.690185+0000","last_unstale":"2024-08-17T02:24:46.690505+0000","last_undegraded":"2024-08-17T02:24:46.690505+0000","last_fullsized":"2024-08-17T02:24:46.690505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.684166+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:15.861283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690550+0000","last_change":"2024-08-17T02:24:46.690550+0000","last_active":"2024-08-17T02:24:46.690550+0000","last_peered":"2024-08-17T02:24:46.690550+0000","last_clean":"2024-08-17T02:24:46.690550+0000","last_became_active":"2024-08-17T02:24:46.690231+0000","last_became_peered":"2024-08-17T02:24:46.690231+0000","last_unstale":"2024-08-17T02:24:46.690550+0000","last_undegraded":"2024-08-17T02:24:46.690550+0000","last_fullsized":"2024-08-17T02:24:46.690550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:40:04.175081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703443+0000","last_change":"2024-08-17T02:24:46.703443+0000","last_active":"2024-08-17T02:24:46.703443+0000","last_peered":"2024-08-17T02:24:46.703443+0000","last_clean":"2024-08-17T02:24:46.703443+0000","last_became_active":"2024-08-17T02:24:46.703111+0000","last_became_peered":"2024-08-17T02:24:46.703111+0000","last_unstale":"2024-08-17T02:24:46.703443+0000","last_undegraded":"2024-08-17T02:24:46.703443+0000","last_fullsized":"2024-08-17T02:24:46.703443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695275+0000","last_change":"2024-08-17T02:24:46.695275+0000","last_active":"2024-08-17T02:24:46.695275+0000","last_peered":"2024-08-17T02:24:46.695275+0000","last_clean":"2024-08-17T02:24:46.695275+0000","last_became_active":"2024-08-17T02:24:46.694600+0000","last_became_peered":"2024-08-17T02:24:46.694600+0000","last_unstale":"2024-08-17T02:24:46.695275+0000","last_undegraded":"2024-08-17T02:24:46.695275+0000","last_fullsized":"2024-08-17T02:24:46.695275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703289+0000","last_change":"2024-08-17T02:24:46.703289+0000","last_active":"2024-08-17T02:24:46.703289+0000","last_peered":"2024-08-17T02:24:46.703289+0000","last_clean":"2024-08-17T02:24:46.703289+0000","last_became_active":"2024-08-17T02:24:46.702961+0000","last_became_peered":"2024-08-17T02:24:46.702961+0000","last_unstale":"2024-08-17T02:24:46.703289+0000","last_undegraded":"2024-08-17T02:24:46.703289+0000","last_fullsized":"2024-08-17T02:24:46.703289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:26.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696080+0000","last_change":"2024-08-17T02:24:46.696080+0000","last_active":"2024-08-17T02:24:46.696080+0000","last_peered":"2024-08-17T02:24:46.696080+0000","last_clean":"2024-08-17T02:24:46.696080+0000","last_became_active":"2024-08-17T02:24:46.695753+0000","last_became_peered":"2024-08-17T02:24:46.695753+0000","last_unstale":"2024-08-17T02:24:46.696080+0000","last_undegraded":"2024-08-17T02:24:46.696080+0000","last_fullsized":"2024-08-17T02:24:46.696080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.692695+0000","last_change":"2024-08-17T02:24:46.692695+0000","last_active":"2024-08-17T02:24:46.692695+0000","last_peered":"2024-08-17T02:24:46.692695+0000","last_clean":"2024-08-17T02:24:46.692695+0000","last_became_active":"2024-08-17T02:24:46.691145+0000","last_became_peered":"2024-08-17T02:24:46.691145+0000","last_unstale":"2024-08-17T02:24:46.692695+0000","last_undegraded":"2024-08-17T02:24:46.692695+0000","last_fullsized":"2024-08-17T02:24:46.692695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:25.233681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696761+0000","last_change":"2024-08-17T02:24:46.696761+0000","last_active":"2024-08-17T02:24:46.696761+0000","last_peered":"2024-08-17T02:24:46.696761+0000","last_clean":"2024-08-17T02:24:46.696761+0000","last_became_active":"2024-08-17T02:24:46.695844+0000","last_became_peered":"2024-08-17T02:24:46.695844+0000","last_unstale":"2024-08-17T02:24:46.696761+0000","last_undegraded":"2024-08-17T02:24:46.696761+0000","last_fullsized":"2024-08-17T02:24:46.696761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683038+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:45:02.907069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.683686+0000","last_change":"2024-08-17T02:24:46.683686+0000","last_active":"2024-08-17T02:24:46.683686+0000","last_peered":"2024-08-17T02:24:46.683686+0000","last_clean":"2024-08-17T02:24:46.683686+0000","last_became_active":"2024-08-17T02:24:46.683416+0000","last_became_peered":"2024-08-17T02:24:46.683416+0000","last_unstale":"2024-08-17T02:24:46.683686+0000","last_undegraded":"2024-08-17T02:24:46.683686+0000","last_fullsized":"2024-08-17T02:24:46.683686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:38.075390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.686371+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:04:38.994029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707560+0000","last_change":"2024-08-17T02:24:46.707560+0000","last_active":"2024-08-17T02:24:46.707560+0000","last_peered":"2024-08-17T02:24:46.707560+0000","last_clean":"2024-08-17T02:24:46.707560+0000","last_became_active":"2024-08-17T02:24:46.707234+0000","last_became_peered":"2024-08-17T02:24:46.707234+0000","last_unstale":"2024-08-17T02:24:46.707560+0000","last_undegraded":"2024-08-17T02:24:46.707560+0000","last_fullsized":"2024-08-17T02:24:46.707560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:32.930431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691514+0000","last_change":"2024-08-17T02:24:46.691514+0000","last_active":"2024-08-17T02:24:46.691514+0000","last_peered":"2024-08-17T02:24:46.691514+0000","last_clean":"2024-08-17T02:24:46.691514+0000","last_became_active":"2024-08-17T02:24:46.691231+0000","last_became_peered":"2024-08-17T02:24:46.691231+0000","last_unstale":"2024-08-17T02:24:46.691514+0000","last_undegraded":"2024-08-17T02:24:46.691514+0000","last_fullsized":"2024-08-17T02:24:46.691514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698271+0000","last_change":"2024-08-17T02:24:46.698271+0000","last_active":"2024-08-17T02:24:46.698271+0000","last_peered":"2024-08-17T02:24:46.698271+0000","last_clean":"2024-08-17T02:24:46.698271+0000","last_became_active":"2024-08-17T02:24:46.698020+0000","last_became_peered":"2024-08-17T02:24:46.698020+0000","last_unstale":"2024-08-17T02:24:46.698271+0000","last_undegraded":"2024-08-17T02:24:46.698271+0000","last_fullsized":"2024-08-17T02:24:46.698271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:51.758557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.681671+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:25:33.547382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.684857+0000","last_change":"2024-08-17T02:24:46.684857+0000","last_active":"2024-08-17T02:24:46.684857+0000","last_peered":"2024-08-17T02:24:46.684857+0000","last_clean":"2024-08-17T02:24:46.684857+0000","last_became_active":"2024-08-17T02:24:46.683949+0000","last_became_peered":"2024-08-17T02:24:46.683949+0000","last_unstale":"2024-08-17T02:24:46.684857+0000","last_undegraded":"2024-08-17T02:24:46.684857+0000","last_fullsized":"2024-08-17T02:24:46.684857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:06.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698926+0000","last_change":"2024-08-17T02:24:46.698926+0000","last_active":"2024-08-17T02:24:46.698926+0000","last_peered":"2024-08-17T02:24:46.698926+0000","last_clean":"2024-08-17T02:24:46.698926+0000","last_became_active":"2024-08-17T02:24:46.698650+0000","last_became_peered":"2024-08-17T02:24:46.698650+0000","last_unstale":"2024-08-17T02:24:46.698926+0000","last_undegraded":"2024-08-17T02:24:46.698926+0000","last_fullsized":"2024-08-17T02:24:46.698926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697443+0000","last_change":"2024-08-17T02:24:46.697443+0000","last_active":"2024-08-17T02:24:46.697443+0000","last_peered":"2024-08-17T02:24:46.697443+0000","last_clean":"2024-08-17T02:24:46.697443+0000","last_became_active":"2024-08-17T02:24:46.696404+0000","last_became_peered":"2024-08-17T02:24:46.696404+0000","last_unstale":"2024-08-17T02:24:46.697443+0000","last_undegraded":"2024-08-17T02:24:46.697443+0000","last_fullsized":"2024-08-17T02:24:46.697443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701561+0000","last_change":"2024-08-17T02:24:46.701561+0000","last_active":"2024-08-17T02:24:46.701561+0000","last_peered":"2024-08-17T02:24:46.701561+0000","last_clean":"2024-08-17T02:24:46.701561+0000","last_became_active":"2024-08-17T02:24:46.696208+0000","last_became_peered":"2024-08-17T02:24:46.696208+0000","last_unstale":"2024-08-17T02:24:46.701561+0000","last_undegraded":"2024-08-17T02:24:46.701561+0000","last_fullsized":"2024-08-17T02:24:46.701561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693597+0000","last_change":"2024-08-17T02:24:45.693597+0000","last_active":"2024-08-17T02:24:45.693597+0000","last_peered":"2024-08-17T02:24:45.693597+0000","last_clean":"2024-08-17T02:24:45.693597+0000","last_became_active":"2024-08-17T02:24:45.692136+0000","last_became_peered":"2024-08-17T02:24:45.692136+0000","last_unstale":"2024-08-17T02:24:45.693597+0000","last_undegraded":"2024-08-17T02:24:45.693597+0000","last_fullsized":"2024-08-17T02:24:45.693597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:51.770625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700557+0000","last_change":"2024-08-17T02:24:46.700557+0000","last_active":"2024-08-17T02:24:46.700557+0000","last_peered":"2024-08-17T02:24:46.700557+0000","last_clean":"2024-08-17T02:24:46.700557+0000","last_became_active":"2024-08-17T02:24:46.700114+0000","last_became_peered":"2024-08-17T02:24:46.700114+0000","last_unstale":"2024-08-17T02:24:46.700557+0000","last_undegraded":"2024-08-17T02:24:46.700557+0000","last_fullsized":"2024-08-17T02:24:46.700557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673565+0000","last_change":"2024-08-17T02:24:45.685965+0000","last_active":"2024-08-17T02:24:46.673565+0000","last_peered":"2024-08-17T02:24:46.673565+0000","last_clean":"2024-08-17T02:24:46.673565+0000","last_became_active":"2024-08-17T02:24:45.685019+0000","last_became_peered":"2024-08-17T02:24:45.685019+0000","last_unstale":"2024-08-17T02:24:46.673565+0000","last_undegraded":"2024-08-17T02:24:46.673565+0000","last_fullsized":"2024-08-17T02:24:46.673565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:33.322093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.701270+0000","last_change":"2024-08-17T02:24:45.695657+0000","last_active":"2024-08-17T02:24:45.701270+0000","last_peered":"2024-08-17T02:24:45.701270+0000","last_clean":"2024-08-17T02:24:45.701270+0000","last_became_active":"2024-08-17T02:24:45.695337+0000","last_became_peered":"2024-08-17T02:24:45.695337+0000","last_unstale":"2024-08-17T02:24:45.701270+0000","last_undegraded":"2024-08-17T02:24:45.701270+0000","last_fullsized":"2024-08-17T02:24:45.701270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.680939+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:20:35.140243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.686595+0000","last_change":"2024-08-17T02:24:45.683302+0000","last_active":"2024-08-17T02:24:45.686595+0000","last_peered":"2024-08-17T02:24:45.686595+0000","last_clean":"2024-08-17T02:24:45.686595+0000","last_became_active":"2024-08-17T02:24:45.682641+0000","last_became_peered":"2024-08-17T02:24:45.682641+0000","last_unstale":"2024-08-17T02:24:45.686595+0000","last_undegraded":"2024-08-17T02:24:45.686595+0000","last_fullsized":"2024-08-17T02:24:45.686595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:36.581167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693180+0000","last_change":"2024-08-17T02:24:46.693180+0000","last_active":"2024-08-17T02:24:46.693180+0000","last_peered":"2024-08-17T02:24:46.693180+0000","last_clean":"2024-08-17T02:24:46.693180+0000","last_became_active":"2024-08-17T02:24:46.692910+0000","last_became_peered":"2024-08-17T02:24:46.692910+0000","last_unstale":"2024-08-17T02:24:46.693180+0000","last_undegraded":"2024-08-17T02:24:46.693180+0000","last_fullsized":"2024-08-17T02:24:46.693180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:20.305646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692682+0000","last_change":"2024-08-17T02:24:45.689693+0000","last_active":"2024-08-17T02:24:45.692682+0000","last_peered":"2024-08-17T02:24:45.692682+0000","last_clean":"2024-08-17T02:24:45.692682+0000","last_became_active":"2024-08-17T02:24:45.689396+0000","last_became_peered":"2024-08-17T02:24:45.689396+0000","last_unstale":"2024-08-17T02:24:45.692682+0000","last_undegraded":"2024-08-17T02:24:45.692682+0000","last_fullsized":"2024-08-17T02:24:45.692682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:03:27.829684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707529+0000","last_change":"2024-08-17T02:24:46.707529+0000","last_active":"2024-08-17T02:24:46.707529+0000","last_peered":"2024-08-17T02:24:46.707529+0000","last_clean":"2024-08-17T02:24:46.707529+0000","last_became_active":"2024-08-17T02:24:46.706887+0000","last_became_peered":"2024-08-17T02:24:46.706887+0000","last_unstale":"2024-08-17T02:24:46.707529+0000","last_undegraded":"2024-08-17T02:24:46.707529+0000","last_fullsized":"2024-08-17T02:24:46.707529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693785+0000","last_change":"2024-08-17T02:24:45.689053+0000","last_active":"2024-08-17T02:24:45.693785+0000","last_peered":"2024-08-17T02:24:45.693785+0000","last_clean":"2024-08-17T02:24:45.693785+0000","last_became_active":"2024-08-17T02:24:45.688643+0000","last_became_peered":"2024-08-17T02:24:45.688643+0000","last_unstale":"2024-08-17T02:24:45.693785+0000","last_undegraded":"2024-08-17T02:24:45.693785+0000","last_fullsized":"2024-08-17T02:24:45.693785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683528+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:53.636650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701087+0000","last_change":"2024-08-17T02:24:45.686140+0000","last_active":"2024-08-17T02:24:46.701087+0000","last_peered":"2024-08-17T02:24:46.701087+0000","last_clean":"2024-08-17T02:24:46.701087+0000","last_became_active":"2024-08-17T02:24:45.685732+0000","last_became_peered":"2024-08-17T02:24:45.685732+0000","last_unstale":"2024-08-17T02:24:46.701087+0000","last_undegraded":"2024-08-17T02:24:46.701087+0000","last_fullsized":"2024-08-17T02:24:46.701087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703995+0000","last_change":"2024-08-17T02:24:46.703995+0000","last_active":"2024-08-17T02:24:46.703995+0000","last_peered":"2024-08-17T02:24:46.703995+0000","last_clean":"2024-08-17T02:24:46.703995+0000","last_became_active":"2024-08-17T02:24:46.703632+0000","last_became_peered":"2024-08-17T02:24:46.703632+0000","last_unstale":"2024-08-17T02:24:46.703995+0000","last_undegraded":"2024-08-17T02:24:46.703995+0000","last_fullsized":"2024-08-17T02:24:46.703995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702401+0000","last_change":"2024-08-17T02:24:45.691026+0000","last_active":"2024-08-17T02:24:46.702401+0000","last_peered":"2024-08-17T02:24:46.702401+0000","last_clean":"2024-08-17T02:24:46.702401+0000","last_became_active":"2024-08-17T02:24:45.690499+0000","last_became_peered":"2024-08-17T02:24:45.690499+0000","last_unstale":"2024-08-17T02:24:46.702401+0000","last_undegraded":"2024-08-17T02:24:46.702401+0000","last_fullsized":"2024-08-17T02:24:46.702401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:14.230300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694359+0000","last_change":"2024-08-17T02:24:46.694359+0000","last_active":"2024-08-17T02:24:46.694359+0000","last_peered":"2024-08-17T02:24:46.694359+0000","last_clean":"2024-08-17T02:24:46.694359+0000","last_became_active":"2024-08-17T02:24:46.693812+0000","last_became_peered":"2024-08-17T02:24:46.693812+0000","last_unstale":"2024-08-17T02:24:46.694359+0000","last_undegraded":"2024-08-17T02:24:46.694359+0000","last_fullsized":"2024-08-17T02:24:46.694359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:48:49.063780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703380+0000","last_change":"2024-08-17T02:24:45.689928+0000","last_active":"2024-08-17T02:24:46.703380+0000","last_peered":"2024-08-17T02:24:46.703380+0000","last_clean":"2024-08-17T02:24:46.703380+0000","last_became_active":"2024-08-17T02:24:45.689519+0000","last_became_peered":"2024-08-17T02:24:45.689519+0000","last_unstale":"2024-08-17T02:24:46.703380+0000","last_undegraded":"2024-08-17T02:24:46.703380+0000","last_fullsized":"2024-08-17T02:24:46.703380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708134+0000","last_change":"2024-08-17T02:24:46.708134+0000","last_active":"2024-08-17T02:24:46.708134+0000","last_peered":"2024-08-17T02:24:46.708134+0000","last_clean":"2024-08-17T02:24:46.708134+0000","last_became_active":"2024-08-17T02:24:46.707822+0000","last_became_peered":"2024-08-17T02:24:46.707822+0000","last_unstale":"2024-08-17T02:24:46.708134+0000","last_undegraded":"2024-08-17T02:24:46.708134+0000","last_fullsized":"2024-08-17T02:24:46.708134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692541+0000","last_change":"2024-08-17T02:24:45.686232+0000","last_active":"2024-08-17T02:24:45.692541+0000","last_peered":"2024-08-17T02:24:45.692541+0000","last_clean":"2024-08-17T02:24:45.692541+0000","last_became_active":"2024-08-17T02:24:45.685407+0000","last_became_peered":"2024-08-17T02:24:45.685407+0000","last_unstale":"2024-08-17T02:24:45.692541+0000","last_undegraded":"2024-08-17T02:24:45.692541+0000","last_fullsized":"2024-08-17T02:24:45.692541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700959+0000","last_change":"2024-08-17T02:24:46.700959+0000","last_active":"2024-08-17T02:24:46.700959+0000","last_peered":"2024-08-17T02:24:46.700959+0000","last_clean":"2024-08-17T02:24:46.700959+0000","last_became_active":"2024-08-17T02:24:46.698769+0000","last_became_peered":"2024-08-17T02:24:46.698769+0000","last_unstale":"2024-08-17T02:24:46.700959+0000","last_undegraded":"2024-08-17T02:24:46.700959+0000","last_fullsized":"2024-08-17T02:24:46.700959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693729+0000","last_change":"2024-08-17T02:24:45.687633+0000","last_active":"2024-08-17T02:24:45.693729+0000","last_peered":"2024-08-17T02:24:45.693729+0000","last_clean":"2024-08-17T02:24:45.693729+0000","last_became_active":"2024-08-17T02:24:45.687078+0000","last_became_peered":"2024-08-17T02:24:45.687078+0000","last_unstale":"2024-08-17T02:24:45.693729+0000","last_undegraded":"2024-08-17T02:24:45.693729+0000","last_fullsized":"2024-08-17T02:24:45.693729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696374+0000","last_change":"2024-08-17T02:24:46.696374+0000","last_active":"2024-08-17T02:24:46.696374+0000","last_peered":"2024-08-17T02:24:46.696374+0000","last_clean":"2024-08-17T02:24:46.696374+0000","last_became_active":"2024-08-17T02:24:46.695792+0000","last_became_peered":"2024-08-17T02:24:46.695792+0000","last_unstale":"2024-08-17T02:24:46.696374+0000","last_undegraded":"2024-08-17T02:24:46.696374+0000","last_fullsized":"2024-08-17T02:24:46.696374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.709507+0000","last_change":"2024-08-17T02:24:45.686489+0000","last_active":"2024-08-17T02:24:46.709507+0000","last_peered":"2024-08-17T02:24:46.709507+0000","last_clean":"2024-08-17T02:24:46.709507+0000","last_became_active":"2024-08-17T02:24:45.684809+0000","last_became_peered":"2024-08-17T02:24:45.684809+0000","last_unstale":"2024-08-17T02:24:46.709507+0000","last_undegraded":"2024-08-17T02:24:46.709507+0000","last_fullsized":"2024-08-17T02:24:46.709507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699050+0000","last_change":"2024-08-17T02:24:46.699050+0000","last_active":"2024-08-17T02:24:46.699050+0000","last_peered":"2024-08-17T02:24:46.699050+0000","last_clean":"2024-08-17T02:24:46.699050+0000","last_became_active":"2024-08-17T02:24:46.697848+0000","last_became_peered":"2024-08-17T02:24:46.697848+0000","last_unstale":"2024-08-17T02:24:46.699050+0000","last_undegraded":"2024-08-17T02:24:46.699050+0000","last_fullsized":"2024-08-17T02:24:46.699050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.684337+0000","last_change":"2024-08-17T02:24:45.696348+0000","last_active":"2024-08-17T02:24:46.684337+0000","last_peered":"2024-08-17T02:24:46.684337+0000","last_clean":"2024-08-17T02:24:46.684337+0000","last_became_active":"2024-08-17T02:24:45.695978+0000","last_became_peered":"2024-08-17T02:24:45.695978+0000","last_unstale":"2024-08-17T02:24:46.684337+0000","last_undegraded":"2024-08-17T02:24:46.684337+0000","last_fullsized":"2024-08-17T02:24:46.684337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698921+0000","last_change":"2024-08-17T02:24:46.698921+0000","last_active":"2024-08-17T02:24:46.698921+0000","last_peered":"2024-08-17T02:24:46.698921+0000","last_clean":"2024-08-17T02:24:46.698921+0000","last_became_active":"2024-08-17T02:24:46.698688+0000","last_became_peered":"2024-08-17T02:24:46.698688+0000","last_unstale":"2024-08-17T02:24:46.698921+0000","last_undegraded":"2024-08-17T02:24:46.698921+0000","last_fullsized":"2024-08-17T02:24:46.698921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:37.590898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701719+0000","last_change":"2024-08-17T02:24:45.699315+0000","last_active":"2024-08-17T02:24:46.701719+0000","last_peered":"2024-08-17T02:24:46.701719+0000","last_clean":"2024-08-17T02:24:46.701719+0000","last_became_active":"2024-08-17T02:24:45.698964+0000","last_became_peered":"2024-08-17T02:24:45.698964+0000","last_unstale":"2024-08-17T02:24:46.701719+0000","last_undegraded":"2024-08-17T02:24:46.701719+0000","last_fullsized":"2024-08-17T02:24:46.701719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696697+0000","last_change":"2024-08-17T02:24:46.696697+0000","last_active":"2024-08-17T02:24:46.696697+0000","last_peered":"2024-08-17T02:24:46.696697+0000","last_clean":"2024-08-17T02:24:46.696697+0000","last_became_active":"2024-08-17T02:24:46.696387+0000","last_became_peered":"2024-08-17T02:24:46.696387+0000","last_unstale":"2024-08-17T02:24:46.696697+0000","last_undegraded":"2024-08-17T02:24:46.696697+0000","last_fullsized":"2024-08-17T02:24:46.696697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693896+0000","last_change":"2024-08-17T02:24:45.693896+0000","last_active":"2024-08-17T02:24:45.693896+0000","last_peered":"2024-08-17T02:24:45.693896+0000","last_clean":"2024-08-17T02:24:45.693896+0000","last_became_active":"2024-08-17T02:24:45.693694+0000","last_became_peered":"2024-08-17T02:24:45.693694+0000","last_unstale":"2024-08-17T02:24:45.693896+0000","last_undegraded":"2024-08-17T02:24:45.693896+0000","last_fullsized":"2024-08-17T02:24:45.693896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:25.447726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695064+0000","last_change":"2024-08-17T02:24:46.695064+0000","last_active":"2024-08-17T02:24:46.695064+0000","last_peered":"2024-08-17T02:24:46.695064+0000","last_clean":"2024-08-17T02:24:46.695064+0000","last_became_active":"2024-08-17T02:24:46.694303+0000","last_became_peered":"2024-08-17T02:24:46.694303+0000","last_unstale":"2024-08-17T02:24:46.695064+0000","last_undegraded":"2024-08-17T02:24:46.695064+0000","last_fullsized":"2024-08-17T02:24:46.695064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.695865+0000","last_change":"2024-08-17T02:24:45.693363+0000","last_active":"2024-08-17T02:24:45.695865+0000","last_peered":"2024-08-17T02:24:45.695865+0000","last_clean":"2024-08-17T02:24:45.695865+0000","last_became_active":"2024-08-17T02:24:45.693114+0000","last_became_peered":"2024-08-17T02:24:45.693114+0000","last_unstale":"2024-08-17T02:24:45.695865+0000","last_undegraded":"2024-08-17T02:24:45.695865+0000","last_fullsized":"2024-08-17T02:24:45.695865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703793+0000","last_change":"2024-08-17T02:24:46.703793+0000","last_active":"2024-08-17T02:24:46.703793+0000","last_peered":"2024-08-17T02:24:46.703793+0000","last_clean":"2024-08-17T02:24:46.703793+0000","last_became_active":"2024-08-17T02:24:46.703493+0000","last_became_peered":"2024-08-17T02:24:46.703493+0000","last_unstale":"2024-08-17T02:24:46.703793+0000","last_undegraded":"2024-08-17T02:24:46.703793+0000","last_fullsized":"2024-08-17T02:24:46.703793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":162,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.681783+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:24:45.681783+0000","last_peered":"2024-08-17T02:24:45.681783+0000","last_clean":"2024-08-17T02:24:45.681783+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:24:45.681783+0000","last_undegraded":"2024-08-17T02:24:45.681783+0000","last_fullsized":"2024-08-17T02:24:45.681783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.690926+0000","last_change":"2024-08-17T02:24:45.684657+0000","last_active":"2024-08-17T02:24:45.690926+0000","last_peered":"2024-08-17T02:24:45.690926+0000","last_clean":"2024-08-17T02:24:45.690926+0000","last_became_active":"2024-08-17T02:24:45.683930+0000","last_became_peered":"2024-08-17T02:24:45.683930+0000","last_unstale":"2024-08-17T02:24:45.690926+0000","last_undegraded":"2024-08-17T02:24:45.690926+0000","last_fullsized":"2024-08-17T02:24:45.690926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690032+0000","last_change":"2024-08-17T02:24:46.690032+0000","last_active":"2024-08-17T02:24:46.690032+0000","last_peered":"2024-08-17T02:24:46.690032+0000","last_clean":"2024-08-17T02:24:46.690032+0000","last_became_active":"2024-08-17T02:24:46.689692+0000","last_became_peered":"2024-08-17T02:24:46.689692+0000","last_unstale":"2024-08-17T02:24:46.690032+0000","last_undegraded":"2024-08-17T02:24:46.690032+0000","last_fullsized":"2024-08-17T02:24:46.690032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:49.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.696106+0000","last_change":"2024-08-17T02:24:45.695195+0000","last_active":"2024-08-17T02:24:45.696106+0000","last_peered":"2024-08-17T02:24:45.696106+0000","last_clean":"2024-08-17T02:24:45.696106+0000","last_became_active":"2024-08-17T02:24:45.694908+0000","last_became_peered":"2024-08-17T02:24:45.694908+0000","last_unstale":"2024-08-17T02:24:45.696106+0000","last_undegraded":"2024-08-17T02:24:45.696106+0000","last_fullsized":"2024-08-17T02:24:45.696106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698400+0000","last_change":"2024-08-17T02:24:46.698400+0000","last_active":"2024-08-17T02:24:46.698400+0000","last_peered":"2024-08-17T02:24:46.698400+0000","last_clean":"2024-08-17T02:24:46.698400+0000","last_became_active":"2024-08-17T02:24:46.697641+0000","last_became_peered":"2024-08-17T02:24:46.697641+0000","last_unstale":"2024-08-17T02:24:46.698400+0000","last_undegraded":"2024-08-17T02:24:46.698400+0000","last_fullsized":"2024-08-17T02:24:46.698400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.701104+0000","last_change":"2024-08-17T02:24:45.696585+0000","last_active":"2024-08-17T02:24:45.701104+0000","last_peered":"2024-08-17T02:24:45.701104+0000","last_clean":"2024-08-17T02:24:45.701104+0000","last_became_active":"2024-08-17T02:24:45.696243+0000","last_became_peered":"2024-08-17T02:24:45.696243+0000","last_unstale":"2024-08-17T02:24:45.701104+0000","last_undegraded":"2024-08-17T02:24:45.701104+0000","last_fullsized":"2024-08-17T02:24:45.701104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.685570+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:38:17.216750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692732+0000","last_change":"2024-08-17T02:24:45.689974+0000","last_active":"2024-08-17T02:24:45.692732+0000","last_peered":"2024-08-17T02:24:45.692732+0000","last_clean":"2024-08-17T02:24:45.692732+0000","last_became_active":"2024-08-17T02:24:45.689686+0000","last_became_peered":"2024-08-17T02:24:45.689686+0000","last_unstale":"2024-08-17T02:24:45.692732+0000","last_undegraded":"2024-08-17T02:24:45.692732+0000","last_fullsized":"2024-08-17T02:24:45.692732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:02.113673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.695491+0000","last_change":"2024-08-17T02:24:46.695491+0000","last_active":"2024-08-17T02:24:46.695491+0000","last_peered":"2024-08-17T02:24:46.695491+0000","last_clean":"2024-08-17T02:24:46.695491+0000","last_became_active":"2024-08-17T02:24:46.694910+0000","last_became_peered":"2024-08-17T02:24:46.694910+0000","last_unstale":"2024-08-17T02:24:46.695491+0000","last_undegraded":"2024-08-17T02:24:46.695491+0000","last_fullsized":"2024-08-17T02:24:46.695491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:17.309712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.693494+0000","last_change":"2024-08-17T02:24:45.693494+0000","last_active":"2024-08-17T02:24:45.693494+0000","last_peered":"2024-08-17T02:24:45.693494+0000","last_clean":"2024-08-17T02:24:45.693494+0000","last_became_active":"2024-08-17T02:24:45.691399+0000","last_became_peered":"2024-08-17T02:24:45.691399+0000","last_unstale":"2024-08-17T02:24:45.693494+0000","last_undegraded":"2024-08-17T02:24:45.693494+0000","last_fullsized":"2024-08-17T02:24:45.693494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:47.538687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.697272+0000","last_change":"2024-08-17T02:24:46.697272+0000","last_active":"2024-08-17T02:24:46.697272+0000","last_peered":"2024-08-17T02:24:46.697272+0000","last_clean":"2024-08-17T02:24:46.697272+0000","last_became_active":"2024-08-17T02:24:46.696866+0000","last_became_peered":"2024-08-17T02:24:46.696866+0000","last_unstale":"2024-08-17T02:24:46.697272+0000","last_undegraded":"2024-08-17T02:24:46.697272+0000","last_fullsized":"2024-08-17T02:24:46.697272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692661+0000","last_change":"2024-08-17T02:24:45.689340+0000","last_active":"2024-08-17T02:24:45.692661+0000","last_peered":"2024-08-17T02:24:45.692661+0000","last_clean":"2024-08-17T02:24:45.692661+0000","last_became_active":"2024-08-17T02:24:45.687263+0000","last_became_peered":"2024-08-17T02:24:45.687263+0000","last_unstale":"2024-08-17T02:24:45.692661+0000","last_undegraded":"2024-08-17T02:24:45.692661+0000","last_fullsized":"2024-08-17T02:24:45.692661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.687663+0000","last_change":"2024-08-17T02:24:46.687663+0000","last_active":"2024-08-17T02:24:46.687663+0000","last_peered":"2024-08-17T02:24:46.687663+0000","last_clean":"2024-08-17T02:24:46.687663+0000","last_became_active":"2024-08-17T02:24:46.687285+0000","last_became_peered":"2024-08-17T02:24:46.687285+0000","last_unstale":"2024-08-17T02:24:46.687663+0000","last_undegraded":"2024-08-17T02:24:46.687663+0000","last_fullsized":"2024-08-17T02:24:46.687663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.695885+0000","last_change":"2024-08-17T02:24:45.692340+0000","last_active":"2024-08-17T02:24:45.695885+0000","last_peered":"2024-08-17T02:24:45.695885+0000","last_clean":"2024-08-17T02:24:45.695885+0000","last_became_active":"2024-08-17T02:24:45.691959+0000","last_became_peered":"2024-08-17T02:24:45.691959+0000","last_unstale":"2024-08-17T02:24:45.695885+0000","last_undegraded":"2024-08-17T02:24:45.695885+0000","last_fullsized":"2024-08-17T02:24:45.695885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699671+0000","last_change":"2024-08-17T02:24:46.699671+0000","last_active":"2024-08-17T02:24:46.699671+0000","last_peered":"2024-08-17T02:24:46.699671+0000","last_clean":"2024-08-17T02:24:46.699671+0000","last_became_active":"2024-08-17T02:24:46.699384+0000","last_became_peered":"2024-08-17T02:24:46.699384+0000","last_unstale":"2024-08-17T02:24:46.699671+0000","last_undegraded":"2024-08-17T02:24:46.699671+0000","last_fullsized":"2024-08-17T02:24:46.699671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706478+0000","last_change":"2024-08-17T02:24:45.689016+0000","last_active":"2024-08-17T02:24:46.706478+0000","last_peered":"2024-08-17T02:24:46.706478+0000","last_clean":"2024-08-17T02:24:46.706478+0000","last_became_active":"2024-08-17T02:24:45.688568+0000","last_became_peered":"2024-08-17T02:24:45.688568+0000","last_unstale":"2024-08-17T02:24:46.706478+0000","last_undegraded":"2024-08-17T02:24:46.706478+0000","last_fullsized":"2024-08-17T02:24:46.706478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:31.920700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.690217+0000","last_change":"2024-08-17T02:24:46.690217+0000","last_active":"2024-08-17T02:24:46.690217+0000","last_peered":"2024-08-17T02:24:46.690217+0000","last_clean":"2024-08-17T02:24:46.690217+0000","last_became_active":"2024-08-17T02:24:46.689945+0000","last_became_peered":"2024-08-17T02:24:46.689945+0000","last_unstale":"2024-08-17T02:24:46.690217+0000","last_undegraded":"2024-08-17T02:24:46.690217+0000","last_fullsized":"2024-08-17T02:24:46.690217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.696490+0000","last_change":"2024-08-17T02:24:45.692162+0000","last_active":"2024-08-17T02:24:45.696490+0000","last_peered":"2024-08-17T02:24:45.696490+0000","last_clean":"2024-08-17T02:24:45.696490+0000","last_became_active":"2024-08-17T02:24:45.691864+0000","last_became_peered":"2024-08-17T02:24:45.691864+0000","last_unstale":"2024-08-17T02:24:45.696490+0000","last_undegraded":"2024-08-17T02:24:45.696490+0000","last_fullsized":"2024-08-17T02:24:45.696490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693752+0000","last_change":"2024-08-17T02:24:46.693752+0000","last_active":"2024-08-17T02:24:46.693752+0000","last_peered":"2024-08-17T02:24:46.693752+0000","last_clean":"2024-08-17T02:24:46.693752+0000","last_became_active":"2024-08-17T02:24:46.693452+0000","last_became_peered":"2024-08-17T02:24:46.693452+0000","last_unstale":"2024-08-17T02:24:46.693752+0000","last_undegraded":"2024-08-17T02:24:46.693752+0000","last_fullsized":"2024-08-17T02:24:46.693752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.504743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.698413+0000","last_change":"2024-08-17T02:24:45.695549+0000","last_active":"2024-08-17T02:24:45.698413+0000","last_peered":"2024-08-17T02:24:45.698413+0000","last_clean":"2024-08-17T02:24:45.698413+0000","last_became_active":"2024-08-17T02:24:45.695270+0000","last_became_peered":"2024-08-17T02:24:45.695270+0000","last_unstale":"2024-08-17T02:24:45.698413+0000","last_undegraded":"2024-08-17T02:24:45.698413+0000","last_fullsized":"2024-08-17T02:24:45.698413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.689650+0000","last_change":"2024-08-17T02:24:46.689650+0000","last_active":"2024-08-17T02:24:46.689650+0000","last_peered":"2024-08-17T02:24:46.689650+0000","last_clean":"2024-08-17T02:24:46.689650+0000","last_became_active":"2024-08-17T02:24:46.689361+0000","last_became_peered":"2024-08-17T02:24:46.689361+0000","last_unstale":"2024-08-17T02:24:46.689650+0000","last_undegraded":"2024-08-17T02:24:46.689650+0000","last_fullsized":"2024-08-17T02:24:46.689650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.692092+0000","last_change":"2024-08-17T02:24:45.688479+0000","last_active":"2024-08-17T02:24:45.692092+0000","last_peered":"2024-08-17T02:24:45.692092+0000","last_clean":"2024-08-17T02:24:45.692092+0000","last_became_active":"2024-08-17T02:24:45.688105+0000","last_became_peered":"2024-08-17T02:24:45.688105+0000","last_unstale":"2024-08-17T02:24:45.692092+0000","last_undegraded":"2024-08-17T02:24:45.692092+0000","last_fullsized":"2024-08-17T02:24:45.692092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.693894+0000","last_change":"2024-08-17T02:24:46.693894+0000","last_active":"2024-08-17T02:24:46.693894+0000","last_peered":"2024-08-17T02:24:46.693894+0000","last_clean":"2024-08-17T02:24:46.693894+0000","last_became_active":"2024-08-17T02:24:46.693611+0000","last_became_peered":"2024-08-17T02:24:46.693611+0000","last_unstale":"2024-08-17T02:24:46.693894+0000","last_undegraded":"2024-08-17T02:24:46.693894+0000","last_fullsized":"2024-08-17T02:24:46.693894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706309+0000","last_change":"2024-08-17T02:24:45.684136+0000","last_active":"2024-08-17T02:24:46.706309+0000","last_peered":"2024-08-17T02:24:46.706309+0000","last_clean":"2024-08-17T02:24:46.706309+0000","last_became_active":"2024-08-17T02:24:45.683723+0000","last_became_peered":"2024-08-17T02:24:45.683723+0000","last_unstale":"2024-08-17T02:24:46.706309+0000","last_undegraded":"2024-08-17T02:24:46.706309+0000","last_fullsized":"2024-08-17T02:24:46.706309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691308+0000","last_change":"2024-08-17T02:24:46.691308+0000","last_active":"2024-08-17T02:24:46.691308+0000","last_peered":"2024-08-17T02:24:46.691308+0000","last_clean":"2024-08-17T02:24:46.691308+0000","last_became_active":"2024-08-17T02:24:46.691046+0000","last_became_peered":"2024-08-17T02:24:46.691046+0000","last_unstale":"2024-08-17T02:24:46.691308+0000","last_undegraded":"2024-08-17T02:24:46.691308+0000","last_fullsized":"2024-08-17T02:24:46.691308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699150+0000","last_change":"2024-08-17T02:24:46.699150+0000","last_active":"2024-08-17T02:24:46.699150+0000","last_peered":"2024-08-17T02:24:46.699150+0000","last_clean":"2024-08-17T02:24:46.699150+0000","last_became_active":"2024-08-17T02:24:46.697504+0000","last_became_peered":"2024-08-17T02:24:46.697504+0000","last_unstale":"2024-08-17T02:24:46.699150+0000","last_undegraded":"2024-08-17T02:24:46.699150+0000","last_fullsized":"2024-08-17T02:24:46.699150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710964+0000","last_change":"2024-08-17T02:24:45.690864+0000","last_active":"2024-08-17T02:24:46.710964+0000","last_peered":"2024-08-17T02:24:46.710964+0000","last_clean":"2024-08-17T02:24:46.710964+0000","last_became_active":"2024-08-17T02:24:45.687405+0000","last_became_peered":"2024-08-17T02:24:45.687405+0000","last_unstale":"2024-08-17T02:24:46.710964+0000","last_undegraded":"2024-08-17T02:24:46.710964+0000","last_fullsized":"2024-08-17T02:24:46.710964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":8,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702644+0000","last_change":"2024-08-17T02:24:46.702644+0000","last_active":"2024-08-17T02:24:46.702644+0000","last_peered":"2024-08-17T02:24:46.702644+0000","last_clean":"2024-08-17T02:24:46.702644+0000","last_became_active":"2024-08-17T02:24:46.701576+0000","last_became_peered":"2024-08-17T02:24:46.701576+0000","last_unstale":"2024-08-17T02:24:46.702644+0000","last_undegraded":"2024-08-17T02:24:46.702644+0000","last_fullsized":"2024-08-17T02:24:46.702644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:12.393424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710485+0000","last_change":"2024-08-17T02:24:45.689395+0000","last_active":"2024-08-17T02:24:46.710485+0000","last_peered":"2024-08-17T02:24:46.710485+0000","last_clean":"2024-08-17T02:24:46.710485+0000","last_became_active":"2024-08-17T02:24:45.689082+0000","last_became_peered":"2024-08-17T02:24:45.689082+0000","last_unstale":"2024-08-17T02:24:46.710485+0000","last_undegraded":"2024-08-17T02:24:46.710485+0000","last_fullsized":"2024-08-17T02:24:46.710485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.685140+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:42.849100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":8,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:24:45.687064+0000","last_change":"2024-08-17T02:24:45.687064+0000","last_active":"2024-08-17T02:24:45.687064+0000","last_peered":"2024-08-17T02:24:45.687064+0000","last_clean":"2024-08-17T02:24:45.687064+0000","last_became_active":"2024-08-17T02:24:45.686543+0000","last_became_peered":"2024-08-17T02:24:45.686543+0000","last_unstale":"2024-08-17T02:24:45.687064+0000","last_undegraded":"2024-08-17T02:24:45.687064+0000","last_fullsized":"2024-08-17T02:24:45.687064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:47.125586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:24:45.654560+0000","last_change":"2024-08-17T02:24:45.683230+0000","last_active":"2024-08-17T02:24:45.654560+0000","last_peered":"2024-08-17T02:24:45.654560+0000","last_clean":"2024-08-17T02:24:45.654560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:24:45.654560+0000","last_undegraded":"2024-08-17T02:24:45.654560+0000","last_fullsized":"2024-08-17T02:24:45.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:10:27.265830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708733+0000","last_change":"2024-08-17T02:24:45.687257+0000","last_active":"2024-08-17T02:24:46.708733+0000","last_peered":"2024-08-17T02:24:46.708733+0000","last_clean":"2024-08-17T02:24:46.708733+0000","last_became_active":"2024-08-17T02:24:45.686911+0000","last_became_peered":"2024-08-17T02:24:45.686911+0000","last_unstale":"2024-08-17T02:24:46.708733+0000","last_undegraded":"2024-08-17T02:24:46.708733+0000","last_fullsized":"2024-08-17T02:24:46.708733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2268,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":74467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":74343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":241664,"data_stored":76555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":225280,"data_stored":74913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":233472,"data_stored":75895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":819200,"data_stored":664781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":74399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":802816,"data_stored":657948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:54.124 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:54.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.234+0000 7f73ebfff700 1 Processor -- start 2024-08-17T02:24:54.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.234+0000 7f73ebfff700 1 -- start start 2024-08-17T02:24:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f73ec0cd880 0x7f73ec159250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73ec0afe60 0x7f73ec0aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec0abf80 con 0x7f73ec158e80 2024-08-17T02:24:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec06e7a0 con 0x7f73ec0cd880 2024-08-17T02:24:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0ac1c0 con 0x7f73ec0afe60 2024-08-17T02:24:54.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ea7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f73ec0cd880 0x7f73ec159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73eaffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f73ec158e80 0x7f73ec0ab870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58374/0 (socket says 172.21.15.31:58374) 2024-08-17T02:24:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73eaffd700 1 -- 172.21.15.31:0/1111502181 learned_addr learned my addr 172.21.15.31:0/1111502181 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:54.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73eb7fe700 1 --2- 172.21.15.31:0/1111502181 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73ec0afe60 0x7f73ec0aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ea7fc700 1 -- 172.21.15.31:0/1111502181 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73ec0afe60 msgr2=0x7f73ec0aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ea7fc700 1 --2- 172.21.15.31:0/1111502181 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73ec0afe60 0x7f73ec0aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ea7fc700 1 -- 172.21.15.31:0/1111502181 >> v1:172.21.15.31:6789/0 conn(0x7f73ec158e80 legacy=0x7f73ec0ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ea7fc700 1 -- 172.21.15.31:0/1111502181 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec0ac4a0 con 0x7f73ec0cd880 2024-08-17T02:24:54.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73e9ffb700 1 -- 172.21.15.31:0/1111502181 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170633680 0 0) 0x7f73dc001490 con 0x7f73ec158e80 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ea7fc700 1 --2- 172.21.15.31:0/1111502181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec0cd880 0x7f73ec159250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73d40098e0 tx=0x7f73d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eb47a04fab36ad server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73e9ffb700 1 -- 172.21.15.31:0/1111502181 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400b640 con 0x7f73ec0cd880 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73e9ffb700 1 -- 172.21.15.31:0/1111502181 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d400b7a0 con 0x7f73ec0cd880 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73e9ffb700 1 -- 172.21.15.31:0/1111502181 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400bb40 con 0x7f73ec0cd880 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 -- 172.21.15.31:0/1111502181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec0cd880 msgr2=0x7f73ec159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 --2- 172.21.15.31:0/1111502181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec0cd880 0x7f73ec159250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73d40098e0 tx=0x7f73d40091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 -- 172.21.15.31:0/1111502181 shutdown_connections 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 --2- 172.21.15.31:0/1111502181 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73ec0afe60 0x7f73ec0aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 --2- 172.21.15.31:0/1111502181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec0cd880 0x7f73ec159250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 -- 172.21.15.31:0/1111502181 >> 172.21.15.31:0/1111502181 conn(0x7f73ec063b20 msgr2=0x7f73ec06b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 -- 172.21.15.31:0/1111502181 shutdown_connections 2024-08-17T02:24:54.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.238+0000 7f73ebfff700 1 -- 172.21.15.31:0/1111502181 wait complete. 2024-08-17T02:24:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ebfff700 1 Processor -- start 2024-08-17T02:24:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ebfff700 1 -- start start 2024-08-17T02:24:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec0afe60 0x7f73ec159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ebfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73ec0cd880 0x7f73ec15a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec158e80 0x7f73ec0cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ebfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec15ae10 con 0x7f73ec158e80 2024-08-17T02:24:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ebfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec15a440 con 0x7f73ec0afe60 2024-08-17T02:24:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ebfff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0cc130 con 0x7f73ec0cd880 2024-08-17T02:24:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73eb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec158e80 0x7f73ec0cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73eb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec158e80 0x7f73ec0cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48556/0 (socket says 172.21.15.31:48556) 2024-08-17T02:24:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73eb7fe700 1 -- 172.21.15.31:0/2182944254 learned_addr learned my addr 172.21.15.31:0/2182944254 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ea7fc700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73ec0cd880 0x7f73ec15a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73eaffd700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec0afe60 0x7f73ec159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73eb7fe700 1 -- 172.21.15.31:0/2182944254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73ec0cd880 msgr2=0x7f73ec15a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73eb7fe700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73ec0cd880 0x7f73ec15a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73eb7fe700 1 -- 172.21.15.31:0/2182944254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec0afe60 msgr2=0x7f73ec159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73eb7fe700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec0afe60 0x7f73ec159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73eb7fe700 1 -- 172.21.15.31:0/2182944254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4009420 con 0x7f73ec158e80 2024-08-17T02:24:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73eb7fe700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec158e80 0x7f73ec0cbbf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f73e400ea50 tx=0x7f73e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73e2ffd700 1 -- 172.21.15.31:0/2182944254 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400ee90 con 0x7f73ec158e80 2024-08-17T02:24:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ebfff700 1 -- 172.21.15.31:0/2182944254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec159830 con 0x7f73ec158e80 2024-08-17T02:24:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73e2ffd700 1 -- 172.21.15.31:0/2182944254 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400c7f0 con 0x7f73ec158e80 2024-08-17T02:24:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73e2ffd700 1 -- 172.21.15.31:0/2182944254 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400cbb0 con 0x7f73ec158e80 2024-08-17T02:24:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.242+0000 7f73ebfff700 1 -- 172.21.15.31:0/2182944254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec159df0 con 0x7f73ec158e80 2024-08-17T02:24:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.246+0000 7f73ebfff700 1 -- 172.21.15.31:0/2182944254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec15a5b0 con 0x7f73ec158e80 2024-08-17T02:24:54.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.246+0000 7f73e2ffd700 1 -- 172.21.15.31:0/2182944254 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f73e4013470 con 0x7f73ec158e80 2024-08-17T02:24:54.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.250+0000 7f73e2ffd700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73cc060890 0x7f73cc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.250+0000 7f73e2ffd700 1 -- 172.21.15.31:0/2182944254 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73e407d570 con 0x7f73ec158e80 2024-08-17T02:24:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.250+0000 7f73eaffd700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73cc060890 0x7f73cc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.250+0000 7f73eaffd700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73cc060890 0x7f73cc062d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73dc007240 tx=0x7f73dc001970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.254+0000 7f73e2ffd700 1 -- 172.21.15.31:0/2182944254 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f73e404d9c0 con 0x7f73ec158e80 2024-08-17T02:24:54.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.418+0000 7f73ebfff700 1 -- 172.21.15.31:0/2182944254 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73ec0712b0 con 0x7f73cc060890 2024-08-17T02:24:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.430+0000 7f73e2ffd700 1 -- 172.21.15.31:0/2182944254 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264538 (secure 0 0 0) 0x7f73ec0712b0 con 0x7f73cc060890 2024-08-17T02:24:54.442 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 -- 172.21.15.31:0/2182944254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73cc060890 msgr2=0x7f73cc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73cc060890 0x7f73cc062d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73dc007240 tx=0x7f73dc001970 comp rx=0 tx=0).stop 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 -- 172.21.15.31:0/2182944254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec158e80 msgr2=0x7f73ec0cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec158e80 0x7f73ec0cbbf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f73e400ea50 tx=0x7f73e40091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 -- 172.21.15.31:0/2182944254 shutdown_connections 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73cc060890 0x7f73cc062d40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73ec158e80 0x7f73ec0cbbf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73ec0cd880 0x7f73ec15a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 --2- 172.21.15.31:0/2182944254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73ec0afe60 0x7f73ec159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 -- 172.21.15.31:0/2182944254 >> 172.21.15.31:0/2182944254 conn(0x7f73ec063b20 msgr2=0x7f73ec155760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 -- 172.21.15.31:0/2182944254 shutdown_connections 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.438+0000 7f73ebfff700 1 -- 172.21.15.31:0/2182944254 wait complete. 2024-08-17T02:24:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:24:54.457 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-08-17T02:24:53.584096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381932,"kb_used_data":3048,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592788,"statfs":{"total":773094113280,"available":770655014912,"internally_reserved":0,"allocated":3121152,"data_stored":1830460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.916902"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714546+0000","last_change":"2024-08-17T02:24:46.711137+0000","last_active":"2024-08-17T02:24:46.714546+0000","last_peered":"2024-08-17T02:24:46.714546+0000","last_clean":"2024-08-17T02:24:46.714546+0000","last_became_active":"2024-08-17T02:24:46.710820+0000","last_became_peered":"2024-08-17T02:24:46.710820+0000","last_unstale":"2024-08-17T02:24:46.714546+0000","last_undegraded":"2024-08-17T02:24:46.714546+0000","last_fullsized":"2024-08-17T02:24:46.714546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696492+0000","last_change":"2024-08-17T02:24:46.689088+0000","last_active":"2024-08-17T02:24:46.696492+0000","last_peered":"2024-08-17T02:24:46.696492+0000","last_clean":"2024-08-17T02:24:46.696492+0000","last_became_active":"2024-08-17T02:24:46.688753+0000","last_became_peered":"2024-08-17T02:24:46.688753+0000","last_unstale":"2024-08-17T02:24:46.696492+0000","last_undegraded":"2024-08-17T02:24:46.696492+0000","last_fullsized":"2024-08-17T02:24:46.696492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:20.964222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700771+0000","last_change":"2024-08-17T02:24:46.695883+0000","last_active":"2024-08-17T02:24:46.700771+0000","last_peered":"2024-08-17T02:24:46.700771+0000","last_clean":"2024-08-17T02:24:46.700771+0000","last_became_active":"2024-08-17T02:24:46.695594+0000","last_became_peered":"2024-08-17T02:24:46.695594+0000","last_unstale":"2024-08-17T02:24:46.700771+0000","last_undegraded":"2024-08-17T02:24:46.700771+0000","last_fullsized":"2024-08-17T02:24:46.700771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:45:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707546+0000","last_change":"2024-08-17T02:24:46.702343+0000","last_active":"2024-08-17T02:24:46.707546+0000","last_peered":"2024-08-17T02:24:46.707546+0000","last_clean":"2024-08-17T02:24:46.707546+0000","last_became_active":"2024-08-17T02:24:46.700536+0000","last_became_peered":"2024-08-17T02:24:46.700536+0000","last_unstale":"2024-08-17T02:24:46.707546+0000","last_undegraded":"2024-08-17T02:24:46.707546+0000","last_fullsized":"2024-08-17T02:24:46.707546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702344+0000","last_change":"2024-08-17T02:24:46.697977+0000","last_active":"2024-08-17T02:24:46.702344+0000","last_peered":"2024-08-17T02:24:46.702344+0000","last_clean":"2024-08-17T02:24:46.702344+0000","last_became_active":"2024-08-17T02:24:46.697680+0000","last_became_peered":"2024-08-17T02:24:46.697680+0000","last_unstale":"2024-08-17T02:24:46.702344+0000","last_undegraded":"2024-08-17T02:24:46.702344+0000","last_fullsized":"2024-08-17T02:24:46.702344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698897+0000","last_change":"2024-08-17T02:24:46.696070+0000","last_active":"2024-08-17T02:24:46.698897+0000","last_peered":"2024-08-17T02:24:46.698897+0000","last_clean":"2024-08-17T02:24:46.698897+0000","last_became_active":"2024-08-17T02:24:46.693809+0000","last_became_peered":"2024-08-17T02:24:46.693809+0000","last_unstale":"2024-08-17T02:24:46.698897+0000","last_undegraded":"2024-08-17T02:24:46.698897+0000","last_fullsized":"2024-08-17T02:24:46.698897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699991+0000","last_change":"2024-08-17T02:24:46.694034+0000","last_active":"2024-08-17T02:24:46.699991+0000","last_peered":"2024-08-17T02:24:46.699991+0000","last_clean":"2024-08-17T02:24:46.699991+0000","last_became_active":"2024-08-17T02:24:46.693720+0000","last_became_peered":"2024-08-17T02:24:46.693720+0000","last_unstale":"2024-08-17T02:24:46.699991+0000","last_undegraded":"2024-08-17T02:24:46.699991+0000","last_fullsized":"2024-08-17T02:24:46.699991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:25.120018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703650+0000","last_change":"2024-08-17T02:24:46.698687+0000","last_active":"2024-08-17T02:24:46.703650+0000","last_peered":"2024-08-17T02:24:46.703650+0000","last_clean":"2024-08-17T02:24:46.703650+0000","last_became_active":"2024-08-17T02:24:46.698410+0000","last_became_peered":"2024-08-17T02:24:46.698410+0000","last_unstale":"2024-08-17T02:24:46.703650+0000","last_undegraded":"2024-08-17T02:24:46.703650+0000","last_fullsized":"2024-08-17T02:24:46.703650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:40:14.395986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714270+0000","last_change":"2024-08-17T02:24:46.710805+0000","last_active":"2024-08-17T02:24:46.714270+0000","last_peered":"2024-08-17T02:24:46.714270+0000","last_clean":"2024-08-17T02:24:46.714270+0000","last_became_active":"2024-08-17T02:24:46.710510+0000","last_became_peered":"2024-08-17T02:24:46.710510+0000","last_unstale":"2024-08-17T02:24:46.714270+0000","last_undegraded":"2024-08-17T02:24:46.714270+0000","last_fullsized":"2024-08-17T02:24:46.714270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702497+0000","last_change":"2024-08-17T02:24:46.695508+0000","last_active":"2024-08-17T02:24:46.702497+0000","last_peered":"2024-08-17T02:24:46.702497+0000","last_clean":"2024-08-17T02:24:46.702497+0000","last_became_active":"2024-08-17T02:24:46.695174+0000","last_became_peered":"2024-08-17T02:24:46.695174+0000","last_unstale":"2024-08-17T02:24:46.702497+0000","last_undegraded":"2024-08-17T02:24:46.702497+0000","last_fullsized":"2024-08-17T02:24:46.702497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:26.358220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714534+0000","last_change":"2024-08-17T02:24:46.711058+0000","last_active":"2024-08-17T02:24:46.714534+0000","last_peered":"2024-08-17T02:24:46.714534+0000","last_clean":"2024-08-17T02:24:46.714534+0000","last_became_active":"2024-08-17T02:24:46.710739+0000","last_became_peered":"2024-08-17T02:24:46.710739+0000","last_unstale":"2024-08-17T02:24:46.714534+0000","last_undegraded":"2024-08-17T02:24:46.714534+0000","last_fullsized":"2024-08-17T02:24:46.714534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702585+0000","last_change":"2024-08-17T02:24:46.695791+0000","last_active":"2024-08-17T02:24:46.702585+0000","last_peered":"2024-08-17T02:24:46.702585+0000","last_clean":"2024-08-17T02:24:46.702585+0000","last_became_active":"2024-08-17T02:24:46.695116+0000","last_became_peered":"2024-08-17T02:24:46.695116+0000","last_unstale":"2024-08-17T02:24:46.702585+0000","last_undegraded":"2024-08-17T02:24:46.702585+0000","last_fullsized":"2024-08-17T02:24:46.702585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703379+0000","last_change":"2024-08-17T02:24:46.699896+0000","last_active":"2024-08-17T02:24:46.703379+0000","last_peered":"2024-08-17T02:24:46.703379+0000","last_clean":"2024-08-17T02:24:46.703379+0000","last_became_active":"2024-08-17T02:24:46.699645+0000","last_became_peered":"2024-08-17T02:24:46.699645+0000","last_unstale":"2024-08-17T02:24:46.703379+0000","last_undegraded":"2024-08-17T02:24:46.703379+0000","last_fullsized":"2024-08-17T02:24:46.703379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:36.261958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694896+0000","last_change":"2024-08-17T02:24:46.690505+0000","last_active":"2024-08-17T02:24:46.694896+0000","last_peered":"2024-08-17T02:24:46.694896+0000","last_clean":"2024-08-17T02:24:46.694896+0000","last_became_active":"2024-08-17T02:24:46.690185+0000","last_became_peered":"2024-08-17T02:24:46.690185+0000","last_unstale":"2024-08-17T02:24:46.694896+0000","last_undegraded":"2024-08-17T02:24:46.694896+0000","last_fullsized":"2024-08-17T02:24:46.694896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703730+0000","last_change":"2024-08-17T02:24:46.698787+0000","last_active":"2024-08-17T02:24:46.703730+0000","last_peered":"2024-08-17T02:24:46.703730+0000","last_clean":"2024-08-17T02:24:46.703730+0000","last_became_active":"2024-08-17T02:24:46.698418+0000","last_became_peered":"2024-08-17T02:24:46.698418+0000","last_unstale":"2024-08-17T02:24:46.703730+0000","last_undegraded":"2024-08-17T02:24:46.703730+0000","last_fullsized":"2024-08-17T02:24:46.703730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:40.310047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706590+0000","last_change":"2024-08-17T02:24:46.690550+0000","last_active":"2024-08-17T02:24:46.706590+0000","last_peered":"2024-08-17T02:24:46.706590+0000","last_clean":"2024-08-17T02:24:46.706590+0000","last_became_active":"2024-08-17T02:24:46.690231+0000","last_became_peered":"2024-08-17T02:24:46.690231+0000","last_unstale":"2024-08-17T02:24:46.706590+0000","last_undegraded":"2024-08-17T02:24:46.706590+0000","last_fullsized":"2024-08-17T02:24:46.706590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:40:04.175081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706996+0000","last_change":"2024-08-17T02:24:46.703443+0000","last_active":"2024-08-17T02:24:46.706996+0000","last_peered":"2024-08-17T02:24:46.706996+0000","last_clean":"2024-08-17T02:24:46.706996+0000","last_became_active":"2024-08-17T02:24:46.703111+0000","last_became_peered":"2024-08-17T02:24:46.703111+0000","last_unstale":"2024-08-17T02:24:46.706996+0000","last_undegraded":"2024-08-17T02:24:46.706996+0000","last_fullsized":"2024-08-17T02:24:46.706996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703691+0000","last_change":"2024-08-17T02:24:46.695275+0000","last_active":"2024-08-17T02:24:46.703691+0000","last_peered":"2024-08-17T02:24:46.703691+0000","last_clean":"2024-08-17T02:24:46.703691+0000","last_became_active":"2024-08-17T02:24:46.694600+0000","last_became_peered":"2024-08-17T02:24:46.694600+0000","last_unstale":"2024-08-17T02:24:46.703691+0000","last_undegraded":"2024-08-17T02:24:46.703691+0000","last_fullsized":"2024-08-17T02:24:46.703691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706899+0000","last_change":"2024-08-17T02:24:46.703289+0000","last_active":"2024-08-17T02:24:46.706899+0000","last_peered":"2024-08-17T02:24:46.706899+0000","last_clean":"2024-08-17T02:24:46.706899+0000","last_became_active":"2024-08-17T02:24:46.702961+0000","last_became_peered":"2024-08-17T02:24:46.702961+0000","last_unstale":"2024-08-17T02:24:46.706899+0000","last_undegraded":"2024-08-17T02:24:46.706899+0000","last_fullsized":"2024-08-17T02:24:46.706899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:26.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702603+0000","last_change":"2024-08-17T02:24:46.696080+0000","last_active":"2024-08-17T02:24:46.702603+0000","last_peered":"2024-08-17T02:24:46.702603+0000","last_clean":"2024-08-17T02:24:46.702603+0000","last_became_active":"2024-08-17T02:24:46.695753+0000","last_became_peered":"2024-08-17T02:24:46.695753+0000","last_unstale":"2024-08-17T02:24:46.702603+0000","last_undegraded":"2024-08-17T02:24:46.702603+0000","last_fullsized":"2024-08-17T02:24:46.702603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700418+0000","last_change":"2024-08-17T02:24:46.692695+0000","last_active":"2024-08-17T02:24:46.700418+0000","last_peered":"2024-08-17T02:24:46.700418+0000","last_clean":"2024-08-17T02:24:46.700418+0000","last_became_active":"2024-08-17T02:24:46.691145+0000","last_became_peered":"2024-08-17T02:24:46.691145+0000","last_unstale":"2024-08-17T02:24:46.700418+0000","last_undegraded":"2024-08-17T02:24:46.700418+0000","last_fullsized":"2024-08-17T02:24:46.700418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:25.233681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706334+0000","last_change":"2024-08-17T02:24:46.696761+0000","last_active":"2024-08-17T02:24:46.706334+0000","last_peered":"2024-08-17T02:24:46.706334+0000","last_clean":"2024-08-17T02:24:46.706334+0000","last_became_active":"2024-08-17T02:24:46.695844+0000","last_became_peered":"2024-08-17T02:24:46.695844+0000","last_unstale":"2024-08-17T02:24:46.706334+0000","last_undegraded":"2024-08-17T02:24:46.706334+0000","last_fullsized":"2024-08-17T02:24:46.706334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700724+0000","last_change":"2024-08-17T02:24:46.694929+0000","last_active":"2024-08-17T02:24:46.700724+0000","last_peered":"2024-08-17T02:24:46.700724+0000","last_clean":"2024-08-17T02:24:46.700724+0000","last_became_active":"2024-08-17T02:24:46.694374+0000","last_became_peered":"2024-08-17T02:24:46.694374+0000","last_unstale":"2024-08-17T02:24:46.700724+0000","last_undegraded":"2024-08-17T02:24:46.700724+0000","last_fullsized":"2024-08-17T02:24:46.700724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:46:46.027493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706231+0000","last_change":"2024-08-17T02:24:46.683686+0000","last_active":"2024-08-17T02:24:46.706231+0000","last_peered":"2024-08-17T02:24:46.706231+0000","last_clean":"2024-08-17T02:24:46.706231+0000","last_became_active":"2024-08-17T02:24:46.683416+0000","last_became_peered":"2024-08-17T02:24:46.683416+0000","last_unstale":"2024-08-17T02:24:46.706231+0000","last_undegraded":"2024-08-17T02:24:46.706231+0000","last_fullsized":"2024-08-17T02:24:46.706231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:38.075390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703466+0000","last_change":"2024-08-17T02:24:46.697382+0000","last_active":"2024-08-17T02:24:46.703466+0000","last_peered":"2024-08-17T02:24:46.703466+0000","last_clean":"2024-08-17T02:24:46.703466+0000","last_became_active":"2024-08-17T02:24:46.697033+0000","last_became_peered":"2024-08-17T02:24:46.697033+0000","last_unstale":"2024-08-17T02:24:46.703466+0000","last_undegraded":"2024-08-17T02:24:46.703466+0000","last_fullsized":"2024-08-17T02:24:46.703466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:28.290751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714222+0000","last_change":"2024-08-17T02:24:46.707560+0000","last_active":"2024-08-17T02:24:46.714222+0000","last_peered":"2024-08-17T02:24:46.714222+0000","last_clean":"2024-08-17T02:24:46.714222+0000","last_became_active":"2024-08-17T02:24:46.707234+0000","last_became_peered":"2024-08-17T02:24:46.707234+0000","last_unstale":"2024-08-17T02:24:46.714222+0000","last_undegraded":"2024-08-17T02:24:46.714222+0000","last_fullsized":"2024-08-17T02:24:46.714222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:32.930431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694875+0000","last_change":"2024-08-17T02:24:46.691514+0000","last_active":"2024-08-17T02:24:46.694875+0000","last_peered":"2024-08-17T02:24:46.694875+0000","last_clean":"2024-08-17T02:24:46.694875+0000","last_became_active":"2024-08-17T02:24:46.691231+0000","last_became_peered":"2024-08-17T02:24:46.691231+0000","last_unstale":"2024-08-17T02:24:46.694875+0000","last_undegraded":"2024-08-17T02:24:46.694875+0000","last_fullsized":"2024-08-17T02:24:46.694875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700286+0000","last_change":"2024-08-17T02:24:46.698271+0000","last_active":"2024-08-17T02:24:46.700286+0000","last_peered":"2024-08-17T02:24:46.700286+0000","last_clean":"2024-08-17T02:24:46.700286+0000","last_became_active":"2024-08-17T02:24:46.698020+0000","last_became_peered":"2024-08-17T02:24:46.698020+0000","last_unstale":"2024-08-17T02:24:46.700286+0000","last_undegraded":"2024-08-17T02:24:46.700286+0000","last_fullsized":"2024-08-17T02:24:46.700286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:51.758557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696520+0000","last_change":"2024-08-17T02:24:46.691079+0000","last_active":"2024-08-17T02:24:46.696520+0000","last_peered":"2024-08-17T02:24:46.696520+0000","last_clean":"2024-08-17T02:24:46.696520+0000","last_became_active":"2024-08-17T02:24:46.690659+0000","last_became_peered":"2024-08-17T02:24:46.690659+0000","last_unstale":"2024-08-17T02:24:46.696520+0000","last_undegraded":"2024-08-17T02:24:46.696520+0000","last_fullsized":"2024-08-17T02:24:46.696520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:16:36.446060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706285+0000","last_change":"2024-08-17T02:24:46.684857+0000","last_active":"2024-08-17T02:24:46.706285+0000","last_peered":"2024-08-17T02:24:46.706285+0000","last_clean":"2024-08-17T02:24:46.706285+0000","last_became_active":"2024-08-17T02:24:46.683949+0000","last_became_peered":"2024-08-17T02:24:46.683949+0000","last_unstale":"2024-08-17T02:24:46.706285+0000","last_undegraded":"2024-08-17T02:24:46.706285+0000","last_fullsized":"2024-08-17T02:24:46.706285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:06.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703787+0000","last_change":"2024-08-17T02:24:46.698926+0000","last_active":"2024-08-17T02:24:46.703787+0000","last_peered":"2024-08-17T02:24:46.703787+0000","last_clean":"2024-08-17T02:24:46.703787+0000","last_became_active":"2024-08-17T02:24:46.698650+0000","last_became_peered":"2024-08-17T02:24:46.698650+0000","last_unstale":"2024-08-17T02:24:46.703787+0000","last_undegraded":"2024-08-17T02:24:46.703787+0000","last_fullsized":"2024-08-17T02:24:46.703787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699472+0000","last_change":"2024-08-17T02:24:46.697443+0000","last_active":"2024-08-17T02:24:46.699472+0000","last_peered":"2024-08-17T02:24:46.699472+0000","last_clean":"2024-08-17T02:24:46.699472+0000","last_became_active":"2024-08-17T02:24:46.696404+0000","last_became_peered":"2024-08-17T02:24:46.696404+0000","last_unstale":"2024-08-17T02:24:46.699472+0000","last_undegraded":"2024-08-17T02:24:46.699472+0000","last_fullsized":"2024-08-17T02:24:46.699472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706357+0000","last_change":"2024-08-17T02:24:46.701561+0000","last_active":"2024-08-17T02:24:46.706357+0000","last_peered":"2024-08-17T02:24:46.706357+0000","last_clean":"2024-08-17T02:24:46.706357+0000","last_became_active":"2024-08-17T02:24:46.696208+0000","last_became_peered":"2024-08-17T02:24:46.696208+0000","last_unstale":"2024-08-17T02:24:46.706357+0000","last_undegraded":"2024-08-17T02:24:46.706357+0000","last_fullsized":"2024-08-17T02:24:46.706357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700595+0000","last_change":"2024-08-17T02:24:45.693597+0000","last_active":"2024-08-17T02:24:46.700595+0000","last_peered":"2024-08-17T02:24:46.700595+0000","last_clean":"2024-08-17T02:24:46.700595+0000","last_became_active":"2024-08-17T02:24:45.692136+0000","last_became_peered":"2024-08-17T02:24:45.692136+0000","last_unstale":"2024-08-17T02:24:46.700595+0000","last_undegraded":"2024-08-17T02:24:46.700595+0000","last_fullsized":"2024-08-17T02:24:46.700595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:51.770625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703406+0000","last_change":"2024-08-17T02:24:46.700557+0000","last_active":"2024-08-17T02:24:46.703406+0000","last_peered":"2024-08-17T02:24:46.703406+0000","last_clean":"2024-08-17T02:24:46.703406+0000","last_became_active":"2024-08-17T02:24:46.700114+0000","last_became_peered":"2024-08-17T02:24:46.700114+0000","last_unstale":"2024-08-17T02:24:46.703406+0000","last_undegraded":"2024-08-17T02:24:46.703406+0000","last_fullsized":"2024-08-17T02:24:46.703406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706413+0000","last_change":"2024-08-17T02:24:45.685965+0000","last_active":"2024-08-17T02:24:46.706413+0000","last_peered":"2024-08-17T02:24:46.706413+0000","last_clean":"2024-08-17T02:24:46.706413+0000","last_became_active":"2024-08-17T02:24:45.685019+0000","last_became_peered":"2024-08-17T02:24:45.685019+0000","last_unstale":"2024-08-17T02:24:46.706413+0000","last_undegraded":"2024-08-17T02:24:46.706413+0000","last_fullsized":"2024-08-17T02:24:46.706413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:33.322093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.681299+0000","last_change":"2024-08-17T02:24:45.695657+0000","last_active":"2024-08-17T02:24:46.681299+0000","last_peered":"2024-08-17T02:24:46.681299+0000","last_clean":"2024-08-17T02:24:46.681299+0000","last_became_active":"2024-08-17T02:24:45.695337+0000","last_became_peered":"2024-08-17T02:24:45.695337+0000","last_unstale":"2024-08-17T02:24:46.681299+0000","last_undegraded":"2024-08-17T02:24:46.681299+0000","last_fullsized":"2024-08-17T02:24:46.681299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696577+0000","last_change":"2024-08-17T02:24:46.691553+0000","last_active":"2024-08-17T02:24:46.696577+0000","last_peered":"2024-08-17T02:24:46.696577+0000","last_clean":"2024-08-17T02:24:46.696577+0000","last_became_active":"2024-08-17T02:24:46.688816+0000","last_became_peered":"2024-08-17T02:24:46.688816+0000","last_unstale":"2024-08-17T02:24:46.696577+0000","last_undegraded":"2024-08-17T02:24:46.696577+0000","last_fullsized":"2024-08-17T02:24:46.696577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:46:36.817383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673163+0000","last_change":"2024-08-17T02:24:45.683302+0000","last_active":"2024-08-17T02:24:46.673163+0000","last_peered":"2024-08-17T02:24:46.673163+0000","last_clean":"2024-08-17T02:24:46.673163+0000","last_became_active":"2024-08-17T02:24:45.682641+0000","last_became_peered":"2024-08-17T02:24:45.682641+0000","last_unstale":"2024-08-17T02:24:46.673163+0000","last_undegraded":"2024-08-17T02:24:46.673163+0000","last_fullsized":"2024-08-17T02:24:46.673163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:36.581167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700661+0000","last_change":"2024-08-17T02:24:46.693180+0000","last_active":"2024-08-17T02:24:46.700661+0000","last_peered":"2024-08-17T02:24:46.700661+0000","last_clean":"2024-08-17T02:24:46.700661+0000","last_became_active":"2024-08-17T02:24:46.692910+0000","last_became_peered":"2024-08-17T02:24:46.692910+0000","last_unstale":"2024-08-17T02:24:46.700661+0000","last_undegraded":"2024-08-17T02:24:46.700661+0000","last_fullsized":"2024-08-17T02:24:46.700661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:20.305646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691054+0000","last_change":"2024-08-17T02:24:45.689693+0000","last_active":"2024-08-17T02:24:46.691054+0000","last_peered":"2024-08-17T02:24:46.691054+0000","last_clean":"2024-08-17T02:24:46.691054+0000","last_became_active":"2024-08-17T02:24:45.689396+0000","last_became_peered":"2024-08-17T02:24:45.689396+0000","last_unstale":"2024-08-17T02:24:46.691054+0000","last_undegraded":"2024-08-17T02:24:46.691054+0000","last_fullsized":"2024-08-17T02:24:46.691054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:03:27.829684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714193+0000","last_change":"2024-08-17T02:24:46.707529+0000","last_active":"2024-08-17T02:24:46.714193+0000","last_peered":"2024-08-17T02:24:46.714193+0000","last_clean":"2024-08-17T02:24:46.714193+0000","last_became_active":"2024-08-17T02:24:46.706887+0000","last_became_peered":"2024-08-17T02:24:46.706887+0000","last_unstale":"2024-08-17T02:24:46.714193+0000","last_undegraded":"2024-08-17T02:24:46.714193+0000","last_fullsized":"2024-08-17T02:24:46.714193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682673+0000","last_change":"2024-08-17T02:24:45.689053+0000","last_active":"2024-08-17T02:24:46.682673+0000","last_peered":"2024-08-17T02:24:46.682673+0000","last_clean":"2024-08-17T02:24:46.682673+0000","last_became_active":"2024-08-17T02:24:45.688643+0000","last_became_peered":"2024-08-17T02:24:45.688643+0000","last_unstale":"2024-08-17T02:24:46.682673+0000","last_undegraded":"2024-08-17T02:24:46.682673+0000","last_fullsized":"2024-08-17T02:24:46.682673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711779+0000","last_change":"2024-08-17T02:24:46.708643+0000","last_active":"2024-08-17T02:24:46.711779+0000","last_peered":"2024-08-17T02:24:46.711779+0000","last_clean":"2024-08-17T02:24:46.711779+0000","last_became_active":"2024-08-17T02:24:46.708322+0000","last_became_peered":"2024-08-17T02:24:46.708322+0000","last_unstale":"2024-08-17T02:24:46.711779+0000","last_undegraded":"2024-08-17T02:24:46.711779+0000","last_fullsized":"2024-08-17T02:24:46.711779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:00.112973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703626+0000","last_change":"2024-08-17T02:24:45.686140+0000","last_active":"2024-08-17T02:24:46.703626+0000","last_peered":"2024-08-17T02:24:46.703626+0000","last_clean":"2024-08-17T02:24:46.703626+0000","last_became_active":"2024-08-17T02:24:45.685732+0000","last_became_peered":"2024-08-17T02:24:45.685732+0000","last_unstale":"2024-08-17T02:24:46.703626+0000","last_undegraded":"2024-08-17T02:24:46.703626+0000","last_fullsized":"2024-08-17T02:24:46.703626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710171+0000","last_change":"2024-08-17T02:24:46.703995+0000","last_active":"2024-08-17T02:24:46.710171+0000","last_peered":"2024-08-17T02:24:46.710171+0000","last_clean":"2024-08-17T02:24:46.710171+0000","last_became_active":"2024-08-17T02:24:46.703632+0000","last_became_peered":"2024-08-17T02:24:46.703632+0000","last_unstale":"2024-08-17T02:24:46.710171+0000","last_undegraded":"2024-08-17T02:24:46.710171+0000","last_fullsized":"2024-08-17T02:24:46.710171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711599+0000","last_change":"2024-08-17T02:24:45.691026+0000","last_active":"2024-08-17T02:24:46.711599+0000","last_peered":"2024-08-17T02:24:46.711599+0000","last_clean":"2024-08-17T02:24:46.711599+0000","last_became_active":"2024-08-17T02:24:45.690499+0000","last_became_peered":"2024-08-17T02:24:45.690499+0000","last_unstale":"2024-08-17T02:24:46.711599+0000","last_undegraded":"2024-08-17T02:24:46.711599+0000","last_fullsized":"2024-08-17T02:24:46.711599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:14.230300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700038+0000","last_change":"2024-08-17T02:24:46.694359+0000","last_active":"2024-08-17T02:24:46.700038+0000","last_peered":"2024-08-17T02:24:46.700038+0000","last_clean":"2024-08-17T02:24:46.700038+0000","last_became_active":"2024-08-17T02:24:46.693812+0000","last_became_peered":"2024-08-17T02:24:46.693812+0000","last_unstale":"2024-08-17T02:24:46.700038+0000","last_undegraded":"2024-08-17T02:24:46.700038+0000","last_fullsized":"2024-08-17T02:24:46.700038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:48:49.063780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703831+0000","last_change":"2024-08-17T02:24:45.689928+0000","last_active":"2024-08-17T02:24:46.703831+0000","last_peered":"2024-08-17T02:24:46.703831+0000","last_clean":"2024-08-17T02:24:46.703831+0000","last_became_active":"2024-08-17T02:24:45.689519+0000","last_became_peered":"2024-08-17T02:24:45.689519+0000","last_unstale":"2024-08-17T02:24:46.703831+0000","last_undegraded":"2024-08-17T02:24:46.703831+0000","last_fullsized":"2024-08-17T02:24:46.703831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.709142+0000","last_change":"2024-08-17T02:24:46.708134+0000","last_active":"2024-08-17T02:24:46.709142+0000","last_peered":"2024-08-17T02:24:46.709142+0000","last_clean":"2024-08-17T02:24:46.709142+0000","last_became_active":"2024-08-17T02:24:46.707822+0000","last_became_peered":"2024-08-17T02:24:46.707822+0000","last_unstale":"2024-08-17T02:24:46.709142+0000","last_undegraded":"2024-08-17T02:24:46.709142+0000","last_fullsized":"2024-08-17T02:24:46.709142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673821+0000","last_change":"2024-08-17T02:24:45.686232+0000","last_active":"2024-08-17T02:24:46.673821+0000","last_peered":"2024-08-17T02:24:46.673821+0000","last_clean":"2024-08-17T02:24:46.673821+0000","last_became_active":"2024-08-17T02:24:45.685407+0000","last_became_peered":"2024-08-17T02:24:45.685407+0000","last_unstale":"2024-08-17T02:24:46.673821+0000","last_undegraded":"2024-08-17T02:24:46.673821+0000","last_fullsized":"2024-08-17T02:24:46.673821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706888+0000","last_change":"2024-08-17T02:24:46.700959+0000","last_active":"2024-08-17T02:24:46.706888+0000","last_peered":"2024-08-17T02:24:46.706888+0000","last_clean":"2024-08-17T02:24:46.706888+0000","last_became_active":"2024-08-17T02:24:46.698769+0000","last_became_peered":"2024-08-17T02:24:46.698769+0000","last_unstale":"2024-08-17T02:24:46.706888+0000","last_undegraded":"2024-08-17T02:24:46.706888+0000","last_fullsized":"2024-08-17T02:24:46.706888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.683527+0000","last_change":"2024-08-17T02:24:45.687633+0000","last_active":"2024-08-17T02:24:46.683527+0000","last_peered":"2024-08-17T02:24:46.683527+0000","last_clean":"2024-08-17T02:24:46.683527+0000","last_became_active":"2024-08-17T02:24:45.687078+0000","last_became_peered":"2024-08-17T02:24:45.687078+0000","last_unstale":"2024-08-17T02:24:46.683527+0000","last_undegraded":"2024-08-17T02:24:46.683527+0000","last_fullsized":"2024-08-17T02:24:46.683527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706073+0000","last_change":"2024-08-17T02:24:46.696374+0000","last_active":"2024-08-17T02:24:46.706073+0000","last_peered":"2024-08-17T02:24:46.706073+0000","last_clean":"2024-08-17T02:24:46.706073+0000","last_became_active":"2024-08-17T02:24:46.695792+0000","last_became_peered":"2024-08-17T02:24:46.695792+0000","last_unstale":"2024-08-17T02:24:46.706073+0000","last_undegraded":"2024-08-17T02:24:46.706073+0000","last_fullsized":"2024-08-17T02:24:46.706073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.709576+0000","last_change":"2024-08-17T02:24:45.686489+0000","last_active":"2024-08-17T02:24:46.709576+0000","last_peered":"2024-08-17T02:24:46.709576+0000","last_clean":"2024-08-17T02:24:46.709576+0000","last_became_active":"2024-08-17T02:24:45.684809+0000","last_became_peered":"2024-08-17T02:24:45.684809+0000","last_unstale":"2024-08-17T02:24:46.709576+0000","last_undegraded":"2024-08-17T02:24:46.709576+0000","last_fullsized":"2024-08-17T02:24:46.709576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706951+0000","last_change":"2024-08-17T02:24:46.699050+0000","last_active":"2024-08-17T02:24:46.706951+0000","last_peered":"2024-08-17T02:24:46.706951+0000","last_clean":"2024-08-17T02:24:46.706951+0000","last_became_active":"2024-08-17T02:24:46.697848+0000","last_became_peered":"2024-08-17T02:24:46.697848+0000","last_unstale":"2024-08-17T02:24:46.706951+0000","last_undegraded":"2024-08-17T02:24:46.706951+0000","last_fullsized":"2024-08-17T02:24:46.706951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702818+0000","last_change":"2024-08-17T02:24:45.696348+0000","last_active":"2024-08-17T02:24:46.702818+0000","last_peered":"2024-08-17T02:24:46.702818+0000","last_clean":"2024-08-17T02:24:46.702818+0000","last_became_active":"2024-08-17T02:24:45.695978+0000","last_became_peered":"2024-08-17T02:24:45.695978+0000","last_unstale":"2024-08-17T02:24:46.702818+0000","last_undegraded":"2024-08-17T02:24:46.702818+0000","last_fullsized":"2024-08-17T02:24:46.702818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701299+0000","last_change":"2024-08-17T02:24:46.698921+0000","last_active":"2024-08-17T02:24:46.701299+0000","last_peered":"2024-08-17T02:24:46.701299+0000","last_clean":"2024-08-17T02:24:46.701299+0000","last_became_active":"2024-08-17T02:24:46.698688+0000","last_became_peered":"2024-08-17T02:24:46.698688+0000","last_unstale":"2024-08-17T02:24:46.701299+0000","last_undegraded":"2024-08-17T02:24:46.701299+0000","last_fullsized":"2024-08-17T02:24:46.701299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:37.590898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701865+0000","last_change":"2024-08-17T02:24:45.699315+0000","last_active":"2024-08-17T02:24:46.701865+0000","last_peered":"2024-08-17T02:24:46.701865+0000","last_clean":"2024-08-17T02:24:46.701865+0000","last_became_active":"2024-08-17T02:24:45.698964+0000","last_became_peered":"2024-08-17T02:24:45.698964+0000","last_unstale":"2024-08-17T02:24:46.701865+0000","last_undegraded":"2024-08-17T02:24:46.701865+0000","last_fullsized":"2024-08-17T02:24:46.701865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702236+0000","last_change":"2024-08-17T02:24:46.696697+0000","last_active":"2024-08-17T02:24:46.702236+0000","last_peered":"2024-08-17T02:24:46.702236+0000","last_clean":"2024-08-17T02:24:46.702236+0000","last_became_active":"2024-08-17T02:24:46.696387+0000","last_became_peered":"2024-08-17T02:24:46.696387+0000","last_unstale":"2024-08-17T02:24:46.702236+0000","last_undegraded":"2024-08-17T02:24:46.702236+0000","last_fullsized":"2024-08-17T02:24:46.702236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.705922+0000","last_change":"2024-08-17T02:24:45.693896+0000","last_active":"2024-08-17T02:24:46.705922+0000","last_peered":"2024-08-17T02:24:46.705922+0000","last_clean":"2024-08-17T02:24:46.705922+0000","last_became_active":"2024-08-17T02:24:45.693694+0000","last_became_peered":"2024-08-17T02:24:45.693694+0000","last_unstale":"2024-08-17T02:24:46.705922+0000","last_undegraded":"2024-08-17T02:24:46.705922+0000","last_fullsized":"2024-08-17T02:24:46.705922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:25.447726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702563+0000","last_change":"2024-08-17T02:24:46.695064+0000","last_active":"2024-08-17T02:24:46.702563+0000","last_peered":"2024-08-17T02:24:46.702563+0000","last_clean":"2024-08-17T02:24:46.702563+0000","last_became_active":"2024-08-17T02:24:46.694303+0000","last_became_peered":"2024-08-17T02:24:46.694303+0000","last_unstale":"2024-08-17T02:24:46.702563+0000","last_undegraded":"2024-08-17T02:24:46.702563+0000","last_fullsized":"2024-08-17T02:24:46.702563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682822+0000","last_change":"2024-08-17T02:24:45.693363+0000","last_active":"2024-08-17T02:24:46.682822+0000","last_peered":"2024-08-17T02:24:46.682822+0000","last_clean":"2024-08-17T02:24:46.682822+0000","last_became_active":"2024-08-17T02:24:45.693114+0000","last_became_peered":"2024-08-17T02:24:45.693114+0000","last_unstale":"2024-08-17T02:24:46.682822+0000","last_undegraded":"2024-08-17T02:24:46.682822+0000","last_fullsized":"2024-08-17T02:24:46.682822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706914+0000","last_change":"2024-08-17T02:24:46.703793+0000","last_active":"2024-08-17T02:24:46.706914+0000","last_peered":"2024-08-17T02:24:46.706914+0000","last_clean":"2024-08-17T02:24:46.706914+0000","last_became_active":"2024-08-17T02:24:46.703493+0000","last_became_peered":"2024-08-17T02:24:46.703493+0000","last_unstale":"2024-08-17T02:24:46.706914+0000","last_undegraded":"2024-08-17T02:24:46.706914+0000","last_fullsized":"2024-08-17T02:24:46.706914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.685754+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:24:46.685754+0000","last_peered":"2024-08-17T02:24:46.685754+0000","last_clean":"2024-08-17T02:24:46.685754+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:24:46.685754+0000","last_undegraded":"2024-08-17T02:24:46.685754+0000","last_fullsized":"2024-08-17T02:24:46.685754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.676656+0000","last_change":"2024-08-17T02:24:45.684657+0000","last_active":"2024-08-17T02:24:46.676656+0000","last_peered":"2024-08-17T02:24:46.676656+0000","last_clean":"2024-08-17T02:24:46.676656+0000","last_became_active":"2024-08-17T02:24:45.683930+0000","last_became_peered":"2024-08-17T02:24:45.683930+0000","last_unstale":"2024-08-17T02:24:46.676656+0000","last_undegraded":"2024-08-17T02:24:46.676656+0000","last_fullsized":"2024-08-17T02:24:46.676656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700029+0000","last_change":"2024-08-17T02:24:46.690032+0000","last_active":"2024-08-17T02:24:46.700029+0000","last_peered":"2024-08-17T02:24:46.700029+0000","last_clean":"2024-08-17T02:24:46.700029+0000","last_became_active":"2024-08-17T02:24:46.689692+0000","last_became_peered":"2024-08-17T02:24:46.689692+0000","last_unstale":"2024-08-17T02:24:46.700029+0000","last_undegraded":"2024-08-17T02:24:46.700029+0000","last_fullsized":"2024-08-17T02:24:46.700029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:49.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673191+0000","last_change":"2024-08-17T02:24:45.695195+0000","last_active":"2024-08-17T02:24:46.673191+0000","last_peered":"2024-08-17T02:24:46.673191+0000","last_clean":"2024-08-17T02:24:46.673191+0000","last_became_active":"2024-08-17T02:24:45.694908+0000","last_became_peered":"2024-08-17T02:24:45.694908+0000","last_unstale":"2024-08-17T02:24:46.673191+0000","last_undegraded":"2024-08-17T02:24:46.673191+0000","last_fullsized":"2024-08-17T02:24:46.673191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700963+0000","last_change":"2024-08-17T02:24:46.698400+0000","last_active":"2024-08-17T02:24:46.700963+0000","last_peered":"2024-08-17T02:24:46.700963+0000","last_clean":"2024-08-17T02:24:46.700963+0000","last_became_active":"2024-08-17T02:24:46.697641+0000","last_became_peered":"2024-08-17T02:24:46.697641+0000","last_unstale":"2024-08-17T02:24:46.700963+0000","last_undegraded":"2024-08-17T02:24:46.700963+0000","last_fullsized":"2024-08-17T02:24:46.700963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682928+0000","last_change":"2024-08-17T02:24:45.696585+0000","last_active":"2024-08-17T02:24:46.682928+0000","last_peered":"2024-08-17T02:24:46.682928+0000","last_clean":"2024-08-17T02:24:46.682928+0000","last_became_active":"2024-08-17T02:24:45.696243+0000","last_became_peered":"2024-08-17T02:24:45.696243+0000","last_unstale":"2024-08-17T02:24:46.682928+0000","last_undegraded":"2024-08-17T02:24:46.682928+0000","last_fullsized":"2024-08-17T02:24:46.682928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700945+0000","last_change":"2024-08-17T02:24:46.692661+0000","last_active":"2024-08-17T02:24:46.700945+0000","last_peered":"2024-08-17T02:24:46.700945+0000","last_clean":"2024-08-17T02:24:46.700945+0000","last_became_active":"2024-08-17T02:24:46.692144+0000","last_became_peered":"2024-08-17T02:24:46.692144+0000","last_unstale":"2024-08-17T02:24:46.700945+0000","last_undegraded":"2024-08-17T02:24:46.700945+0000","last_fullsized":"2024-08-17T02:24:46.700945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:16.650137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.674060+0000","last_change":"2024-08-17T02:24:45.689974+0000","last_active":"2024-08-17T02:24:46.674060+0000","last_peered":"2024-08-17T02:24:46.674060+0000","last_clean":"2024-08-17T02:24:46.674060+0000","last_became_active":"2024-08-17T02:24:45.689686+0000","last_became_peered":"2024-08-17T02:24:45.689686+0000","last_unstale":"2024-08-17T02:24:46.674060+0000","last_undegraded":"2024-08-17T02:24:46.674060+0000","last_fullsized":"2024-08-17T02:24:46.674060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:02.113673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702323+0000","last_change":"2024-08-17T02:24:46.695491+0000","last_active":"2024-08-17T02:24:46.702323+0000","last_peered":"2024-08-17T02:24:46.702323+0000","last_clean":"2024-08-17T02:24:46.702323+0000","last_became_active":"2024-08-17T02:24:46.694910+0000","last_became_peered":"2024-08-17T02:24:46.694910+0000","last_unstale":"2024-08-17T02:24:46.702323+0000","last_undegraded":"2024-08-17T02:24:46.702323+0000","last_fullsized":"2024-08-17T02:24:46.702323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:17.309712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.675664+0000","last_change":"2024-08-17T02:24:45.693494+0000","last_active":"2024-08-17T02:24:46.675664+0000","last_peered":"2024-08-17T02:24:46.675664+0000","last_clean":"2024-08-17T02:24:46.675664+0000","last_became_active":"2024-08-17T02:24:45.691399+0000","last_became_peered":"2024-08-17T02:24:45.691399+0000","last_unstale":"2024-08-17T02:24:46.675664+0000","last_undegraded":"2024-08-17T02:24:46.675664+0000","last_fullsized":"2024-08-17T02:24:46.675664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:47.538687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699510+0000","last_change":"2024-08-17T02:24:46.697272+0000","last_active":"2024-08-17T02:24:46.699510+0000","last_peered":"2024-08-17T02:24:46.699510+0000","last_clean":"2024-08-17T02:24:46.699510+0000","last_became_active":"2024-08-17T02:24:46.696866+0000","last_became_peered":"2024-08-17T02:24:46.696866+0000","last_unstale":"2024-08-17T02:24:46.699510+0000","last_undegraded":"2024-08-17T02:24:46.699510+0000","last_fullsized":"2024-08-17T02:24:46.699510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.677187+0000","last_change":"2024-08-17T02:24:45.689340+0000","last_active":"2024-08-17T02:24:46.677187+0000","last_peered":"2024-08-17T02:24:46.677187+0000","last_clean":"2024-08-17T02:24:46.677187+0000","last_became_active":"2024-08-17T02:24:45.687263+0000","last_became_peered":"2024-08-17T02:24:45.687263+0000","last_unstale":"2024-08-17T02:24:46.677187+0000","last_undegraded":"2024-08-17T02:24:46.677187+0000","last_fullsized":"2024-08-17T02:24:46.677187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694607+0000","last_change":"2024-08-17T02:24:46.687663+0000","last_active":"2024-08-17T02:24:46.694607+0000","last_peered":"2024-08-17T02:24:46.694607+0000","last_clean":"2024-08-17T02:24:46.694607+0000","last_became_active":"2024-08-17T02:24:46.687285+0000","last_became_peered":"2024-08-17T02:24:46.687285+0000","last_unstale":"2024-08-17T02:24:46.694607+0000","last_undegraded":"2024-08-17T02:24:46.694607+0000","last_fullsized":"2024-08-17T02:24:46.694607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-08-17T02:24:47.813909+0000","last_change":"2024-08-17T02:24:45.692340+0000","last_active":"2024-08-17T02:24:47.813909+0000","last_peered":"2024-08-17T02:24:47.813909+0000","last_clean":"2024-08-17T02:24:47.813909+0000","last_became_active":"2024-08-17T02:24:45.691959+0000","last_became_peered":"2024-08-17T02:24:45.691959+0000","last_unstale":"2024-08-17T02:24:47.813909+0000","last_undegraded":"2024-08-17T02:24:47.813909+0000","last_fullsized":"2024-08-17T02:24:47.813909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701175+0000","last_change":"2024-08-17T02:24:46.699671+0000","last_active":"2024-08-17T02:24:46.701175+0000","last_peered":"2024-08-17T02:24:46.701175+0000","last_clean":"2024-08-17T02:24:46.701175+0000","last_became_active":"2024-08-17T02:24:46.699384+0000","last_became_peered":"2024-08-17T02:24:46.699384+0000","last_unstale":"2024-08-17T02:24:46.701175+0000","last_undegraded":"2024-08-17T02:24:46.701175+0000","last_fullsized":"2024-08-17T02:24:46.701175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706578+0000","last_change":"2024-08-17T02:24:45.689016+0000","last_active":"2024-08-17T02:24:46.706578+0000","last_peered":"2024-08-17T02:24:46.706578+0000","last_clean":"2024-08-17T02:24:46.706578+0000","last_became_active":"2024-08-17T02:24:45.688568+0000","last_became_peered":"2024-08-17T02:24:45.688568+0000","last_unstale":"2024-08-17T02:24:46.706578+0000","last_undegraded":"2024-08-17T02:24:46.706578+0000","last_fullsized":"2024-08-17T02:24:46.706578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:31.920700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700042+0000","last_change":"2024-08-17T02:24:46.690217+0000","last_active":"2024-08-17T02:24:46.700042+0000","last_peered":"2024-08-17T02:24:46.700042+0000","last_clean":"2024-08-17T02:24:46.700042+0000","last_became_active":"2024-08-17T02:24:46.689945+0000","last_became_peered":"2024-08-17T02:24:46.689945+0000","last_unstale":"2024-08-17T02:24:46.700042+0000","last_undegraded":"2024-08-17T02:24:46.700042+0000","last_fullsized":"2024-08-17T02:24:46.700042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691093+0000","last_change":"2024-08-17T02:24:45.692162+0000","last_active":"2024-08-17T02:24:46.691093+0000","last_peered":"2024-08-17T02:24:46.691093+0000","last_clean":"2024-08-17T02:24:46.691093+0000","last_became_active":"2024-08-17T02:24:45.691864+0000","last_became_peered":"2024-08-17T02:24:45.691864+0000","last_unstale":"2024-08-17T02:24:46.691093+0000","last_undegraded":"2024-08-17T02:24:46.691093+0000","last_fullsized":"2024-08-17T02:24:46.691093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706928+0000","last_change":"2024-08-17T02:24:46.693752+0000","last_active":"2024-08-17T02:24:46.706928+0000","last_peered":"2024-08-17T02:24:46.706928+0000","last_clean":"2024-08-17T02:24:46.706928+0000","last_became_active":"2024-08-17T02:24:46.693452+0000","last_became_peered":"2024-08-17T02:24:46.693452+0000","last_unstale":"2024-08-17T02:24:46.706928+0000","last_undegraded":"2024-08-17T02:24:46.706928+0000","last_fullsized":"2024-08-17T02:24:46.706928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.504743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682032+0000","last_change":"2024-08-17T02:24:45.695549+0000","last_active":"2024-08-17T02:24:46.682032+0000","last_peered":"2024-08-17T02:24:46.682032+0000","last_clean":"2024-08-17T02:24:46.682032+0000","last_became_active":"2024-08-17T02:24:45.695270+0000","last_became_peered":"2024-08-17T02:24:45.695270+0000","last_unstale":"2024-08-17T02:24:46.682032+0000","last_undegraded":"2024-08-17T02:24:46.682032+0000","last_fullsized":"2024-08-17T02:24:46.682032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700059+0000","last_change":"2024-08-17T02:24:46.689650+0000","last_active":"2024-08-17T02:24:46.700059+0000","last_peered":"2024-08-17T02:24:46.700059+0000","last_clean":"2024-08-17T02:24:46.700059+0000","last_became_active":"2024-08-17T02:24:46.689361+0000","last_became_peered":"2024-08-17T02:24:46.689361+0000","last_unstale":"2024-08-17T02:24:46.700059+0000","last_undegraded":"2024-08-17T02:24:46.700059+0000","last_fullsized":"2024-08-17T02:24:46.700059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.685591+0000","last_change":"2024-08-17T02:24:45.688479+0000","last_active":"2024-08-17T02:24:46.685591+0000","last_peered":"2024-08-17T02:24:46.685591+0000","last_clean":"2024-08-17T02:24:46.685591+0000","last_became_active":"2024-08-17T02:24:45.688105+0000","last_became_peered":"2024-08-17T02:24:45.688105+0000","last_unstale":"2024-08-17T02:24:46.685591+0000","last_undegraded":"2024-08-17T02:24:46.685591+0000","last_fullsized":"2024-08-17T02:24:46.685591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703549+0000","last_change":"2024-08-17T02:24:46.693894+0000","last_active":"2024-08-17T02:24:46.703549+0000","last_peered":"2024-08-17T02:24:46.703549+0000","last_clean":"2024-08-17T02:24:46.703549+0000","last_became_active":"2024-08-17T02:24:46.693611+0000","last_became_peered":"2024-08-17T02:24:46.693611+0000","last_unstale":"2024-08-17T02:24:46.703549+0000","last_undegraded":"2024-08-17T02:24:46.703549+0000","last_fullsized":"2024-08-17T02:24:46.703549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706372+0000","last_change":"2024-08-17T02:24:45.684136+0000","last_active":"2024-08-17T02:24:46.706372+0000","last_peered":"2024-08-17T02:24:46.706372+0000","last_clean":"2024-08-17T02:24:46.706372+0000","last_became_active":"2024-08-17T02:24:45.683723+0000","last_became_peered":"2024-08-17T02:24:45.683723+0000","last_unstale":"2024-08-17T02:24:46.706372+0000","last_undegraded":"2024-08-17T02:24:46.706372+0000","last_fullsized":"2024-08-17T02:24:46.706372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707394+0000","last_change":"2024-08-17T02:24:46.691308+0000","last_active":"2024-08-17T02:24:46.707394+0000","last_peered":"2024-08-17T02:24:46.707394+0000","last_clean":"2024-08-17T02:24:46.707394+0000","last_became_active":"2024-08-17T02:24:46.691046+0000","last_became_peered":"2024-08-17T02:24:46.691046+0000","last_unstale":"2024-08-17T02:24:46.707394+0000","last_undegraded":"2024-08-17T02:24:46.707394+0000","last_fullsized":"2024-08-17T02:24:46.707394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706877+0000","last_change":"2024-08-17T02:24:46.699150+0000","last_active":"2024-08-17T02:24:46.706877+0000","last_peered":"2024-08-17T02:24:46.706877+0000","last_clean":"2024-08-17T02:24:46.706877+0000","last_became_active":"2024-08-17T02:24:46.697504+0000","last_became_peered":"2024-08-17T02:24:46.697504+0000","last_unstale":"2024-08-17T02:24:46.706877+0000","last_undegraded":"2024-08-17T02:24:46.706877+0000","last_fullsized":"2024-08-17T02:24:46.706877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711183+0000","last_change":"2024-08-17T02:24:45.690864+0000","last_active":"2024-08-17T02:24:46.711183+0000","last_peered":"2024-08-17T02:24:46.711183+0000","last_clean":"2024-08-17T02:24:46.711183+0000","last_became_active":"2024-08-17T02:24:45.687405+0000","last_became_peered":"2024-08-17T02:24:45.687405+0000","last_unstale":"2024-08-17T02:24:46.711183+0000","last_undegraded":"2024-08-17T02:24:46.711183+0000","last_fullsized":"2024-08-17T02:24:46.711183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710456+0000","last_change":"2024-08-17T02:24:46.702644+0000","last_active":"2024-08-17T02:24:46.710456+0000","last_peered":"2024-08-17T02:24:46.710456+0000","last_clean":"2024-08-17T02:24:46.710456+0000","last_became_active":"2024-08-17T02:24:46.701576+0000","last_became_peered":"2024-08-17T02:24:46.701576+0000","last_unstale":"2024-08-17T02:24:46.710456+0000","last_undegraded":"2024-08-17T02:24:46.710456+0000","last_fullsized":"2024-08-17T02:24:46.710456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:12.393424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710630+0000","last_change":"2024-08-17T02:24:45.689395+0000","last_active":"2024-08-17T02:24:46.710630+0000","last_peered":"2024-08-17T02:24:46.710630+0000","last_clean":"2024-08-17T02:24:46.710630+0000","last_became_active":"2024-08-17T02:24:45.689082+0000","last_became_peered":"2024-08-17T02:24:45.689082+0000","last_unstale":"2024-08-17T02:24:46.710630+0000","last_undegraded":"2024-08-17T02:24:46.710630+0000","last_fullsized":"2024-08-17T02:24:46.710630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703445+0000","last_change":"2024-08-17T02:24:46.697195+0000","last_active":"2024-08-17T02:24:46.703445+0000","last_peered":"2024-08-17T02:24:46.703445+0000","last_clean":"2024-08-17T02:24:46.703445+0000","last_became_active":"2024-08-17T02:24:46.696949+0000","last_became_peered":"2024-08-17T02:24:46.696949+0000","last_unstale":"2024-08-17T02:24:46.703445+0000","last_undegraded":"2024-08-17T02:24:46.703445+0000","last_fullsized":"2024-08-17T02:24:46.703445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:22.938256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703915+0000","last_change":"2024-08-17T02:24:45.687064+0000","last_active":"2024-08-17T02:24:46.703915+0000","last_peered":"2024-08-17T02:24:46.703915+0000","last_clean":"2024-08-17T02:24:46.703915+0000","last_became_active":"2024-08-17T02:24:45.686543+0000","last_became_peered":"2024-08-17T02:24:45.686543+0000","last_unstale":"2024-08-17T02:24:46.703915+0000","last_undegraded":"2024-08-17T02:24:46.703915+0000","last_fullsized":"2024-08-17T02:24:46.703915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:47.125586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696443+0000","last_change":"2024-08-17T02:24:46.688626+0000","last_active":"2024-08-17T02:24:46.696443+0000","last_peered":"2024-08-17T02:24:46.696443+0000","last_clean":"2024-08-17T02:24:46.696443+0000","last_became_active":"2024-08-17T02:24:46.688208+0000","last_became_peered":"2024-08-17T02:24:46.688208+0000","last_unstale":"2024-08-17T02:24:46.696443+0000","last_undegraded":"2024-08-17T02:24:46.696443+0000","last_fullsized":"2024-08-17T02:24:46.696443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:20.339019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708842+0000","last_change":"2024-08-17T02:24:45.687257+0000","last_active":"2024-08-17T02:24:46.708842+0000","last_peered":"2024-08-17T02:24:46.708842+0000","last_clean":"2024-08-17T02:24:46.708842+0000","last_became_active":"2024-08-17T02:24:45.686911+0000","last_became_peered":"2024-08-17T02:24:45.686911+0000","last_unstale":"2024-08-17T02:24:46.708842+0000","last_undegraded":"2024-08-17T02:24:46.708842+0000","last_fullsized":"2024-08-17T02:24:46.708842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":241664,"data_stored":80755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":233472,"data_stored":80631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":253952,"data_stored":82843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":81201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":245760,"data_stored":82183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":831488,"data_stored":671069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":241664,"data_stored":80687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":835584,"data_stored":671091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:54.461 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:24:54.462 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:24:54.462 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:24:54.462 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:24:54.462 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:24:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b35ef700 1 Processor -- start 2024-08-17T02:24:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b35ef700 1 -- start start 2024-08-17T02:24:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b35ef700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac097830 0x7f12ac0ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b35ef700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f12ac157250 0x7f12ac0acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b35ef700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac0ae3f0 con 0x7f12ac156e80 2024-08-17T02:24:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b35ef700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac0ad260 con 0x7f12ac157250 2024-08-17T02:24:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b35ef700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0adac0 con 0x7f12ac097830 2024-08-17T02:24:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b1b8c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f12ac157250 0x7f12ac0acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b138b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f12ac156e80 0x7f12ac097120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58382/0 (socket says 172.21.15.31:58382) 2024-08-17T02:24:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b138b700 1 -- 172.21.15.31:0/2973394326 learned_addr learned my addr 172.21.15.31:0/2973394326 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b0b8a700 1 --2- 172.21.15.31:0/2973394326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac097830 0x7f12ac0ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b1b8c700 1 -- 172.21.15.31:0/2973394326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac097830 msgr2=0x7f12ac0ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b1b8c700 1 --2- 172.21.15.31:0/2973394326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac097830 0x7f12ac0ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b1b8c700 1 -- 172.21.15.31:0/2973394326 >> v1:172.21.15.31:6789/0 conn(0x7f12ac156e80 legacy=0x7f12ac097120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b1b8c700 1 -- 172.21.15.31:0/2973394326 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac0adda0 con 0x7f12ac157250 2024-08-17T02:24:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b0b8a700 1 --2- 172.21.15.31:0/2973394326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac097830 0x7f12ac0ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.566+0000 7f12b1b8c700 1 --2- 172.21.15.31:0/2973394326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac157250 0x7f12ac0acd20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f12a40098e0 tx=0x7f12a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ae387b29459c4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12a3fff700 1 -- 172.21.15.31:0/2973394326 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4009e80 con 0x7f12ac157250 2024-08-17T02:24:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12a3fff700 1 -- 172.21.15.31:0/2973394326 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a400b860 con 0x7f12ac157250 2024-08-17T02:24:54.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12a3fff700 1 -- 172.21.15.31:0/2973394326 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400bbe0 con 0x7f12ac157250 2024-08-17T02:24:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12b35ef700 1 -- 172.21.15.31:0/2973394326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac157250 msgr2=0x7f12ac0acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12b35ef700 1 --2- 172.21.15.31:0/2973394326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac157250 0x7f12ac0acd20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f12a40098e0 tx=0x7f12a40091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12b35ef700 1 -- 172.21.15.31:0/2973394326 shutdown_connections 2024-08-17T02:24:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12b35ef700 1 --2- 172.21.15.31:0/2973394326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac157250 0x7f12ac0acd20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12b35ef700 1 --2- 172.21.15.31:0/2973394326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac097830 0x7f12ac0ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12b35ef700 1 -- 172.21.15.31:0/2973394326 >> 172.21.15.31:0/2973394326 conn(0x7f12ac0ceb70 msgr2=0x7f12ac096a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12b35ef700 1 -- 172.21.15.31:0/2973394326 shutdown_connections 2024-08-17T02:24:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.570+0000 7f12b35ef700 1 -- 172.21.15.31:0/2973394326 wait complete. 2024-08-17T02:24:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b35ef700 1 Processor -- start 2024-08-17T02:24:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b35ef700 1 -- start start 2024-08-17T02:24:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b35ef700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac097830 0x7f12ac1576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b35ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ac156e80 0x7f12ac150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b35ef700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac157250 0x7f12ac158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b35ef700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0ab5a0 con 0x7f12ac097830 2024-08-17T02:24:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b35ef700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac157f20 con 0x7f12ac156e80 2024-08-17T02:24:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b35ef700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac158200 con 0x7f12ac157250 2024-08-17T02:24:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b138b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac097830 0x7f12ac1576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b138b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac097830 0x7f12ac1576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48566/0 (socket says 172.21.15.31:48566) 2024-08-17T02:24:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b138b700 1 -- 172.21.15.31:0/3624291783 learned_addr learned my addr 172.21.15.31:0/3624291783 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b1b8c700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac157250 0x7f12ac158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b0b8a700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ac156e80 0x7f12ac150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b138b700 1 -- 172.21.15.31:0/3624291783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac157250 msgr2=0x7f12ac158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b138b700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac157250 0x7f12ac158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b138b700 1 -- 172.21.15.31:0/3624291783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ac156e80 msgr2=0x7f12ac150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b138b700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ac156e80 0x7f12ac150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b138b700 1 -- 172.21.15.31:0/3624291783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4009420 con 0x7f12ac097830 2024-08-17T02:24:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b138b700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac097830 0x7f12ac1576f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f129c00c7c0 tx=0x7f129c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12a17fa700 1 -- 172.21.15.31:0/3624291783 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c005b30 con 0x7f12ac097830 2024-08-17T02:24:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12a17fa700 1 -- 172.21.15.31:0/3624291783 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c005c90 con 0x7f12ac097830 2024-08-17T02:24:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b35ef700 1 -- 172.21.15.31:0/3624291783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac1584e0 con 0x7f12ac097830 2024-08-17T02:24:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12a17fa700 1 -- 172.21.15.31:0/3624291783 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c004a80 con 0x7f12ac097830 2024-08-17T02:24:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.574+0000 7f12b35ef700 1 -- 172.21.15.31:0/3624291783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ac157c30 con 0x7f12ac097830 2024-08-17T02:24:54.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.578+0000 7f12b35ef700 1 -- 172.21.15.31:0/3624291783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ac0712b0 con 0x7f12ac097830 2024-08-17T02:24:54.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.578+0000 7f12a17fa700 1 -- 172.21.15.31:0/3624291783 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f129c0070d0 con 0x7f12ac097830 2024-08-17T02:24:54.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.578+0000 7f12a17fa700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1298060860 0x7f1298062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.578+0000 7f12a17fa700 1 -- 172.21.15.31:0/3624291783 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f129c07bfc0 con 0x7f12ac097830 2024-08-17T02:24:54.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.578+0000 7f12b0b8a700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1298060860 0x7f1298062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.578+0000 7f12b0b8a700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1298060860 0x7f1298062d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f12ac16c3e0 tx=0x7f12a80099d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.586+0000 7f12a17fa700 1 -- 172.21.15.31:0/3624291783 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f129c04c370 con 0x7f12ac097830 2024-08-17T02:24:54.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.794+0000 7f12b35ef700 1 -- 172.21.15.31:0/3624291783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f12ac155f00 con 0x7f12ac097830 2024-08-17T02:24:54.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.802+0000 7f12a17fa700 1 -- 172.21.15.31:0/3624291783 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154535 (secure 0 0 0) 0x7f129c04f990 con 0x7f12ac097830 2024-08-17T02:24:54.810 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 -- 172.21.15.31:0/3624291783 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1298060860 msgr2=0x7f1298062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1298060860 0x7f1298062d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f12ac16c3e0 tx=0x7f12a80099d0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 -- 172.21.15.31:0/3624291783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac097830 msgr2=0x7f12ac1576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac097830 0x7f12ac1576f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f129c00c7c0 tx=0x7f129c007f70 comp rx=0 tx=0).stop 2024-08-17T02:24:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 -- 172.21.15.31:0/3624291783 shutdown_connections 2024-08-17T02:24:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1298060860 0x7f1298062d10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f12ac157250 0x7f12ac158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12ac156e80 0x7f12ac150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 --2- 172.21.15.31:0/3624291783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12ac097830 0x7f12ac1576f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 -- 172.21.15.31:0/3624291783 >> 172.21.15.31:0/3624291783 conn(0x7f12ac0ceb70 msgr2=0x7f12ac0b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 -- 172.21.15.31:0/3624291783 shutdown_connections 2024-08-17T02:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.806+0000 7f12b35ef700 1 -- 172.21.15.31:0/3624291783 wait complete. 2024-08-17T02:24:54.826 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":24030},{"type":"v1","addr":"172.21.15.31:6833","nonce":24030}]},"active_addr":"172.21.15.31:6833/24030","active_change":"2024-08-17T02:24:25.561398+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1135723443}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3528335975}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":4066778988}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1675259853}]}]} 2024-08-17T02:24:54.829 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:24:54.829 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:24:54.829 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:54.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4636d25700 1 Processor -- start 2024-08-17T02:24:54.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4636d25700 1 -- start start 2024-08-17T02:24:54.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4636d25700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f463015d6c0 0x7f46300aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4636d25700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46300aa880 0x7f463015b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4636d25700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463015b480 con 0x7f46300cc0f0 2024-08-17T02:24:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4636d25700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46300cc4c0 con 0x7f463015d6c0 2024-08-17T02:24:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4636d25700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300ab0e0 con 0x7f46300aa880 2024-08-17T02:24:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4635d23700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f46300cc0f0 0x7f463015cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58392/0 (socket says 172.21.15.31:58392) 2024-08-17T02:24:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4635d23700 1 -- 172.21.15.31:0/1301019447 learned_addr learned my addr 172.21.15.31:0/1301019447 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4636524700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46300aa880 0x7f463015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4635522700 1 --2- 172.21.15.31:0/1301019447 >> v2:172.21.15.92:3300/0 conn(0x7f463015d6c0 0x7f46300aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384731724 0 0) 0x7f463015b480 con 0x7f46300cc0f0 2024-08-17T02:24:54.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f461c003570 con 0x7f46300cc0f0 2024-08-17T02:24:54.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 474921658 0 0) 0x7f461c003570 con 0x7f46300cc0f0 2024-08-17T02:24:54.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46300aa880 msgr2=0x7f463015b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46300aa880 0x7f463015b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 >> v2:172.21.15.92:3300/0 conn(0x7f463015d6c0 msgr2=0x7f46300aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 --2- 172.21.15.31:0/1301019447 >> v2:172.21.15.92:3300/0 conn(0x7f463015d6c0 0x7f46300aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46300ab3c0 con 0x7f46300cc0f0 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4636524700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46300aa880 0x7f463015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f46280017f0 con 0x7f46300cc0f0 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 >> v1:172.21.15.31:6789/0 conn(0x7f46300cc0f0 legacy=0x7f463015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46300aa880 0x7f461c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f461c003fa0 0x7f461c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c004d50 0x7f461c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46300ab0e0 con 0x7f461c004d50 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c00ba60 con 0x7f461c003fa0 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c00bba0 con 0x7f46300aa880 2024-08-17T02:24:54.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.934+0000 7f4635d23700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46300aa880 0x7f461c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4635522700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f461c003fa0 0x7f461c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636524700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c004d50 0x7f461c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636524700 1 -- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46300aa880 msgr2=0x7f461c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636524700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46300aa880 0x7f461c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636524700 1 -- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f461c003fa0 msgr2=0x7f461c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636524700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f461c003fa0 0x7f461c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636524700 1 -- 172.21.15.31:0/1301019447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c009420 con 0x7f461c004d50 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636524700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c004d50 0x7f461c0051c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f462c009df0 tx=0x7f462c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51eaef5ce69e035 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c009740 con 0x7f461c004d50 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c00e920 con 0x7f461c004d50 2024-08-17T02:24:54.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4634d21700 1 -- 172.21.15.31:0/1301019447 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00ece0 con 0x7f461c004d50 2024-08-17T02:24:54.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636d25700 1 -- 172.21.15.31:0/1301019447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c004d50 msgr2=0x7f461c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636d25700 1 --2- 172.21.15.31:0/1301019447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f461c004d50 0x7f461c0051c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f462c009df0 tx=0x7f462c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636524700 1 -- 172.21.15.31:0/1301019447 reap_dead start 2024-08-17T02:24:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636d25700 1 -- 172.21.15.31:0/1301019447 shutdown_connections 2024-08-17T02:24:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636d25700 1 -- 172.21.15.31:0/1301019447 >> 172.21.15.31:0/1301019447 conn(0x7f463006a450 msgr2=0x7f4630067400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636d25700 1 -- 172.21.15.31:0/1301019447 shutdown_connections 2024-08-17T02:24:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.938+0000 7f4636d25700 1 -- 172.21.15.31:0/1301019447 wait complete. 2024-08-17T02:24:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 Processor -- start 2024-08-17T02:24:54.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 -- start start 2024-08-17T02:24:54.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4630158780 0x7f4630156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4630158b50 0x7f4630156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4630067400 0x7f4630067870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46301538e0 con 0x7f4630067400 2024-08-17T02:24:54.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630067db0 con 0x7f4630158780 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4630156de0 con 0x7f4630158b50 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636524700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4630067400 0x7f4630067870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636524700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4630067400 0x7f4630067870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48576/0 (socket says 172.21.15.31:48576) 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636524700 1 -- 172.21.15.31:0/2146187432 learned_addr learned my addr 172.21.15.31:0/2146187432 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4635d23700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4630158780 0x7f4630156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4635522700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4630158b50 0x7f4630156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636524700 1 -- 172.21.15.31:0/2146187432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4630158b50 msgr2=0x7f4630156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636524700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4630158b50 0x7f4630156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636524700 1 -- 172.21.15.31:0/2146187432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4630158780 msgr2=0x7f4630156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636524700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4630158780 0x7f4630156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636524700 1 -- 172.21.15.31:0/2146187432 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46301529a0 con 0x7f4630067400 2024-08-17T02:24:54.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4635d23700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4630158780 0x7f4630156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4635522700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4630158b50 0x7f4630156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636524700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4630067400 0x7f4630067870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f462c016000 tx=0x7f462c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4625ffb700 1 -- 172.21.15.31:0/2146187432 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c022070 con 0x7f4630067400 2024-08-17T02:24:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4625ffb700 1 -- 172.21.15.31:0/2146187432 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c009740 con 0x7f4630067400 2024-08-17T02:24:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4625ffb700 1 -- 172.21.15.31:0/2146187432 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c01c890 con 0x7f4630067400 2024-08-17T02:24:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 -- 172.21.15.31:0/2146187432 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4630151be0 con 0x7f4630067400 2024-08-17T02:24:54.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 -- 172.21.15.31:0/2146187432 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46301521a0 con 0x7f4630067400 2024-08-17T02:24:54.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.942+0000 7f4636d25700 1 -- 172.21.15.31:0/2146187432 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46300712b0 con 0x7f4630067400 2024-08-17T02:24:54.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.946+0000 7f4625ffb700 1 -- 172.21.15.31:0/2146187432 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f462c01cc80 con 0x7f4630067400 2024-08-17T02:24:54.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.946+0000 7f4625ffb700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4614060890 0x7f4614062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.946+0000 7f4625ffb700 1 -- 172.21.15.31:0/2146187432 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f462c000e40 con 0x7f4630067400 2024-08-17T02:24:54.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.946+0000 7f4635d23700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4614060890 0x7f4614062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.946+0000 7f4635d23700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4614060890 0x7f4614062d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4628001580 tx=0x7f4628006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:54.954+0000 7f4625ffb700 1 -- 172.21.15.31:0/2146187432 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f462c04e6a0 con 0x7f4630067400 2024-08-17T02:24:55.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.118+0000 7f4636d25700 1 -- 172.21.15.31:0/2146187432 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46300633e0 con 0x7f4630067400 2024-08-17T02:24:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.118+0000 7f4625ffb700 1 -- 172.21.15.31:0/2146187432 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f462c051cc0 con 0x7f4630067400 2024-08-17T02:24:55.126 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:55.126 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 -- 172.21.15.31:0/2146187432 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4614060890 msgr2=0x7f4614062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4614060890 0x7f4614062d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4628001580 tx=0x7f4628006040 comp rx=0 tx=0).stop 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 -- 172.21.15.31:0/2146187432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4630067400 msgr2=0x7f4630067870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4630067400 0x7f4630067870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f462c016000 tx=0x7f462c01a000 comp rx=0 tx=0).stop 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 -- 172.21.15.31:0/2146187432 shutdown_connections 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4614060890 0x7f4614062d40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4630067400 0x7f4630067870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4630158b50 0x7f4630156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 --2- 172.21.15.31:0/2146187432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4630158780 0x7f4630156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 -- 172.21.15.31:0/2146187432 >> 172.21.15.31:0/2146187432 conn(0x7f463006a450 msgr2=0x7f463014fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 -- 172.21.15.31:0/2146187432 shutdown_connections 2024-08-17T02:24:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.122+0000 7f4636d25700 1 -- 172.21.15.31:0/2146187432 wait complete. 2024-08-17T02:24:55.140 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:24:55.140 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:55.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20d71a1700 1 Processor -- start 2024-08-17T02:24:55.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20d71a1700 1 -- start start 2024-08-17T02:24:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20d71a1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f20d015d530 0x7f20d006a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20d71a1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f20d00ade80 0x7f20d006a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20d71a1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d00ad9f0 con 0x7f20d00af010 2024-08-17T02:24:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20d71a1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d00acde0 con 0x7f20d00ade80 2024-08-17T02:24:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20d71a1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d00ad0c0 con 0x7f20d015d530 2024-08-17T02:24:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f20d00ade80 0x7f20d006a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f20d00ade80 0x7f20d006a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48584/0 (socket says 172.21.15.31:48584) 2024-08-17T02:24:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cffff700 1 -- 172.21.15.31:0/70316702 learned_addr learned my addr 172.21.15.31:0/70316702 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20d4f3d700 1 --2- 172.21.15.31:0/70316702 >> v2:172.21.15.92:3300/0 conn(0x7f20d015d530 0x7f20d006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cffff700 1 -- 172.21.15.31:0/70316702 >> v2:172.21.15.92:3300/0 conn(0x7f20d015d530 msgr2=0x7f20d006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cffff700 1 --2- 172.21.15.31:0/70316702 >> v2:172.21.15.92:3300/0 conn(0x7f20d015d530 0x7f20d006a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cffff700 1 -- 172.21.15.31:0/70316702 >> v1:172.21.15.92:6789/0 conn(0x7f20d00af010 legacy=0x7f20d00af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cffff700 1 -- 172.21.15.31:0/70316702 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d00ad3a0 con 0x7f20d00ade80 2024-08-17T02:24:55.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cffff700 1 --2- 172.21.15.31:0/70316702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00ade80 0x7f20d006a6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f20d0068800 tx=0x7f20c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f7b8cce72fbf40 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cf7fe700 1 -- 172.21.15.31:0/70316702 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800e070 con 0x7f20d00ade80 2024-08-17T02:24:55.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cf7fe700 1 -- 172.21.15.31:0/70316702 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c800ba20 con 0x7f20d00ade80 2024-08-17T02:24:55.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20cf7fe700 1 -- 172.21.15.31:0/70316702 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c80092e0 con 0x7f20d00ade80 2024-08-17T02:24:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20d71a1700 1 -- 172.21.15.31:0/70316702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00ade80 msgr2=0x7f20d006a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.234+0000 7f20d71a1700 1 --2- 172.21.15.31:0/70316702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00ade80 0x7f20d006a6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f20d0068800 tx=0x7f20c8009840 comp rx=0 tx=0).stop 2024-08-17T02:24:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.238+0000 7f20d71a1700 1 -- 172.21.15.31:0/70316702 shutdown_connections 2024-08-17T02:24:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.238+0000 7f20d71a1700 1 --2- 172.21.15.31:0/70316702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00ade80 0x7f20d006a6e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.238+0000 7f20d71a1700 1 --2- 172.21.15.31:0/70316702 >> v2:172.21.15.92:3300/0 conn(0x7f20d015d530 0x7f20d006a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.238+0000 7f20d71a1700 1 -- 172.21.15.31:0/70316702 >> 172.21.15.31:0/70316702 conn(0x7f20d00cbe50 msgr2=0x7f20d00cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.238+0000 7f20d71a1700 1 -- 172.21.15.31:0/70316702 shutdown_connections 2024-08-17T02:24:55.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.238+0000 7f20d71a1700 1 -- 172.21.15.31:0/70316702 wait complete. 2024-08-17T02:24:55.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.238+0000 7f20d71a1700 1 Processor -- start 2024-08-17T02:24:55.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.238+0000 7f20d71a1700 1 -- start start 2024-08-17T02:24:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d71a1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20d00ade80 0x7f20d0158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d71a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00af010 0x7f20d00c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d71a1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20d015d530 0x7f20d016dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d71a1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d006d6e0 con 0x7f20d00af010 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d71a1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00c90d0 con 0x7f20d00ade80 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d71a1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00c93b0 con 0x7f20d015d530 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20cffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00af010 0x7f20d00c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20cffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00af010 0x7f20d00c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48598/0 (socket says 172.21.15.31:48598) 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20cffff700 1 -- 172.21.15.31:0/3681536269 learned_addr learned my addr 172.21.15.31:0/3681536269 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d4f3d700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20d00ade80 0x7f20d0158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d573e700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20d015d530 0x7f20d016dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d4f3d700 1 -- 172.21.15.31:0/3681536269 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20d015d530 msgr2=0x7f20d016dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d4f3d700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20d015d530 0x7f20d016dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d4f3d700 1 -- 172.21.15.31:0/3681536269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00af010 msgr2=0x7f20d00c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d4f3d700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00af010 0x7f20d00c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d4f3d700 1 -- 172.21.15.31:0/3681536269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8009ae0 con 0x7f20d00ade80 2024-08-17T02:24:55.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20cffff700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00af010 0x7f20d00c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:55.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d4f3d700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20d00ade80 0x7f20d0158070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f20b800e900 tx=0x7f20b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20ccff9700 1 -- 172.21.15.31:0/3681536269 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8013680 con 0x7f20d00ade80 2024-08-17T02:24:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20ccff9700 1 -- 172.21.15.31:0/3681536269 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b80137e0 con 0x7f20d00ade80 2024-08-17T02:24:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d71a1700 1 -- 172.21.15.31:0/3681536269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d00c9690 con 0x7f20d00ade80 2024-08-17T02:24:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20ccff9700 1 -- 172.21.15.31:0/3681536269 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8013ba0 con 0x7f20d00ade80 2024-08-17T02:24:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.242+0000 7f20d71a1700 1 -- 172.21.15.31:0/3681536269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d01585b0 con 0x7f20d00ade80 2024-08-17T02:24:55.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.246+0000 7f20d71a1700 1 -- 172.21.15.31:0/3681536269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d00712b0 con 0x7f20d00ade80 2024-08-17T02:24:55.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.246+0000 7f20ccff9700 1 -- 172.21.15.31:0/3681536269 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f20b8005a00 con 0x7f20d00ade80 2024-08-17T02:24:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.246+0000 7f20ccff9700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f20b0060860 0x7f20b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.246+0000 7f20ccff9700 1 -- 172.21.15.31:0/3681536269 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20b807d060 con 0x7f20d00ade80 2024-08-17T02:24:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.246+0000 7f20cffff700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f20b0060860 0x7f20b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.246+0000 7f20cffff700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f20b0060860 0x7f20b0062d10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20d00b20e0 tx=0x7f20c8018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.258+0000 7f20ccff9700 1 -- 172.21.15.31:0/3681536269 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f20b804d410 con 0x7f20d00ade80 2024-08-17T02:24:55.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.426+0000 7f20d71a1700 1 -- 172.21.15.31:0/3681536269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20d00aea90 con 0x7f20d00ade80 2024-08-17T02:24:55.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.426+0000 7f20ccff9700 1 -- 172.21.15.31:0/3681536269 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f20b8017090 con 0x7f20d00ade80 2024-08-17T02:24:55.433 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:55.433 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:55.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 -- 172.21.15.31:0/3681536269 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f20b0060860 msgr2=0x7f20b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f20b0060860 0x7f20b0062d10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20d00b20e0 tx=0x7f20c8018000 comp rx=0 tx=0).stop 2024-08-17T02:24:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 -- 172.21.15.31:0/3681536269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20d00ade80 msgr2=0x7f20d0158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20d00ade80 0x7f20d0158070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f20b800e900 tx=0x7f20b80091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 -- 172.21.15.31:0/3681536269 shutdown_connections 2024-08-17T02:24:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f20b0060860 0x7f20b0062d10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f20d015d530 0x7f20d016dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20d00af010 0x7f20d00c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 --2- 172.21.15.31:0/3681536269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20d00ade80 0x7f20d0158070 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 -- 172.21.15.31:0/3681536269 >> 172.21.15.31:0/3681536269 conn(0x7f20d00cbe50 msgr2=0x7f20d015b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 -- 172.21.15.31:0/3681536269 shutdown_connections 2024-08-17T02:24:55.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.430+0000 7f20d71a1700 1 -- 172.21.15.31:0/3681536269 wait complete. 2024-08-17T02:24:55.448 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:24:55.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:24:55.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:24:55.450 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:24:55.450 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:24:55.450 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:24:55.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:24:55.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:24:55.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab097b9700 1 Processor -- start 2024-08-17T02:24:55.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab097b9700 1 -- start start 2024-08-17T02:24:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fd09e8700 1 Processor -- start 2024-08-17T02:24:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fd09e8700 1 -- start start 2024-08-17T02:24:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f7a9324e700 1 Processor -- start 2024-08-17T02:24:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5ad493f700 1 Processor -- start 2024-08-17T02:24:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5ad493f700 1 -- start start 2024-08-17T02:24:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f7a9324e700 1 -- start start 2024-08-17T02:24:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab097b9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fab04069690 0x7fab04156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab097b9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab040af420 con 0x7fab040ae560 2024-08-17T02:24:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab097b9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab04156070 con 0x7fab040aef80 2024-08-17T02:24:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab097b9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab04156a40 con 0x7fab04069690 2024-08-17T02:24:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fd09e8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5fcc156fd0 0x7f5fcc0cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fd09e8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5fcc0b12b0 0x7f5fcc0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fd09e8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fcc0ca070 0x7f5fcc06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fd09e8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc0cb1b0 con 0x7f5fcc156fd0 2024-08-17T02:24:55.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fd09e8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc0ca5a0 con 0x7f5fcc0b12b0 2024-08-17T02:24:55.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fd09e8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0ca880 con 0x7f5fcc0ca070 2024-08-17T02:24:55.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab03fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fab040ae560 0x7fab040b1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58394/0 (socket says 172.21.15.31:58394) 2024-08-17T02:24:55.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab03fff700 1 -- 172.21.15.31:0/1774955819 learned_addr learned my addr 172.21.15.31:0/1774955819 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7ff2e6372700 1 Processor -- start 2024-08-17T02:24:55.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fca59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5fcc156fd0 0x7f5fcc0cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fca59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5fcc156fd0 0x7f5fcc0cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48610/0 (socket says 172.21.15.31:48610) 2024-08-17T02:24:55.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fca59c700 1 -- 172.21.15.31:0/535279460 learned_addr learned my addr 172.21.15.31:0/535279460 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab08fb8700 1 --2- 172.21.15.31:0/1774955819 >> v2:172.21.15.92:3300/0 conn(0x7fab04069690 0x7fab04156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7ff2e6372700 1 -- start start 2024-08-17T02:24:55.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab02ffd700 1 -- 172.21.15.31:0/1774955819 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108124805 0 0) 0x7fab040af420 con 0x7fab040ae560 2024-08-17T02:24:55.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fcad9d700 1 --2- 172.21.15.31:0/535279460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fcc0ca070 0x7f5fcc06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab02ffd700 1 -- 172.21.15.31:0/1774955819 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaec003570 con 0x7fab040ae560 2024-08-17T02:24:55.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fc9d9b700 1 --2- 172.21.15.31:0/535279460 >> v2:172.21.15.92:3300/0 conn(0x7f5fcc0b12b0 0x7f5fcc0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5ad493f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5ac80e3230 0x7f5ac8005f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5ad493f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 0x7f5ac804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5ad493f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac8007210 con 0x7f5ac80e3600 2024-08-17T02:24:55.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5ad493f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac8034640 con 0x7f5ac80e3230 2024-08-17T02:24:55.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5ad493f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8006600 con 0x7f5ac8033ef0 2024-08-17T02:24:55.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f7a9324e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7a8c06a8b0 0x7f7a8c0b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f7a90fea700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7a8c155e20 0x7f7a8c06a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58400/0 (socket says 172.21.15.31:58400) 2024-08-17T02:24:55.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab02ffd700 1 -- 172.21.15.31:0/1774955819 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 155313058 0 0) 0x7faaec003570 con 0x7fab040ae560 2024-08-17T02:24:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab08fb8700 1 -- 172.21.15.31:0/1774955819 >> v1:172.21.15.92:6789/0 conn(0x7fab040aef80 legacy=0x7fab04068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab08fb8700 1 -- 172.21.15.31:0/1774955819 >> v1:172.21.15.31:6789/0 conn(0x7fab040ae560 legacy=0x7fab040b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5ace59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5ac80e3600 0x7f5ac80337e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58402/0 (socket says 172.21.15.31:58402) 2024-08-17T02:24:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5aced9d700 1 --2- 172.21.15.31:0/2565322941 >> v2:172.21.15.92:3300/0 conn(0x7f5ac80e3230 0x7f5ac8005f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5ace59c700 1 -- 172.21.15.31:0/2565322941 learned_addr learned my addr 172.21.15.31:0/2565322941 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f7a90fea700 1 -- 172.21.15.31:0/3700593143 learned_addr learned my addr 172.21.15.31:0/3700593143 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7fab08fb8700 1 -- 172.21.15.31:0/1774955819 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab040b1950 con 0x7fab04069690 2024-08-17T02:24:55.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fca59c700 1 -- 172.21.15.31:0/535279460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fcc0ca070 msgr2=0x7f5fcc06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fca59c700 1 --2- 172.21.15.31:0/535279460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fcc0ca070 0x7f5fcc06a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fca59c700 1 -- 172.21.15.31:0/535279460 >> v2:172.21.15.92:3300/0 conn(0x7f5fcc0b12b0 msgr2=0x7f5fcc0c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fca59c700 1 --2- 172.21.15.31:0/535279460 >> v2:172.21.15.92:3300/0 conn(0x7f5fcc0b12b0 0x7f5fcc0c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.590+0000 7f5fca59c700 1 -- 172.21.15.31:0/535279460 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0cab60 con 0x7f5fcc156fd0 2024-08-17T02:24:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8bfff700 1 --2- 172.21.15.31:0/3700593143 >> v2:172.21.15.31:3300/0 conn(0x7f7a8c06a8b0 0x7f7a8c0b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8fa485700 1 Processor -- start 2024-08-17T02:24:55.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5acf59e700 1 --2- 172.21.15.31:0/2565322941 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 0x7f5ac804fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2d8055cc0 0x7ff2d8056090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff2d804aad0 0x7ff2d804c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a9324e700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a8c1561f0 0x7f7a8c0b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff2d8050750 0x7ff2d8050bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d804b240 con 0x7ff2d8050750 2024-08-17T02:24:55.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d8052f50 con 0x7ff2d804aad0 2024-08-17T02:24:55.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80565d0 con 0x7ff2d8055cc0 2024-08-17T02:24:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8fa485700 1 -- start start 2024-08-17T02:24:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5aced9d700 1 -- 172.21.15.31:0/2565322941 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 msgr2=0x7f5ac804fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5aced9d700 1 --2- 172.21.15.31:0/2565322941 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 0x7f5ac804fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5aced9d700 1 -- 172.21.15.31:0/2565322941 >> v1:172.21.15.31:6789/0 conn(0x7f5ac80e3600 legacy=0x7f5ac80337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5acdd9b700 1 -- 172.21.15.31:0/2565322941 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109728370 0 0) 0x7f5ac8007210 con 0x7f5ac80e3600 2024-08-17T02:24:55.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5aced9d700 1 -- 172.21.15.31:0/2565322941 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac80068e0 con 0x7f5ac80e3230 2024-08-17T02:24:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab08fb8700 1 --2- 172.21.15.31:0/1774955819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04069690 0x7fab04156500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faaf40072f0 tx=0x7faaf400abc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38d5aaeac43a6687 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e490f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff2d8050750 0x7ff2d8050bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e490f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff2d8050750 0x7ff2d8050bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48630/0 (socket says 172.21.15.31:48630) 2024-08-17T02:24:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e490f700 1 -- 172.21.15.31:0/2963224772 learned_addr learned my addr 172.21.15.31:0/2963224772 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a9324e700 1 -- 172.21.15.31:0/3700593143 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c0aeec0 con 0x7f7a8c155e20 2024-08-17T02:24:55.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2df7fe700 1 --2- 172.21.15.31:0/2963224772 >> v2:172.21.15.92:3300/0 conn(0x7ff2d804aad0 0x7ff2d804c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2dffff700 1 --2- 172.21.15.31:0/2963224772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2d8055cc0 0x7ff2d8056090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a917eb700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a8c1561f0 0x7f7a8c0b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e490f700 1 -- 172.21.15.31:0/2963224772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2d8055cc0 msgr2=0x7ff2d8056090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e490f700 1 --2- 172.21.15.31:0/2963224772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2d8055cc0 0x7ff2d8056090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e490f700 1 -- 172.21.15.31:0/2963224772 >> v2:172.21.15.92:3300/0 conn(0x7ff2d804aad0 msgr2=0x7ff2d804c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e490f700 1 --2- 172.21.15.31:0/2963224772 >> v2:172.21.15.92:3300/0 conn(0x7ff2d804aad0 0x7ff2d804c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e490f700 1 -- 172.21.15.31:0/2963224772 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d804af60 con 0x7ff2d8050750 2024-08-17T02:24:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a9324e700 1 -- 172.21.15.31:0/3700593143 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8c0b0be0 con 0x7f7a8c06a8b0 2024-08-17T02:24:55.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a9324e700 1 -- 172.21.15.31:0/3700593143 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0afed0 con 0x7f7a8c1561f0 2024-08-17T02:24:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab02ffd700 1 -- 172.21.15.31:0/1774955819 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf400f070 con 0x7fab04069690 2024-08-17T02:24:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902129219 0 0) 0x7f7a8c0aeec0 con 0x7f7a8c155e20 2024-08-17T02:24:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a74003570 con 0x7f7a8c155e20 2024-08-17T02:24:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab02ffd700 1 -- 172.21.15.31:0/1774955819 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf40089e0 con 0x7fab04069690 2024-08-17T02:24:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab02ffd700 1 -- 172.21.15.31:0/1774955819 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0017f0 con 0x7fab04069690 2024-08-17T02:24:55.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e490f700 1 --2- 172.21.15.31:0/2963224772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d8050750 0x7ff2d8050bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0065520 tx=0x7ff2e0064ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b06c26ec5735e76 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fca59c700 1 --2- 172.21.15.31:0/535279460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fcc156fd0 0x7f5fcc0cb640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc04bad0 tx=0x7f5fc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df560ca097597f1e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5aced9d700 1 --2- 172.21.15.31:0/2565322941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ac80e3230 0x7f5ac8005f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40098d0 tx=0x7f5ac4009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1299baf38b1af99e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fc959a700 1 -- 172.21.15.31:0/535279460 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00108a0 con 0x7f5fcc156fd0 2024-08-17T02:24:55.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fc959a700 1 -- 172.21.15.31:0/535279460 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc0010a00 con 0x7f5fcc156fd0 2024-08-17T02:24:55.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fc959a700 1 -- 172.21.15.31:0/535279460 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0010dc0 con 0x7f5fcc156fd0 2024-08-17T02:24:55.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404374174 0 0) 0x7f7a74003570 con 0x7f7a8c155e20 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a8c1561f0 msgr2=0x7f7a8c0b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a8c1561f0 0x7f7a8c0b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 >> v2:172.21.15.31:3300/0 conn(0x7f7a8c06a8b0 msgr2=0x7f7a8c0b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 --2- 172.21.15.31:0/3700593143 >> v2:172.21.15.31:3300/0 conn(0x7f7a8c06a8b0 0x7f7a8c0b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0af110 con 0x7f7a8c155e20 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f7a840017f0 con 0x7f7a8c155e20 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 >> v1:172.21.15.31:6789/0 conn(0x7f7a8c155e20 legacy=0x7f7a8c06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a74003ae0 0x7f7a74003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a74004810 0x7f7a74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a740052e0 0x7f7a7400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0b0be0 con 0x7f7a74004810 2024-08-17T02:24:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c0afed0 con 0x7f7a74003ae0 2024-08-17T02:24:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7400e3c0 con 0x7f7a740052e0 2024-08-17T02:24:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8bfff700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a74004810 0x7f7a74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a90fea700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a74003ae0 0x7f7a74003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a917eb700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a8c1561f0 0x7f7a8c0b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8fa485700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc8f41503d0 0x7fc8f4068f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8fa485700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8f40ad150 0x7fc8f40694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8fa485700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f40add30 con 0x7fc8f41507a0 2024-08-17T02:24:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8fa485700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f40af070 con 0x7fc8f41503d0 2024-08-17T02:24:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8fa485700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40ad770 con 0x7fc8f40ad150 2024-08-17T02:24:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8f8c82700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc8f41507a0 0x7fc8f40aca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:48984/0 (socket says 172.21.15.31:48984) 2024-08-17T02:24:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8f8c82700 1 -- 172.21.15.31:0/3510023741 learned_addr learned my addr 172.21.15.31:0/3510023741 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8bfff700 1 -- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a740052e0 msgr2=0x7f7a7400dc70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:24:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8bfff700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a740052e0 0x7f7a7400dc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8bfff700 1 -- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a74003ae0 msgr2=0x7f7a74003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8bfff700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a74003ae0 0x7f7a74003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8bfff700 1 -- 172.21.15.31:0/3700593143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0af110 con 0x7f7a74004810 2024-08-17T02:24:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2deffd700 1 -- 172.21.15.31:0/2963224772 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e006d040 con 0x7ff2d8050750 2024-08-17T02:24:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2deffd700 1 -- 172.21.15.31:0/2963224772 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e008b070 con 0x7ff2d8050750 2024-08-17T02:24:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2deffd700 1 -- 172.21.15.31:0/2963224772 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0064870 con 0x7ff2d8050750 2024-08-17T02:24:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 -- 172.21.15.31:0/2963224772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d8050750 msgr2=0x7ff2d8050bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 --2- 172.21.15.31:0/2963224772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d8050750 0x7ff2d8050bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0065520 tx=0x7ff2e0064ee0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8f9483700 1 --2- 172.21.15.31:0/3510023741 >> v2:172.21.15.31:3300/0 conn(0x7fc8f41503d0 0x7fc8f4068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fd09e8700 1 -- 172.21.15.31:0/535279460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fcc156fd0 msgr2=0x7f5fcc0cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fd09e8700 1 --2- 172.21.15.31:0/535279460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fcc156fd0 0x7f5fcc0cb640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc04bad0 tx=0x7f5fc0009250 comp rx=0 tx=0).stop 2024-08-17T02:24:55.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab097b9700 1 -- 172.21.15.31:0/1774955819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04069690 msgr2=0x7fab04156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab097b9700 1 --2- 172.21.15.31:0/1774955819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04069690 0x7fab04156500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faaf40072f0 tx=0x7faaf400abc0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5acdd9b700 1 -- 172.21.15.31:0/2565322941 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4009e70 con 0x7f5ac80e3230 2024-08-17T02:24:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5acdd9b700 1 -- 172.21.15.31:0/2565322941 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac4005c10 con 0x7f5ac80e3230 2024-08-17T02:24:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5acdd9b700 1 -- 172.21.15.31:0/2565322941 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400b650 con 0x7f5ac80e3230 2024-08-17T02:24:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fd09e8700 1 -- 172.21.15.31:0/535279460 shutdown_connections 2024-08-17T02:24:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fd09e8700 1 --2- 172.21.15.31:0/535279460 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fcc0ca070 0x7f5fcc06a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fd09e8700 1 --2- 172.21.15.31:0/535279460 >> v2:172.21.15.92:3300/0 conn(0x7f5fcc0b12b0 0x7f5fcc0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fd09e8700 1 --2- 172.21.15.31:0/535279460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fcc156fd0 0x7f5fcc0cb640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fd09e8700 1 -- 172.21.15.31:0/535279460 >> 172.21.15.31:0/535279460 conn(0x7f5fcc0cbe50 msgr2=0x7f5fcc0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 -- 172.21.15.31:0/2963224772 shutdown_connections 2024-08-17T02:24:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 --2- 172.21.15.31:0/2963224772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d8050750 0x7ff2d8050bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 --2- 172.21.15.31:0/2963224772 >> v2:172.21.15.92:3300/0 conn(0x7ff2d804aad0 0x7ff2d804c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153640498 0 0) 0x7fc8f40add30 con 0x7fc8f41507a0 2024-08-17T02:24:55.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e0003570 con 0x7fc8f41507a0 2024-08-17T02:24:55.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 --2- 172.21.15.31:0/2963224772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2d8055cc0 0x7ff2d8056090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 -- 172.21.15.31:0/2963224772 >> 172.21.15.31:0/2963224772 conn(0x7ff2d8038bf0 msgr2=0x7ff2d8038ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 -- 172.21.15.31:0/2963224772 shutdown_connections 2024-08-17T02:24:55.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fd09e8700 1 -- 172.21.15.31:0/535279460 shutdown_connections 2024-08-17T02:24:55.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5fd09e8700 1 -- 172.21.15.31:0/535279460 wait complete. 2024-08-17T02:24:55.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8bfff700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a74004810 0x7f7a74004c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0cb670 tx=0x7f7a7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d74cf2149c4713d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab097b9700 1 -- 172.21.15.31:0/1774955819 shutdown_connections 2024-08-17T02:24:55.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab097b9700 1 --2- 172.21.15.31:0/1774955819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04069690 0x7fab04156500 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab097b9700 1 -- 172.21.15.31:0/1774955819 >> 172.21.15.31:0/1774955819 conn(0x7fab04067400 msgr2=0x7fab04067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7ff2e6372700 1 -- 172.21.15.31:0/2963224772 wait complete. 2024-08-17T02:24:55.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab097b9700 1 -- 172.21.15.31:0/1774955819 shutdown_connections 2024-08-17T02:24:55.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00b4e0 con 0x7f7a74004810 2024-08-17T02:24:55.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c00d5d0 con 0x7f7a74004810 2024-08-17T02:24:55.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f7a8b7fe700 1 -- 172.21.15.31:0/3700593143 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00d970 con 0x7f7a74004810 2024-08-17T02:24:55.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3721025840 0 0) 0x7fc8e0003570 con 0x7fc8f41507a0 2024-08-17T02:24:55.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8f40ad150 msgr2=0x7fc8f40694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5ad493f700 1 -- 172.21.15.31:0/2565322941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ac80e3230 msgr2=0x7f5ac8005f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7f5ad493f700 1 --2- 172.21.15.31:0/2565322941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ac80e3230 0x7f5ac8005f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40098d0 tx=0x7f5ac4009120 comp rx=0 tx=0).stop 2024-08-17T02:24:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fc8f9c84700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8f40ad150 0x7fc8f40694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8f40ad150 0x7fc8f40694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 >> v2:172.21.15.31:3300/0 conn(0x7fc8f41503d0 msgr2=0x7fc8f4068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/3510023741 >> v2:172.21.15.31:3300/0 conn(0x7fc8f41503d0 0x7fc8f4068f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40ada50 con 0x7fc8f41507a0 2024-08-17T02:24:55.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 <== mon.1 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7fc8ec0017f0 con 0x7fc8f41507a0 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 >> v1:172.21.15.92:6789/0 conn(0x7fc8f41507a0 legacy=0x7fc8f40aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e0003a60 0x7fc8e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0004810 0x7fc8e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8e00051c0 0x7fc8e000dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40af070 con 0x7fc8e0003a60 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40ad770 con 0x7fc8e0004810 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e000e290 con 0x7fc8e00051c0 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f9c84700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8f40ad150 0x7fc8f40694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f9483700 1 --2- 172.21.15.31:0/3510023741 >> v2:172.21.15.31:3300/0 conn(0x7fc8f41503d0 0x7fc8f4068f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f8c82700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0004810 0x7fc8e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f9c84700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8e00051c0 0x7fc8e000dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f7a9324e700 1 -- 172.21.15.31:0/3700593143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a74004810 msgr2=0x7f7a74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f7a9324e700 1 --2- 172.21.15.31:0/3700593143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a74004810 0x7f7a74004c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0cb670 tx=0x7f7a7c008040 comp rx=0 tx=0).stop 2024-08-17T02:24:55.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2e6372700 1 Processor -- start 2024-08-17T02:24:55.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fd09e8700 1 Processor -- start 2024-08-17T02:24:55.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f7a917eb700 1 -- 172.21.15.31:0/3700593143 reap_dead start 2024-08-17T02:24:55.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f7a9324e700 1 -- 172.21.15.31:0/3700593143 shutdown_connections 2024-08-17T02:24:55.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f7a9324e700 1 -- 172.21.15.31:0/3700593143 >> 172.21.15.31:0/3700593143 conn(0x7f7a8c0cbe50 msgr2=0x7f7a8c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f9483700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e0003a60 0x7fc8e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f8c82700 1 -- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8e00051c0 msgr2=0x7fc8e000dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f8c82700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8e00051c0 0x7fc8e000dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f8c82700 1 -- 172.21.15.31:0/3510023741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e0003a60 msgr2=0x7fc8e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f8c82700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e0003a60 0x7fc8e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f8c82700 1 -- 172.21.15.31:0/3510023741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e0003570 con 0x7fc8e0004810 2024-08-17T02:24:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.594+0000 7fab097b9700 1 -- 172.21.15.31:0/1774955819 wait complete. 2024-08-17T02:24:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab097b9700 1 Processor -- start 2024-08-17T02:24:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5ad493f700 1 -- 172.21.15.31:0/2565322941 shutdown_connections 2024-08-17T02:24:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5ad493f700 1 --2- 172.21.15.31:0/2565322941 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 0x7f5ac804fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5ad493f700 1 --2- 172.21.15.31:0/2565322941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ac80e3230 0x7f5ac8005f00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5ad493f700 1 -- 172.21.15.31:0/2565322941 >> 172.21.15.31:0/2565322941 conn(0x7f5ac8051690 msgr2=0x7f5ac8051a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab097b9700 1 -- start start 2024-08-17T02:24:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8f8c82700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0004810 0x7fc8e0004c80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00a970 tx=0x7fc8ec002210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73b7466bbc055e29 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0070d0 con 0x7fc8e0004810 2024-08-17T02:24:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec007270 con 0x7fc8e0004810 2024-08-17T02:24:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8ebfff700 1 -- 172.21.15.31:0/3510023741 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec007630 con 0x7fc8e0004810 2024-08-17T02:24:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fd09e8700 1 -- start start 2024-08-17T02:24:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fd09e8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fcc0b12b0 0x7f5fcc13e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fd09e8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fcc0ca070 0x7f5fcc161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fd09e8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fcc156fd0 0x7f5fcc161b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fd09e8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0c1120 con 0x7f5fcc156fd0 2024-08-17T02:24:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fd09e8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc1621a0 con 0x7f5fcc0b12b0 2024-08-17T02:24:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fd09e8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc162480 con 0x7f5fcc0ca070 2024-08-17T02:24:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fcad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fcc156fd0 0x7f5fcc161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fcad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fcc156fd0 0x7f5fcc161b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48670/0 (socket says 172.21.15.31:48670) 2024-08-17T02:24:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fcad9d700 1 -- 172.21.15.31:0/3908431764 learned_addr learned my addr 172.21.15.31:0/3908431764 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fc9d9b700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fcc0ca070 0x7f5fcc161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2e6372700 1 -- start start 2024-08-17T02:24:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2e6372700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d804aad0 0x7ff2d80d1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2e6372700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d8050750 0x7ff2d804f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2e6372700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2d8055cc0 0x7ff2d80d2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2e6372700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8020000 con 0x7ff2d8050750 2024-08-17T02:24:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2e6372700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d804fd50 con 0x7ff2d804aad0 2024-08-17T02:24:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2e6372700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d801f9b0 con 0x7ff2d8055cc0 2024-08-17T02:24:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d8050750 0x7ff2d804f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2df7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d8050750 0x7ff2d804f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48676/0 (socket says 172.21.15.31:48676) 2024-08-17T02:24:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2df7fe700 1 -- 172.21.15.31:0/631632110 learned_addr learned my addr 172.21.15.31:0/631632110 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2dffff700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d804aad0 0x7ff2d80d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab097b9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04069690 0x7fab041519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab097b9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab040ae560 0x7fab04157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab097b9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040aef80 0x7fab040cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f7a9324e700 1 -- 172.21.15.31:0/3700593143 shutdown_connections 2024-08-17T02:24:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f7a9324e700 1 -- 172.21.15.31:0/3700593143 wait complete. 2024-08-17T02:24:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab097b9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab041695f0 con 0x7fab040aef80 2024-08-17T02:24:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab097b9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab040cae70 con 0x7fab04069690 2024-08-17T02:24:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab097b9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab040c8390 con 0x7fab040ae560 2024-08-17T02:24:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab08fb8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040aef80 0x7fab040cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab08fb8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040aef80 0x7fab040cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48682/0 (socket says 172.21.15.31:48682) 2024-08-17T02:24:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab08fb8700 1 -- 172.21.15.31:0/4217254477 learned_addr learned my addr 172.21.15.31:0/4217254477 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2e490f700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2d8055cc0 0x7ff2d80d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2df7fe700 1 -- 172.21.15.31:0/631632110 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2d8055cc0 msgr2=0x7ff2d80d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2df7fe700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2d8055cc0 0x7ff2d80d2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2df7fe700 1 -- 172.21.15.31:0/631632110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d804aad0 msgr2=0x7ff2d80d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2df7fe700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2d804aad0 0x7ff2d80d1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2df7fe700 1 -- 172.21.15.31:0/631632110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0071090 con 0x7ff2d8050750 2024-08-17T02:24:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2e490f700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2d8055cc0 0x7ff2d80d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5ad493f700 1 -- 172.21.15.31:0/2565322941 shutdown_connections 2024-08-17T02:24:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5ad493f700 1 -- 172.21.15.31:0/2565322941 wait complete. 2024-08-17T02:24:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab08fb8700 1 -- 172.21.15.31:0/4217254477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab040ae560 msgr2=0x7fab04157560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:24:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab08fb8700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab040ae560 0x7fab04157560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab08fb8700 1 -- 172.21.15.31:0/4217254477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04069690 msgr2=0x7fab041519b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:24:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab08fb8700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab04069690 0x7fab041519b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fab08fb8700 1 -- 172.21.15.31:0/4217254477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab040c8670 con 0x7fab040aef80 2024-08-17T02:24:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7ff2df7fe700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d8050750 0x7ff2d804f420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400d860 tx=0x7ff2d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7fc8fa485700 1 -- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0004810 msgr2=0x7fc8e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7fc8fa485700 1 --2- 172.21.15.31:0/3510023741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8e0004810 0x7fc8e0004c80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00a970 tx=0x7fc8ec002210 comp rx=0 tx=0).stop 2024-08-17T02:24:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7fab08fb8700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040aef80 0x7fab040cb670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c330 tx=0x7faaf4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7fc8f9c84700 1 -- 172.21.15.31:0/3510023741 reap_dead start 2024-08-17T02:24:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a9324e700 1 Processor -- start 2024-08-17T02:24:55.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a9324e700 1 -- start start 2024-08-17T02:24:55.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fcad9d700 1 -- 172.21.15.31:0/3908431764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fcc0ca070 msgr2=0x7f5fcc161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fcad9d700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5fcc0ca070 0x7f5fcc161630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fcad9d700 1 -- 172.21.15.31:0/3908431764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fcc0b12b0 msgr2=0x7f5fcc13e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fcad9d700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fcc0b12b0 0x7f5fcc13e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fcad9d700 1 -- 172.21.15.31:0/3908431764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00094f0 con 0x7f5fcc156fd0 2024-08-17T02:24:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fcad9d700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fcc156fd0 0x7f5fcc161b70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009e90 tx=0x7f5fc400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fba7fc700 1 -- 172.21.15.31:0/3908431764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc400cc20 con 0x7f5fcc156fd0 2024-08-17T02:24:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc162760 con 0x7f5fcc156fd0 2024-08-17T02:24:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.598+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc162d20 con 0x7f5fcc156fd0 2024-08-17T02:24:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5fcc0712b0 con 0x7f5fcc156fd0 2024-08-17T02:24:55.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a9324e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a8c142d90 0x7f7a8c143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a9324e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a8c06d2d0 0x7f7a8c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a9324e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a8c1586c0 0x7f7a8c158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a9324e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c15a030 con 0x7f7a8c06d2d0 2024-08-17T02:24:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a9324e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c06dc60 con 0x7f7a8c1586c0 2024-08-17T02:24:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a9324e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c159420 con 0x7f7a8c142d90 2024-08-17T02:24:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ad493f700 1 Processor -- start 2024-08-17T02:24:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ad493f700 1 -- start start 2024-08-17T02:24:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7fc8fa485700 1 -- 172.21.15.31:0/3510023741 shutdown_connections 2024-08-17T02:24:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7fc8fa485700 1 -- 172.21.15.31:0/3510023741 >> 172.21.15.31:0/3510023741 conn(0x7fc8f4067400 msgr2=0x7fc8f4067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ad493f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 0x7f5ac804fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ad493f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ac80e3230 0x7f5ac804d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ad493f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ac80e3600 0x7f5ac80d3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ad493f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac80d49d0 con 0x7f5ac80e3230 2024-08-17T02:24:55.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ad493f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac804eac0 con 0x7f5ac80e3600 2024-08-17T02:24:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ad493f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac80f00f0 con 0x7f5ac8033ef0 2024-08-17T02:24:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ace59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ac80e3230 0x7f5ac804d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5aced9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 0x7f5ac804fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a917eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a8c1586c0 0x7f7a8c158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a917eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a8c1586c0 0x7f7a8c158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:57926/0 (socket says 172.21.15.31:57926) 2024-08-17T02:24:55.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a917eb700 1 -- 172.21.15.31:0/2214596239 learned_addr learned my addr 172.21.15.31:0/2214596239 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7fc8fa485700 1 -- 172.21.15.31:0/3510023741 shutdown_connections 2024-08-17T02:24:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5aced9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 0x7f5ac804fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:41180/0 (socket says 172.21.15.31:41180) 2024-08-17T02:24:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5aced9d700 1 -- 172.21.15.31:0/603650571 learned_addr learned my addr 172.21.15.31:0/603650571 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5acf59e700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ac80e3600 0x7f5ac80d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ace59c700 1 -- 172.21.15.31:0/603650571 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 msgr2=0x7f5ac804fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ace59c700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 0x7f5ac804fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ace59c700 1 -- 172.21.15.31:0/603650571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ac80e3600 msgr2=0x7f5ac80d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ace59c700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ac80e3600 0x7f5ac80d3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5ace59c700 1 -- 172.21.15.31:0/603650571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40093c0 con 0x7f5ac80e3230 2024-08-17T02:24:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5aced9d700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ac8033ef0 0x7f5ac804fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5acf59e700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ac80e3600 0x7f5ac80d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a917eb700 1 -- 172.21.15.31:0/2214596239 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a8c142d90 msgr2=0x7f7a8c143160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:24:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a917eb700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a8c142d90 0x7f7a8c143160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a917eb700 1 -- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a8c06d2d0 msgr2=0x7f7a8c06d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a917eb700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a8c06d2d0 0x7f7a8c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a917eb700 1 -- 172.21.15.31:0/2214596239 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c159700 con 0x7f7a8c1586c0 2024-08-17T02:24:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a917eb700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a8c1586c0 0x7f7a8c158b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0b1a80 tx=0x7f7a80008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f7a88ff9700 1 -- 172.21.15.31:0/2214596239 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a800113f0 con 0x7f7a8c1586c0 2024-08-17T02:24:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f7a88ff9700 1 -- 172.21.15.31:0/2214596239 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a80011550 con 0x7f7a8c1586c0 2024-08-17T02:24:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f7a88ff9700 1 -- 172.21.15.31:0/2214596239 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80011910 con 0x7f7a8c1586c0 2024-08-17T02:24:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7ff2cbfff700 1 -- 172.21.15.31:0/631632110 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4009610 con 0x7ff2d8050750 2024-08-17T02:24:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7ff2cbfff700 1 -- 172.21.15.31:0/631632110 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d4009770 con 0x7ff2d8050750 2024-08-17T02:24:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d801fc90 con 0x7ff2d8050750 2024-08-17T02:24:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d8050030 con 0x7ff2d8050750 2024-08-17T02:24:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7ff2cbfff700 1 -- 172.21.15.31:0/631632110 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4009b30 con 0x7ff2d8050750 2024-08-17T02:24:55.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7fc8fa485700 1 -- 172.21.15.31:0/3510023741 wait complete. 2024-08-17T02:24:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8fa485700 1 Processor -- start 2024-08-17T02:24:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fba7fc700 1 -- 172.21.15.31:0/3908431764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc400f040 con 0x7f5fcc156fd0 2024-08-17T02:24:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fba7fc700 1 -- 172.21.15.31:0/3908431764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4014480 con 0x7f5fcc156fd0 2024-08-17T02:24:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fba7fc700 1 -- 172.21.15.31:0/3908431764 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5fc40147f0 con 0x7f5fcc156fd0 2024-08-17T02:24:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fba7fc700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5fac060a30 0x7f5fac062ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fba7fc700 1 -- 172.21.15.31:0/3908431764 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fc407d640 con 0x7f5fcc156fd0 2024-08-17T02:24:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fca59c700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5fac060a30 0x7f5fac062ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fba7fc700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] conn(0x7f5fac068c40 0x7f5fac06b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fba7fc700 1 -- 172.21.15.31:0/3908431764 --> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fac06b700 con 0x7f5fac068c40 2024-08-17T02:24:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fba7fc700 1 -- 172.21.15.31:0/3908431764 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fc407fb90 con 0x7f5fcc156fd0 2024-08-17T02:24:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f5fc9d9b700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] conn(0x7f5fac068c40 0x7f5fac06b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5fc9d9b700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] conn(0x7f5fac068c40 0x7f5fac06b050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5fca59c700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5fac060a30 0x7f5fac062ee0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc04bad0 tx=0x7f5fc0018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f45f2128700 1 Processor -- start 2024-08-17T02:24:55.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.602+0000 7f45f2128700 1 -- start start 2024-08-17T02:24:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f7a9324e700 1 -- 172.21.15.31:0/2214596239 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8c1599e0 con 0x7f7a8c1586c0 2024-08-17T02:24:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f7a9324e700 1 -- 172.21.15.31:0/2214596239 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c159050 con 0x7f7a8c1586c0 2024-08-17T02:24:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2c0000fd0 con 0x7ff2d8050750 2024-08-17T02:24:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5ace59c700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ac80e3230 0x7f5ac804d600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ad002b300 tx=0x7f5ad0064ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5ab6ffd700 1 -- 172.21.15.31:0/603650571 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad006d040 con 0x7f5ac80e3230 2024-08-17T02:24:55.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5ab6ffd700 1 -- 172.21.15.31:0/603650571 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad004beb0 con 0x7f5ac80e3230 2024-08-17T02:24:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac80d3dc0 con 0x7f5ac80e3230 2024-08-17T02:24:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5ab6ffd700 1 -- 172.21.15.31:0/603650571 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad006f700 con 0x7f5ac80e3230 2024-08-17T02:24:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7ff2cbfff700 1 -- 172.21.15.31:0/631632110 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff2d401e460 con 0x7ff2d8050750 2024-08-17T02:24:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8fa485700 1 -- start start 2024-08-17T02:24:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8fa485700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8e0004810 0x7fc8f4156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8fa485700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8f41531e0 0x7fc8f41488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8fa485700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8f4153650 0x7fc8f4148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8fa485700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f41526d0 con 0x7fc8f4153650 2024-08-17T02:24:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8fa485700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f416e980 con 0x7fc8f41531e0 2024-08-17T02:24:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8fa485700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4155880 con 0x7fc8e0004810 2024-08-17T02:24:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5fba7fc700 1 -- 172.21.15.31:0/3908431764 <== osd.5 v2:172.21.15.92:6800/24420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5fac06b700 con 0x7f5fac068c40 2024-08-17T02:24:55.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac80d4380 con 0x7f5ac80e3230 2024-08-17T02:24:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f2128700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f45ec068f80 0x7f45ec069350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f2128700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45ec0b1b90 0x7f45ec16a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f2128700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ec0ac5d0 con 0x7f45ec0b1710 2024-08-17T02:24:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f2128700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ec0ae8f0 con 0x7f45ec068f80 2024-08-17T02:24:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f2128700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec069890 con 0x7f45ec0b1b90 2024-08-17T02:24:55.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f0925700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f45ec0b1710 0x7f45ec169b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58406/0 (socket says 172.21.15.31:58406) 2024-08-17T02:24:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f0925700 1 -- 172.21.15.31:0/2519463731 learned_addr learned my addr 172.21.15.31:0/2519463731 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f1126700 1 --2- 172.21.15.31:0/2519463731 >> v2:172.21.15.31:3300/0 conn(0x7f45ec068f80 0x7f45ec069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f1927700 1 --2- 172.21.15.31:0/2519463731 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45ec0b1b90 0x7f45ec16a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f1126700 1 -- 172.21.15.31:0/2519463731 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45ec0b1b90 msgr2=0x7f45ec16a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f1126700 1 --2- 172.21.15.31:0/2519463731 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45ec0b1b90 0x7f45ec16a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f1126700 1 -- 172.21.15.31:0/2519463731 >> v1:172.21.15.31:6789/0 conn(0x7f45ec0b1710 legacy=0x7f45ec169b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f1126700 1 -- 172.21.15.31:0/2519463731 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec0ab6e0 con 0x7f45ec068f80 2024-08-17T02:24:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f1927700 1 --2- 172.21.15.31:0/2519463731 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45ec0b1b90 0x7f45ec16a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:55.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8f8c82700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8f41531e0 0x7fc8f41488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8f8c82700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8f41531e0 0x7fc8f41488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:57940/0 (socket says 172.21.15.31:57940) 2024-08-17T02:24:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8f8c82700 1 -- 172.21.15.31:0/1376184211 learned_addr learned my addr 172.21.15.31:0/1376184211 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45e3fff700 1 -- 172.21.15.31:0/2519463731 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79947836 0 0) 0x7f45ec0ac5d0 con 0x7f45ec0b1710 2024-08-17T02:24:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8f9c84700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8f4153650 0x7fc8f4148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45f1126700 1 --2- 172.21.15.31:0/2519463731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45ec068f80 0x7f45ec069350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009e60 tx=0x7f45e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82283c7836c8bf2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7faaebfff700 1 -- 172.21.15.31:0/4217254477 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf40078d0 con 0x7fab040aef80 2024-08-17T02:24:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8f8c82700 1 -- 172.21.15.31:0/1376184211 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8e0004810 msgr2=0x7fc8f4156640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:24:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8f8c82700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8e0004810 0x7fc8f4156640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8f8c82700 1 -- 172.21.15.31:0/1376184211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8f4153650 msgr2=0x7fc8f4148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8f8c82700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8f4153650 0x7fc8f4148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8f8c82700 1 -- 172.21.15.31:0/1376184211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f4155b60 con 0x7fc8f41531e0 2024-08-17T02:24:55.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab04151ef0 con 0x7fab040aef80 2024-08-17T02:24:55.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab041584a0 con 0x7fab040aef80 2024-08-17T02:24:55.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7faaebfff700 1 -- 172.21.15.31:0/4217254477 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf4007a50 con 0x7fab040aef80 2024-08-17T02:24:55.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f45e3fff700 1 -- 172.21.15.31:0/2519463731 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400e070 con 0x7f45ec068f80 2024-08-17T02:24:55.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8f8c82700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8f41531e0 0x7fc8f41488a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000e260 tx=0x7fc8ec015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5ab6ffd700 1 -- 172.21.15.31:0/603650571 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5ad008d020 con 0x7f5ac80e3230 2024-08-17T02:24:55.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5ab6ffd700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5abc060890 0x7f5abc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7f5ab6ffd700 1 -- 172.21.15.31:0/603650571 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ad00f2550 con 0x7f5ac80e3230 2024-08-17T02:24:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8e97fa700 1 -- 172.21.15.31:0/1376184211 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec012610 con 0x7fc8f41531e0 2024-08-17T02:24:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.606+0000 7fc8e97fa700 1 -- 172.21.15.31:0/1376184211 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec012770 con 0x7fc8f41531e0 2024-08-17T02:24:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8e97fa700 1 -- 172.21.15.31:0/1376184211 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec012920 con 0x7fc8f41531e0 2024-08-17T02:24:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f4155e40 con 0x7fc8f41531e0 2024-08-17T02:24:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f416dc50 con 0x7fc8f41531e0 2024-08-17T02:24:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7faaebfff700 1 -- 172.21.15.31:0/4217254477 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4007e10 con 0x7fab040aef80 2024-08-17T02:24:55.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7ff2cbfff700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff2c40609b0 0x7ff2c4062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7ff2dffff700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff2c40609b0 0x7ff2c4062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f5aced9d700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5abc060890 0x7f5abc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f7a88ff9700 1 -- 172.21.15.31:0/2214596239 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7a80011c80 con 0x7f7a8c1586c0 2024-08-17T02:24:55.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f7a88ff9700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a78060860 0x7f7a78062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f7a88ff9700 1 -- 172.21.15.31:0/2214596239 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a8007c3f0 con 0x7f7a8c1586c0 2024-08-17T02:24:55.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f7a90fea700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a78060860 0x7f7a78062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8d4000fd0 con 0x7fc8f41531e0 2024-08-17T02:24:55.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f7a9324e700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] conn(0x7f7a8c15a4a0 0x7f7a8c0a9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7ff2cbfff700 1 -- 172.21.15.31:0/631632110 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2d407d1f0 con 0x7ff2d8050750 2024-08-17T02:24:55.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7ff2cbfff700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] conn(0x7ff2c4068bc0 0x7ff2c406afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7ff2cbfff700 1 -- 172.21.15.31:0/631632110 --> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2c406b680 con 0x7ff2c4068bc0 2024-08-17T02:24:55.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7ff2cbfff700 1 -- 172.21.15.31:0/631632110 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2d407f790 con 0x7ff2d8050750 2024-08-17T02:24:55.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7ff2dffff700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff2c40609b0 0x7ff2c4062e60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc006fd0 tx=0x7ff2cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f7a9324e700 1 -- 172.21.15.31:0/2214596239 --> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a8c0008d0 con 0x7f7a8c15a4a0 2024-08-17T02:24:55.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f5ad493f700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] conn(0x7f5ac80501e0 0x7f5ac8005700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 --> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ac80362a0 con 0x7f5ac80501e0 2024-08-17T02:24:55.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f5acf59e700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] conn(0x7f5ac80501e0 0x7f5ac8005700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7ff2e490f700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] conn(0x7ff2c4068bc0 0x7ff2c406afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faae4000fd0 con 0x7fab040aef80 2024-08-17T02:24:55.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f7a8bfff700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] conn(0x7f7a8c15a4a0 0x7f7a8c0a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f7a90fea700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a78060860 0x7f7a78062d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a84004c10 tx=0x7f7a8400a060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7ff2e490f700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] conn(0x7ff2c4068bc0 0x7ff2c406afd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f7a8bfff700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] conn(0x7f7a8c15a4a0 0x7f7a8c0a9880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f5acf59e700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] conn(0x7f5ac80501e0 0x7f5ac8005700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f5aced9d700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5abc060890 0x7f5abc062d40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009360 tx=0x7f5ac4016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fd147144700 1 Processor -- start 2024-08-17T02:24:55.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f45e3fff700 1 -- 172.21.15.31:0/2519463731 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e400bc30 con 0x7f45ec068f80 2024-08-17T02:24:55.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f45e3fff700 1 -- 172.21.15.31:0/2519463731 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4012430 con 0x7f45ec068f80 2024-08-17T02:24:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8e97fa700 1 -- 172.21.15.31:0/1376184211 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc8ec024020 con 0x7fc8f41531e0 2024-08-17T02:24:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8e97fa700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc8d8060890 0x7fc8d8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8e97fa700 1 -- 172.21.15.31:0/1376184211 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8ec07f220 con 0x7fc8f41531e0 2024-08-17T02:24:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8e97fa700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] conn(0x7fc8d8068aa0 0x7fc8d806aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8f9483700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc8d8060890 0x7fc8d8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8e97fa700 1 -- 172.21.15.31:0/1376184211 --> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8d806b560 con 0x7fc8d8068aa0 2024-08-17T02:24:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fc8e97fa700 1 -- 172.21.15.31:0/1376184211 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8ec07f5f0 con 0x7fc8f41531e0 2024-08-17T02:24:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f7a88ff9700 1 -- 172.21.15.31:0/2214596239 <== osd.1 v2:172.21.15.31:6800/24158 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7a8c0008d0 con 0x7f7a8c15a4a0 2024-08-17T02:24:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7ff2cbfff700 1 -- 172.21.15.31:0/631632110 <== osd.3 v2:172.21.15.31:6817/24159 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff2c406b680 con 0x7ff2c4068bc0 2024-08-17T02:24:55.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7fd147144700 1 -- start start 2024-08-17T02:24:55.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.610+0000 7f5ab6ffd700 1 -- 172.21.15.31:0/603650571 <== osd.0 v2:172.21.15.31:6808/24160 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5ac80362a0 con 0x7f5ac80501e0 2024-08-17T02:24:55.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7fc8f9c84700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] conn(0x7fc8d8068aa0 0x7fc8d806aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7fc8f9483700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc8d8060890 0x7fc8d8062d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006f00 tx=0x7fc8e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7fc8f9c84700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] conn(0x7fc8d8068aa0 0x7fc8d806aeb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7faaebfff700 1 -- 172.21.15.31:0/4217254477 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7faaf4006be0 con 0x7fab040aef80 2024-08-17T02:24:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7faaebfff700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7faaf00608e0 0x7faaf0062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7fab03fff700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7faaf00608e0 0x7faaf0062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7faaebfff700 1 -- 172.21.15.31:0/4217254477 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faaf407e190 con 0x7fab040aef80 2024-08-17T02:24:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7faaebfff700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] conn(0x7faaf0068980 0x7faaf006ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7faaebfff700 1 -- 172.21.15.31:0/4217254477 --> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faaf006b440 con 0x7faaf0068980 2024-08-17T02:24:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7faaebfff700 1 -- 172.21.15.31:0/4217254477 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaf407e560 con 0x7fab040aef80 2024-08-17T02:24:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7fab037fe700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] conn(0x7faaf0068980 0x7faaf006ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7fab03fff700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7faaf00608e0 0x7faaf0062d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faafc001700 tx=0x7faafc001250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7fab037fe700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] conn(0x7faaf0068980 0x7faaf006ad90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7faaebfff700 1 -- 172.21.15.31:0/4217254477 <== osd.2 v2:172.21.15.31:6816/24169 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7faaf006b440 con 0x7faaf0068980 2024-08-17T02:24:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.618+0000 7fc8e97fa700 1 -- 172.21.15.31:0/1376184211 <== osd.4 v2:172.21.15.92:6809/24418 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc8d806b560 con 0x7fc8d8068aa0 2024-08-17T02:24:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7f45f2128700 1 -- 172.21.15.31:0/2519463731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45ec068f80 msgr2=0x7f45ec069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7f45f2128700 1 --2- 172.21.15.31:0/2519463731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45ec068f80 0x7f45ec069350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009e60 tx=0x7f45e4009780 comp rx=0 tx=0).stop 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7f45f2128700 1 -- 172.21.15.31:0/2519463731 shutdown_connections 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7f45f2128700 1 --2- 172.21.15.31:0/2519463731 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45ec0b1b90 0x7f45ec16a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7f45f2128700 1 --2- 172.21.15.31:0/2519463731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45ec068f80 0x7f45ec069350 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009e60 tx=0x7f45e4009780 comp rx=0 tx=0).stop 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.614+0000 7f45f2128700 1 -- 172.21.15.31:0/2519463731 >> 172.21.15.31:0/2519463731 conn(0x7f45ec067400 msgr2=0x7f45ec067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.618+0000 7f45f2128700 1 -- 172.21.15.31:0/2519463731 shutdown_connections 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.618+0000 7f45f2128700 1 -- 172.21.15.31:0/2519463731 wait complete. 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.618+0000 7f45f2128700 1 Processor -- start 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.618+0000 7f45f2128700 1 -- start start 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.618+0000 7f45f2128700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45ec0b1710 0x7f45ec0a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.618+0000 7f45f2128700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45ec0b1b90 0x7f45ec086810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f2128700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45ec17a480 0x7f45ec06e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f2128700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0a5ca0 con 0x7f45ec17a480 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f2128700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0a5f80 con 0x7f45ec0b1710 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f2128700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0a6260 con 0x7f45ec0b1b90 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f1126700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45ec0b1710 0x7f45ec0a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f1126700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45ec0b1710 0x7f45ec0a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:57946/0 (socket says 172.21.15.31:57946) 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f1126700 1 -- 172.21.15.31:0/2000849756 learned_addr learned my addr 172.21.15.31:0/2000849756 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f0925700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45ec0b1b90 0x7f45ec086810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f1927700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45ec17a480 0x7f45ec06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f1126700 1 -- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45ec0b1b90 msgr2=0x7f45ec086810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f1126700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45ec0b1b90 0x7f45ec086810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f1126700 1 -- 172.21.15.31:0/2000849756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45ec17a480 msgr2=0x7f45ec06e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f1126700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45ec17a480 0x7f45ec06e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f1126700 1 -- 172.21.15.31:0/2000849756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e4009a20 con 0x7f45ec0b1710 2024-08-17T02:24:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.622+0000 7f45f1126700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45ec0b1710 0x7f45ec0a5470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45ec069ec0 tx=0x7f45e4019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.626+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 --> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5fcc0c9af0 con 0x7f5fac068c40 2024-08-17T02:24:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.626+0000 7f45e17fa700 1 -- 172.21.15.31:0/2000849756 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4012c40 con 0x7f45ec0b1710 2024-08-17T02:24:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.626+0000 7f45e17fa700 1 -- 172.21.15.31:0/2000849756 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e4012de0 con 0x7f45ec0b1710 2024-08-17T02:24:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.626+0000 7f45e17fa700 1 -- 172.21.15.31:0/2000849756 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4022a80 con 0x7f45ec0b1710 2024-08-17T02:24:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.626+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ec1773c0 con 0x7f45ec0b1710 2024-08-17T02:24:55.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.626+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec0a59b0 con 0x7f45ec0b1710 2024-08-17T02:24:55.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.626+0000 7f5fba7fc700 1 -- 172.21.15.31:0/3908431764 <== osd.5 v2:172.21.15.92:6800/24420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5fcc0c9af0 con 0x7f5fac068c40 2024-08-17T02:24:55.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45ec0712b0 con 0x7f45ec0b1710 2024-08-17T02:24:55.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45e17fa700 1 -- 172.21.15.31:0/2000849756 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f45e4028070 con 0x7f45ec0b1710 2024-08-17T02:24:55.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 >> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] conn(0x7f5fac068c40 msgr2=0x7f5fac06b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fd09e8700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] conn(0x7f5fac068c40 0x7f5fac06b050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5fac060a30 msgr2=0x7f5fac062ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fd09e8700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5fac060a30 0x7f5fac062ee0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc04bad0 tx=0x7f5fc0018000 comp rx=0 tx=0).stop 2024-08-17T02:24:55.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fcc156fd0 msgr2=0x7f5fcc161b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fd09e8700 1 --2- 172.21.15.31:0/3908431764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fcc156fd0 0x7f5fcc161b70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009e90 tx=0x7f5fc400b040 comp rx=0 tx=0).stop 2024-08-17T02:24:55.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fcad9d700 1 -- 172.21.15.31:0/3908431764 reap_dead start 2024-08-17T02:24:55.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 shutdown_connections 2024-08-17T02:24:55.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 >> 172.21.15.31:0/3908431764 conn(0x7f5fcc0cbe50 msgr2=0x7f5fcc154920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45e17fa700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f45d0060930 0x7f45d0062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45e17fa700 1 -- 172.21.15.31:0/2000849756 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45e4083460 con 0x7f45ec0b1710 2024-08-17T02:24:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45f0925700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f45d0060930 0x7f45d0062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45e17fa700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] conn(0x7f45d0068b40 0x7f45d006af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45e17fa700 1 -- 172.21.15.31:0/2000849756 --> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45d006b600 con 0x7f45d0068b40 2024-08-17T02:24:55.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45e17fa700 1 -- 172.21.15.31:0/2000849756 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45e4085aa0 con 0x7f45ec0b1710 2024-08-17T02:24:55.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd147144700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1400ae560 0x7fd1400aef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd147144700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd140156070 con 0x7fd140068f80 2024-08-17T02:24:55.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd147144700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1401569a0 con 0x7fd140156500 2024-08-17T02:24:55.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd147144700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400b1950 con 0x7fd1400ae560 2024-08-17T02:24:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45f1927700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] conn(0x7f45d0068b40 0x7f45d006af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd146943700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd140068f80 0x7fd140069370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58410/0 (socket says 172.21.15.31:58410) 2024-08-17T02:24:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd146943700 1 -- 172.21.15.31:0/664315209 learned_addr learned my addr 172.21.15.31:0/664315209 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd146142700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1400ae560 0x7fd1400aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45f0925700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f45d0060930 0x7f45d0062de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45ec162fa0 tx=0x7f45e8007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 shutdown_connections 2024-08-17T02:24:55.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f5fd09e8700 1 -- 172.21.15.31:0/3908431764 wait complete. 2024-08-17T02:24:55.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd145140700 1 -- 172.21.15.31:0/664315209 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408083129 0 0) 0x7fd140156070 con 0x7fd140068f80 2024-08-17T02:24:55.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7f45f1927700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] conn(0x7f45d0068b40 0x7f45d006af50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 --> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2c0002d30 con 0x7ff2c4068bc0 2024-08-17T02:24:55.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd145140700 1 -- 172.21.15.31:0/664315209 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd12c003570 con 0x7fd140068f80 2024-08-17T02:24:55.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd145140700 1 -- 172.21.15.31:0/664315209 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547345813 0 0) 0x7fd1401569a0 con 0x7fd140156500 2024-08-17T02:24:55.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.630+0000 7fd145140700 1 -- 172.21.15.31:0/664315209 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd140156070 con 0x7fd140156500 2024-08-17T02:24:55.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7fd145140700 1 -- 172.21.15.31:0/664315209 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3598488951 0 0) 0x7fd12c003570 con 0x7fd140068f80 2024-08-17T02:24:55.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7fd146142700 1 -- 172.21.15.31:0/664315209 >> v1:172.21.15.92:6789/0 conn(0x7fd140156500 legacy=0x7fd1400b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7fd146142700 1 -- 172.21.15.31:0/664315209 >> v1:172.21.15.31:6789/0 conn(0x7fd140068f80 legacy=0x7fd140069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7ff2cbfff700 1 -- 172.21.15.31:0/631632110 <== osd.3 v2:172.21.15.31:6817/24159 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff2c0002d30 con 0x7ff2c4068bc0 2024-08-17T02:24:55.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7fd146142700 1 -- 172.21.15.31:0/664315209 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400b1c30 con 0x7fd1400ae560 2024-08-17T02:24:55.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7f45e17fa700 1 -- 172.21.15.31:0/2000849756 <== osd.6 v2:172.21.15.92:6808/24419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f45d006b600 con 0x7f45d0068b40 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7fd146142700 1 --2- 172.21.15.31:0/664315209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1400ae560 0x7fd1400aef80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0098e0 tx=0x7fd13c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4986502cfc1161 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7fd145140700 1 -- 172.21.15.31:0/664315209 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380017f0 con 0x7fd1400ae560 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7fd145140700 1 -- 172.21.15.31:0/664315209 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c011420 con 0x7fd1400ae560 2024-08-17T02:24:55.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7fd147144700 1 -- 172.21.15.31:0/664315209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1400ae560 msgr2=0x7fd1400aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.634+0000 7fd147144700 1 --2- 172.21.15.31:0/664315209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1400ae560 0x7fd1400aef80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0098e0 tx=0x7fd13c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] conn(0x7ff2c4068bc0 msgr2=0x7ff2c406afd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e6372700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] conn(0x7ff2c4068bc0 0x7ff2c406afd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7fd147144700 1 -- 172.21.15.31:0/664315209 shutdown_connections 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7fd147144700 1 --2- 172.21.15.31:0/664315209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1400ae560 0x7fd1400aef80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7fd147144700 1 -- 172.21.15.31:0/664315209 >> 172.21.15.31:0/664315209 conn(0x7fd140067400 msgr2=0x7fd140067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff2c40609b0 msgr2=0x7ff2c4062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e6372700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff2c40609b0 0x7ff2c4062e60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc006fd0 tx=0x7ff2cc008040 comp rx=0 tx=0).stop 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d8050750 msgr2=0x7ff2d804f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e6372700 1 --2- 172.21.15.31:0/631632110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2d8050750 0x7ff2d804f420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400d860 tx=0x7ff2d4008040 comp rx=0 tx=0).stop 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e490f700 1 -- 172.21.15.31:0/631632110 reap_dead start 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 shutdown_connections 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 >> 172.21.15.31:0/631632110 conn(0x7ff2d8038bf0 msgr2=0x7ff2d8006bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 shutdown_connections 2024-08-17T02:24:55.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7ff2e6372700 1 -- 172.21.15.31:0/631632110 wait complete. 2024-08-17T02:24:55.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.638+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 --> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ac8005c40 con 0x7f5ac80501e0 2024-08-17T02:24:55.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.642+0000 7f7a9324e700 1 -- 172.21.15.31:0/2214596239 --> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7a8c06e690 con 0x7f7a8c15a4a0 2024-08-17T02:24:55.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.642+0000 7f5ab6ffd700 1 -- 172.21.15.31:0/603650571 <== osd.0 v2:172.21.15.31:6808/24160 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ac8005c40 con 0x7f5ac80501e0 2024-08-17T02:24:55.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.642+0000 7f7a88ff9700 1 -- 172.21.15.31:0/2214596239 <== osd.1 v2:172.21.15.31:6800/24158 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7a8c06e690 con 0x7f7a8c15a4a0 2024-08-17T02:24:55.708 INFO:teuthology.orchestra.run.smithi031.stdout:60129542151 2024-08-17T02:24:55.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:24:55.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] conn(0x7f5ac80501e0 msgr2=0x7f5ac8005700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5ad493f700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] conn(0x7f5ac80501e0 0x7f5ac8005700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5abc060890 msgr2=0x7f5abc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5ad493f700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5abc060890 0x7f5abc062d40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009360 tx=0x7f5ac4016000 comp rx=0 tx=0).stop 2024-08-17T02:24:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ac80e3230 msgr2=0x7f5ac804d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5ad493f700 1 --2- 172.21.15.31:0/603650571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ac80e3230 0x7f5ac804d600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ad002b300 tx=0x7f5ad0064ee0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a727fc700 1 -- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] conn(0x7f7a8c15a4a0 msgr2=0x7f7a8c0a9880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a727fc700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] conn(0x7f7a8c15a4a0 0x7f7a8c0a9880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5acf59e700 1 -- 172.21.15.31:0/603650571 reap_dead start 2024-08-17T02:24:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a727fc700 1 -- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a78060860 msgr2=0x7f7a78062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a727fc700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a78060860 0x7f7a78062d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a84004c10 tx=0x7f7a8400a060 comp rx=0 tx=0).stop 2024-08-17T02:24:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a727fc700 1 -- 172.21.15.31:0/2214596239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a8c1586c0 msgr2=0x7f7a8c158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a727fc700 1 --2- 172.21.15.31:0/2214596239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a8c1586c0 0x7f7a8c158b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0b1a80 tx=0x7f7a80008040 comp rx=0 tx=0).stop 2024-08-17T02:24:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 shutdown_connections 2024-08-17T02:24:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 >> 172.21.15.31:0/603650571 conn(0x7f5ac8051690 msgr2=0x7f5ac804acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a917eb700 1 -- 172.21.15.31:0/2214596239 reap_dead start 2024-08-17T02:24:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a727fc700 1 -- 172.21.15.31:0/2214596239 shutdown_connections 2024-08-17T02:24:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a727fc700 1 -- 172.21.15.31:0/2214596239 >> 172.21.15.31:0/2214596239 conn(0x7f7a8c0cbe50 msgr2=0x7f7a8c15aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 shutdown_connections 2024-08-17T02:24:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f5ad493f700 1 -- 172.21.15.31:0/603650571 wait complete. 2024-08-17T02:24:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a727fc700 1 -- 172.21.15.31:0/2214596239 shutdown_connections 2024-08-17T02:24:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7f7a727fc700 1 -- 172.21.15.31:0/2214596239 wait complete. 2024-08-17T02:24:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 --> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faae4002d30 con 0x7faaf0068980 2024-08-17T02:24:55.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 --> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8d4002c90 con 0x7fc8d8068aa0 2024-08-17T02:24:55.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7faaebfff700 1 -- 172.21.15.31:0/4217254477 <== osd.2 v2:172.21.15.31:6816/24169 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faae4002d30 con 0x7faaf0068980 2024-08-17T02:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7fc8e97fa700 1 -- 172.21.15.31:0/1376184211 <== osd.4 v2:172.21.15.92:6809/24418 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc8d4002c90 con 0x7fc8d8068aa0 2024-08-17T02:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] conn(0x7faaf0068980 msgr2=0x7faaf006ad90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7fab097b9700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] conn(0x7faaf0068980 0x7faaf006ad90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7faaf00608e0 msgr2=0x7faaf0062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7fab097b9700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7faaf00608e0 0x7faaf0062d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faafc001700 tx=0x7faafc001250 comp rx=0 tx=0).stop 2024-08-17T02:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040aef80 msgr2=0x7fab040cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7fab097b9700 1 --2- 172.21.15.31:0/4217254477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040aef80 0x7fab040cb670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c330 tx=0x7faaf4017000 comp rx=0 tx=0).stop 2024-08-17T02:24:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.646+0000 7fd147144700 1 -- 172.21.15.31:0/664315209 shutdown_connections 2024-08-17T02:24:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 -- 172.21.15.31:0/664315209 wait complete. 2024-08-17T02:24:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fab08fb8700 1 -- 172.21.15.31:0/4217254477 reap_dead start 2024-08-17T02:24:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 shutdown_connections 2024-08-17T02:24:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 >> 172.21.15.31:0/4217254477 conn(0x7fab04067400 msgr2=0x7fab0406d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 Processor -- start 2024-08-17T02:24:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 -- start start 2024-08-17T02:24:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd140068f80 0x7fd14013fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1400ae560 0x7fd14014a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd140156500 0x7fd14014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd140149230 con 0x7fd1400ae560 2024-08-17T02:24:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd140149510 con 0x7fd140156500 2024-08-17T02:24:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1401497f0 con 0x7fd140068f80 2024-08-17T02:24:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd145941700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1400ae560 0x7fd14014a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd145941700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1400ae560 0x7fd14014a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48748/0 (socket says 172.21.15.31:48748) 2024-08-17T02:24:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd145941700 1 -- 172.21.15.31:0/1626674253 learned_addr learned my addr 172.21.15.31:0/1626674253 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd146142700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd140068f80 0x7fd14013fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd146943700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd140156500 0x7fd14014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd145941700 1 -- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd140068f80 msgr2=0x7fd14013fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd145941700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd140068f80 0x7fd14013fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd145941700 1 -- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd140156500 msgr2=0x7fd14014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd145941700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd140156500 0x7fd14014ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd145941700 1 -- 172.21.15.31:0/1626674253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c009420 con 0x7fd1400ae560 2024-08-17T02:24:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd145941700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1400ae560 0x7fd14014a5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd13000c5b0 tx=0x7fd130007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd1367fc700 1 -- 172.21.15.31:0/1626674253 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130011590 con 0x7fd1400ae560 2024-08-17T02:24:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd1367fc700 1 -- 172.21.15.31:0/1626674253 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd130011710 con 0x7fd1400ae560 2024-08-17T02:24:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd140149ad0 con 0x7fd1400ae560 2024-08-17T02:24:55.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd1367fc700 1 -- 172.21.15.31:0/1626674253 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130011ad0 con 0x7fd1400ae560 2024-08-17T02:24:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.650+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd140140100 con 0x7fd1400ae560 2024-08-17T02:24:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 shutdown_connections 2024-08-17T02:24:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fab097b9700 1 -- 172.21.15.31:0/4217254477 wait complete. 2024-08-17T02:24:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 >> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] conn(0x7fc8d8068aa0 msgr2=0x7fc8d806aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8fa485700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] conn(0x7fc8d8068aa0 0x7fc8d806aeb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1400712b0 con 0x7fd1400ae560 2024-08-17T02:24:55.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc8d8060890 msgr2=0x7fc8d8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8fa485700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc8d8060890 0x7fc8d8062d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006f00 tx=0x7fc8e4008040 comp rx=0 tx=0).stop 2024-08-17T02:24:55.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8f41531e0 msgr2=0x7fc8f41488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8fa485700 1 --2- 172.21.15.31:0/1376184211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8f41531e0 0x7fc8f41488a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000e260 tx=0x7fc8ec015000 comp rx=0 tx=0).stop 2024-08-17T02:24:55.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8f9c84700 1 -- 172.21.15.31:0/1376184211 reap_dead start 2024-08-17T02:24:55.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 shutdown_connections 2024-08-17T02:24:55.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 >> 172.21.15.31:0/1376184211 conn(0x7fc8f4067400 msgr2=0x7fc8f40b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 shutdown_connections 2024-08-17T02:24:55.724 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-08-17T02:24:55.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fc8fa485700 1 -- 172.21.15.31:0/1376184211 wait complete. 2024-08-17T02:24:55.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:24:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fd1367fc700 1 -- 172.21.15.31:0/1626674253 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd13001b3b0 con 0x7fd1400ae560 2024-08-17T02:24:55.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 --> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f45ec068060 con 0x7f45d0068b40 2024-08-17T02:24:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fd1367fc700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd124060860 0x7fd124062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fd1367fc700 1 -- 172.21.15.31:0/1626674253 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd13007bf40 con 0x7fd1400ae560 2024-08-17T02:24:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fd1367fc700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] conn(0x7fd124068a70 0x7fd12406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fd1367fc700 1 -- 172.21.15.31:0/1626674253 --> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd12406b530 con 0x7fd124068a70 2024-08-17T02:24:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fd1367fc700 1 -- 172.21.15.31:0/1626674253 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd13007e520 con 0x7fd1400ae560 2024-08-17T02:24:55.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fd146142700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd124060860 0x7fd124062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.654+0000 7fd146943700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] conn(0x7fd124068a70 0x7fd12406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7f45e17fa700 1 -- 172.21.15.31:0/2000849756 <== osd.6 v2:172.21.15.92:6808/24419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f45ec068060 con 0x7f45d0068b40 2024-08-17T02:24:55.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7fd146142700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd124060860 0x7fd124062d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0093f0 tx=0x7fd13c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7fd146943700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] conn(0x7fd124068a70 0x7fd12406ae80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7fd1367fc700 1 -- 172.21.15.31:0/1626674253 <== osd.7 v2:172.21.15.92:6824/24431 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd12406b530 con 0x7fd124068a70 2024-08-17T02:24:55.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] conn(0x7f45d0068b40 msgr2=0x7f45d006af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7f45f2128700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] conn(0x7f45d0068b40 0x7f45d006af50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.729 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-08-17T02:24:55.729 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:24:55.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f45d0060930 msgr2=0x7f45d0062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7f45f2128700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f45d0060930 0x7f45d0062de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45ec162fa0 tx=0x7f45e8007d30 comp rx=0 tx=0).stop 2024-08-17T02:24:55.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45ec0b1710 msgr2=0x7f45ec0a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7f45f2128700 1 --2- 172.21.15.31:0/2000849756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45ec0b1710 0x7f45ec0a5470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45ec069ec0 tx=0x7f45e4019000 comp rx=0 tx=0).stop 2024-08-17T02:24:55.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.658+0000 7f45f1927700 1 -- 172.21.15.31:0/2000849756 reap_dead start 2024-08-17T02:24:55.730 INFO:teuthology.orchestra.run.smithi031.stdout:64424509449 2024-08-17T02:24:55.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:24:55.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.662+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 shutdown_connections 2024-08-17T02:24:55.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.662+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 >> 172.21.15.31:0/2000849756 conn(0x7f45ec067400 msgr2=0x7f45ec165150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.662+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 shutdown_connections 2024-08-17T02:24:55.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.662+0000 7f45f2128700 1 -- 172.21.15.31:0/2000849756 wait complete. 2024-08-17T02:24:55.732 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-08-17T02:24:55.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:24:55.733 INFO:teuthology.orchestra.run.smithi031.stdout:64424509449 2024-08-17T02:24:55.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:24:55.734 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-08-17T02:24:55.734 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:24:55.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 --> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd14006a3f0 con 0x7fd124068a70 2024-08-17T02:24:55.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd1367fc700 1 -- 172.21.15.31:0/1626674253 <== osd.7 v2:172.21.15.92:6824/24431 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd14006a3f0 con 0x7fd124068a70 2024-08-17T02:24:55.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] conn(0x7fd124068a70 msgr2=0x7fd12406ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] conn(0x7fd124068a70 0x7fd12406ae80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd124060860 msgr2=0x7fd124062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd124060860 0x7fd124062d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0093f0 tx=0x7fd13c016000 comp rx=0 tx=0).stop 2024-08-17T02:24:55.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1400ae560 msgr2=0x7fd14014a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 --2- 172.21.15.31:0/1626674253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1400ae560 0x7fd14014a5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd13000c5b0 tx=0x7fd130007f60 comp rx=0 tx=0).stop 2024-08-17T02:24:55.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd146943700 1 -- 172.21.15.31:0/1626674253 reap_dead start 2024-08-17T02:24:55.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 shutdown_connections 2024-08-17T02:24:55.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 >> 172.21.15.31:0/1626674253 conn(0x7fd140067400 msgr2=0x7fd1400aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 shutdown_connections 2024-08-17T02:24:55.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.678+0000 7fd147144700 1 -- 172.21.15.31:0/1626674253 wait complete. 2024-08-17T02:24:55.738 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-08-17T02:24:55.738 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:24:55.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f0601ae5700 1 Processor -- start 2024-08-17T02:24:55.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f0601ae5700 1 -- start start 2024-08-17T02:24:55.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48be59700 1 Processor -- start 2024-08-17T02:24:55.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f7a97fff700 1 Processor -- start 2024-08-17T02:24:55.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48be59700 1 -- start start 2024-08-17T02:24:55.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fc241021700 1 Processor -- start 2024-08-17T02:24:55.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fc241021700 1 -- start start 2024-08-17T02:24:55.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f7a97fff700 1 -- start start 2024-08-17T02:24:55.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fbf5dd56700 1 Processor -- start 2024-08-17T02:24:55.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f499e12b700 1 Processor -- start 2024-08-17T02:24:55.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48be59700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff48415d530 0x7ff48406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f499e12b700 1 -- start start 2024-08-17T02:24:55.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48be59700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff48406a6e0 0x7ff4840af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48be59700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48406ab40 con 0x7ff4840ade80 2024-08-17T02:24:55.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48be59700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4840ad9f0 con 0x7ff48406a6e0 2024-08-17T02:24:55.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48be59700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4840afc60 con 0x7ff48415d530 2024-08-17T02:24:55.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f0601ae5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05fc0b0480 0x7f05fc069580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f0601ae5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05fc15ab70 con 0x7f05fc0691b0 2024-08-17T02:24:55.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f0601ae5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05fc0ac8d0 con 0x7f05fc0ad930 2024-08-17T02:24:55.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f0601ae5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc0b0910 con 0x7f05fc0b0480 2024-08-17T02:24:55.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fbf5dd56700 1 -- start start 2024-08-17T02:24:55.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f014d583700 1 Processor -- start 2024-08-17T02:24:55.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff4893f4700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff4840ade80 0x7ff4840af010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:49010/0 (socket says 172.21.15.31:49010) 2024-08-17T02:24:55.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff4893f4700 1 -- 172.21.15.31:0/1789048677 learned_addr learned my addr 172.21.15.31:0/1789048677 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fc241021700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc23c0b12b0 0x7fc23c0c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fc241021700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c0cb1b0 con 0x7fc23c156fd0 2024-08-17T02:24:55.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fc241021700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c0ca5a0 con 0x7fc23c0ca070 2024-08-17T02:24:55.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fc241021700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c0ca880 con 0x7fc23c0b12b0 2024-08-17T02:24:55.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f7a97fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7a98069690 0x7f7a98168720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f7a97fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a980b1b20 con 0x7f7a98140740 2024-08-17T02:24:55.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f7a97fff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a980b0c70 con 0x7f7a98140370 2024-08-17T02:24:55.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f7a97fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a980b0f10 con 0x7f7a98069690 2024-08-17T02:24:55.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f014d583700 1 -- start start 2024-08-17T02:24:55.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f06012e4700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f05fc0ad930 0x7f05fc13f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:49012/0 (socket says 172.21.15.31:49012) 2024-08-17T02:24:55.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f06012e4700 1 -- 172.21.15.31:0/573170233 learned_addr learned my addr 172.21.15.31:0/573170233 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f05fbfff700 1 --2- 172.21.15.31:0/573170233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05fc0b0480 0x7f05fc069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff489bf5700 1 --2- 172.21.15.31:0/1789048677 >> v2:172.21.15.92:3300/0 conn(0x7ff48415d530 0x7ff48406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48a3f6700 1 --2- 172.21.15.31:0/1789048677 >> v2:172.21.15.31:3300/0 conn(0x7ff48406a6e0 0x7ff4840af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f7a977fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7a98069690 0x7f7a98168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f7a977fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7a98069690 0x7f7a98168720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48772/0 (socket says 172.21.15.31:48772) 2024-08-17T02:24:55.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f7a977fe700 1 -- 172.21.15.31:0/4101984984 learned_addr learned my addr 172.21.15.31:0/4101984984 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fc23b59e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc23c0ca070 0x7fc23c06a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:49026/0 (socket says 172.21.15.31:49026) 2024-08-17T02:24:55.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fc23b59e700 1 -- 172.21.15.31:0/3885925686 learned_addr learned my addr 172.21.15.31:0/3885925686 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f05fbfff700 1 -- 172.21.15.31:0/573170233 >> v1:172.21.15.92:6789/0 conn(0x7f05fc0ad930 legacy=0x7f05fc13f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fbf5dd56700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbf5806a5f0 0x7fbf580af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fbf5dd56700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf58157c90 con 0x7fbf5806a1a0 2024-08-17T02:24:55.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fbf5dd56700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf58156dd0 con 0x7fbf580b1b60 2024-08-17T02:24:55.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fbf5dd56700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf58155bb0 con 0x7fbf5806a5f0 2024-08-17T02:24:55.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f499e12b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4998154b90 0x7f49980b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f499e12b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4998154f60 0x7f49980b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f499e12b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49981583e0 con 0x7f49980c96e0 2024-08-17T02:24:55.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f499e12b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499815bd70 con 0x7f4998154b90 2024-08-17T02:24:55.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f499e12b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49980b0d70 con 0x7f4998154f60 2024-08-17T02:24:55.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f499c928700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4998154f60 0x7f49980b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f499c928700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4998154f60 0x7f49980b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:57966/0 (socket says 172.21.15.31:57966) 2024-08-17T02:24:55.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f499c928700 1 -- 172.21.15.31:0/237068771 learned_addr learned my addr 172.21.15.31:0/237068771 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48a3f6700 1 -- 172.21.15.31:0/1789048677 >> v2:172.21.15.92:3300/0 conn(0x7ff48415d530 msgr2=0x7ff48406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48a3f6700 1 --2- 172.21.15.31:0/1789048677 >> v2:172.21.15.92:3300/0 conn(0x7ff48415d530 0x7ff48406a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48a3f6700 1 -- 172.21.15.31:0/1789048677 >> v1:172.21.15.92:6789/0 conn(0x7ff4840ade80 legacy=0x7ff4840af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f05fbfff700 1 -- 172.21.15.31:0/573170233 >> v1:172.21.15.31:6789/0 conn(0x7f05fc0691b0 legacy=0x7f05fc0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f05fbfff700 1 -- 172.21.15.31:0/573170233 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc0acb70 con 0x7f05fc0b0480 2024-08-17T02:24:55.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fbf56ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbf5806a1a0 0x7fbf581566c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58444/0 (socket says 172.21.15.31:58444) 2024-08-17T02:24:55.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7fbf56ffd700 1 -- 172.21.15.31:0/529765919 learned_addr learned my addr 172.21.15.31:0/529765919 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7ff48a3f6700 1 -- 172.21.15.31:0/1789048677 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4840acde0 con 0x7ff48406a6e0 2024-08-17T02:24:55.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f014d583700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 0x7f014806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f014d583700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f014806a6e0 0x7f01480af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f014d583700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01480ad9f0 con 0x7f01480ade80 2024-08-17T02:24:55.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f014d583700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01480afc60 con 0x7f014806a6e0 2024-08-17T02:24:55.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.910+0000 7f014d583700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014806ab20 con 0x7f014815d530 2024-08-17T02:24:55.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f05fbfff700 1 --2- 172.21.15.31:0/573170233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05fc0b0480 0x7f05fc069580 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009910 tx=0x7f05f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e82b5aa94c019ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0146ffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 0x7f014806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0146ffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 0x7f014806a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:41246/0 (socket says 172.21.15.31:41246) 2024-08-17T02:24:55.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0146ffd700 1 -- 172.21.15.31:0/4135061203 learned_addr learned my addr 172.21.15.31:0/4135061203 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc23a59c700 1 --2- 172.21.15.31:0/3885925686 >> v2:172.21.15.92:3300/0 conn(0x7fc23c0b12b0 0x7fc23c0c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f7a977fe700 1 -- 172.21.15.31:0/4101984984 >> v1:172.21.15.92:6789/0 conn(0x7f7a98140370 legacy=0x7f7a980af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f7a977fe700 1 -- 172.21.15.31:0/4101984984 >> v1:172.21.15.31:6789/0 conn(0x7f7a98140740 legacy=0x7f7a98068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f7a977fe700 1 -- 172.21.15.31:0/4101984984 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a980b11f0 con 0x7f7a98069690 2024-08-17T02:24:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff48a3f6700 1 --2- 172.21.15.31:0/1789048677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff48406a6e0 0x7ff4840af720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff484068800 tx=0x7ff47c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deef93cf89e79f4b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636551706 0 0) 0x7fbf58157c90 con 0x7fbf5806a1a0 2024-08-17T02:24:55.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf40003570 con 0x7fbf5806a1a0 2024-08-17T02:24:55.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f499c928700 1 -- 172.21.15.31:0/237068771 >> v2:172.21.15.31:3300/0 conn(0x7f4998154b90 msgr2=0x7f49980b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f499c928700 1 --2- 172.21.15.31:0/237068771 >> v2:172.21.15.31:3300/0 conn(0x7f4998154b90 0x7f49980b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f499c928700 1 -- 172.21.15.31:0/237068771 >> v1:172.21.15.31:6789/0 conn(0x7f49980c96e0 legacy=0x7f49980caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f499c928700 1 -- 172.21.15.31:0/237068771 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998157ab0 con 0x7f4998154f60 2024-08-17T02:24:55.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf57fff700 1 --2- 172.21.15.31:0/529765919 >> v2:172.21.15.92:3300/0 conn(0x7fbf5806a5f0 0x7fbf580af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc239d9b700 1 -- 172.21.15.31:0/3885925686 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612727854 0 0) 0x7fc23c0ca5a0 con 0x7fc23c0ca070 2024-08-17T02:24:55.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc239d9b700 1 -- 172.21.15.31:0/3885925686 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc224003570 con 0x7fc23c0ca070 2024-08-17T02:24:55.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f05fb7fe700 1 -- 172.21.15.31:0/573170233 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f000b820 con 0x7f05fc0b0480 2024-08-17T02:24:55.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f01477fe700 1 --2- 172.21.15.31:0/4135061203 >> v2:172.21.15.92:3300/0 conn(0x7f014806a6e0 0x7f01480af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1950590765 0 0) 0x7fbf40003570 con 0x7fbf5806a1a0 2024-08-17T02:24:55.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 >> v2:172.21.15.92:3300/0 conn(0x7fbf5806a5f0 msgr2=0x7fbf580af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 --2- 172.21.15.31:0/529765919 >> v2:172.21.15.92:3300/0 conn(0x7fbf5806a5f0 0x7fbf580af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 >> v1:172.21.15.92:6789/0 conn(0x7fbf580b1b60 legacy=0x7fbf581554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff488bf3700 1 -- 172.21.15.31:0/1789048677 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00e070 con 0x7ff48406a6e0 2024-08-17T02:24:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58157080 con 0x7fbf5806a1a0 2024-08-17T02:24:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7fbf4c001470 con 0x7fbf5806a1a0 2024-08-17T02:24:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 >> v1:172.21.15.31:6789/0 conn(0x7fbf5806a1a0 legacy=0x7fbf581566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff488bf3700 1 -- 172.21.15.31:0/1789048677 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00ba60 con 0x7ff48406a6e0 2024-08-17T02:24:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff488bf3700 1 -- 172.21.15.31:0/1789048677 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00be00 con 0x7ff48406a6e0 2024-08-17T02:24:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0146ffd700 1 -- 172.21.15.31:0/4135061203 >> v2:172.21.15.92:3300/0 conn(0x7f014806a6e0 msgr2=0x7f01480af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0146ffd700 1 --2- 172.21.15.31:0/4135061203 >> v2:172.21.15.92:3300/0 conn(0x7f014806a6e0 0x7f01480af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0146ffd700 1 -- 172.21.15.31:0/4135061203 >> v1:172.21.15.31:6789/0 conn(0x7f01480ade80 legacy=0x7f01480af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0146ffd700 1 -- 172.21.15.31:0/4135061203 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480acde0 con 0x7f014815d530 2024-08-17T02:24:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc23a59c700 1 -- 172.21.15.31:0/3885925686 >> v1:172.21.15.92:6789/0 conn(0x7fc23c0ca070 legacy=0x7fc23c06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc23a59c700 1 -- 172.21.15.31:0/3885925686 >> v1:172.21.15.31:6789/0 conn(0x7fc23c156fd0 legacy=0x7fc23c0cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc23a59c700 1 -- 172.21.15.31:0/3885925686 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c0cab60 con 0x7fc23c0b12b0 2024-08-17T02:24:55.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f499c928700 1 --2- 172.21.15.31:0/237068771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998154f60 0x7f49980b14b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4998155330 tx=0x7f4994009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c9aaf066c53998 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f05fb7fe700 1 -- 172.21.15.31:0/573170233 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f000b980 con 0x7f05fc0b0480 2024-08-17T02:24:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f05fb7fe700 1 -- 172.21.15.31:0/573170233 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f000bd20 con 0x7f05fc0b0480 2024-08-17T02:24:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0146ffd700 1 --2- 172.21.15.31:0/4135061203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 0x7f014806a1a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f01380099b0 tx=0x7f0138009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b86006d46f4e882 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f498ffff700 1 -- 172.21.15.31:0/237068771 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499400b860 con 0x7f4998154f60 2024-08-17T02:24:55.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff48be59700 1 -- 172.21.15.31:0/1789048677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff48406a6e0 msgr2=0x7ff4840af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff48be59700 1 --2- 172.21.15.31:0/1789048677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff48406a6e0 0x7ff4840af720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff484068800 tx=0x7ff47c009780 comp rx=0 tx=0).stop 2024-08-17T02:24:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf40003a60 0x7fbf40003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf40004810 0x7fbf40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40005210 0x7fbf4000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4000c0d0 con 0x7fbf40003a60 2024-08-17T02:24:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4000c240 con 0x7fbf40005210 2024-08-17T02:24:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4000c400 con 0x7fbf40004810 2024-08-17T02:24:55.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf57fff700 1 --2- 172.21.15.31:0/529765919 >> v2:172.21.15.92:3300/0 conn(0x7fbf5806a5f0 0x7fbf580af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:55.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f498ffff700 1 -- 172.21.15.31:0/237068771 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499400b9c0 con 0x7f4998154f60 2024-08-17T02:24:55.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f498ffff700 1 -- 172.21.15.31:0/237068771 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499400bd60 con 0x7f4998154f60 2024-08-17T02:24:55.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf577fe700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf40003a60 0x7fbf40003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf56ffd700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf40004810 0x7fbf40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf57fff700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40005210 0x7fbf4000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf577fe700 1 -- 172.21.15.31:0/529765919 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf40004810 msgr2=0x7fbf40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf577fe700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf40004810 0x7fbf40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf577fe700 1 -- 172.21.15.31:0/529765919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40005210 msgr2=0x7fbf4000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf577fe700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40005210 0x7fbf4000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf577fe700 1 -- 172.21.15.31:0/529765919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58157080 con 0x7fbf40003a60 2024-08-17T02:24:55.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf57fff700 1 -- 172.21.15.31:0/529765919 reap_dead start 2024-08-17T02:24:55.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf577fe700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf40003a60 0x7fbf40003e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf48012f40 tx=0x7fbf48007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f384c54955653b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0145ffb700 1 -- 172.21.15.31:0/4135061203 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800b860 con 0x7f014815d530 2024-08-17T02:24:55.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f7a977fe700 1 --2- 172.21.15.31:0/4101984984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a98069690 0x7f7a98168720 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0099b0 tx=0x7f7a8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63317f4600714a3a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0145ffb700 1 -- 172.21.15.31:0/4135061203 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013800b9c0 con 0x7f014815d530 2024-08-17T02:24:55.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0145ffb700 1 -- 172.21.15.31:0/4135061203 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800bd60 con 0x7f014815d530 2024-08-17T02:24:55.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc23a59c700 1 --2- 172.21.15.31:0/3885925686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc23c0b12b0 0x7fc23c0c9b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc234009e60 tx=0x7fc234009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff38377d8aa95c5a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc239d9b700 1 -- 172.21.15.31:0/3885925686 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23400e070 con 0x7fc23c0b12b0 2024-08-17T02:24:55.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc239d9b700 1 -- 172.21.15.31:0/3885925686 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23400bb60 con 0x7fc23c0b12b0 2024-08-17T02:24:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc239d9b700 1 -- 172.21.15.31:0/3885925686 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234012430 con 0x7fc23c0b12b0 2024-08-17T02:24:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff48be59700 1 -- 172.21.15.31:0/1789048677 shutdown_connections 2024-08-17T02:24:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff48be59700 1 --2- 172.21.15.31:0/1789048677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff48406a6e0 0x7ff4840af720 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff48be59700 1 --2- 172.21.15.31:0/1789048677 >> v2:172.21.15.92:3300/0 conn(0x7ff48415d530 0x7ff48406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff48be59700 1 -- 172.21.15.31:0/1789048677 >> 172.21.15.31:0/1789048677 conn(0x7ff4840cbe50 msgr2=0x7ff4840cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0601ae5700 1 -- 172.21.15.31:0/573170233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05fc0b0480 msgr2=0x7f05fc069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0601ae5700 1 --2- 172.21.15.31:0/573170233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05fc0b0480 0x7f05fc069580 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009910 tx=0x7f05f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f7a95ffb700 1 -- 172.21.15.31:0/4101984984 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c00b7e0 con 0x7f7a98069690 2024-08-17T02:24:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f7a95ffb700 1 -- 172.21.15.31:0/4101984984 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8c00b940 con 0x7f7a98069690 2024-08-17T02:24:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f7a95ffb700 1 -- 172.21.15.31:0/4101984984 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c00bce0 con 0x7f7a98069690 2024-08-17T02:24:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0601ae5700 1 -- 172.21.15.31:0/573170233 shutdown_connections 2024-08-17T02:24:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0601ae5700 1 --2- 172.21.15.31:0/573170233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05fc0b0480 0x7f05fc069580 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009910 tx=0x7f05f00091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0601ae5700 1 -- 172.21.15.31:0/573170233 >> 172.21.15.31:0/573170233 conn(0x7f05fc067400 msgr2=0x7f05fc0677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff48be59700 1 -- 172.21.15.31:0/1789048677 shutdown_connections 2024-08-17T02:24:55.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0601ae5700 1 -- 172.21.15.31:0/573170233 shutdown_connections 2024-08-17T02:24:55.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7ff48be59700 1 -- 172.21.15.31:0/1789048677 wait complete. 2024-08-17T02:24:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48001960 con 0x7fbf40003a60 2024-08-17T02:24:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf48001ae0 con 0x7fbf40003a60 2024-08-17T02:24:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fbf567fc700 1 -- 172.21.15.31:0/529765919 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48001ea0 con 0x7fbf40003a60 2024-08-17T02:24:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc241021700 1 -- 172.21.15.31:0/3885925686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc23c0b12b0 msgr2=0x7fc23c0c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7fc241021700 1 --2- 172.21.15.31:0/3885925686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc23c0b12b0 0x7fc23c0c9b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc234009e60 tx=0x7fc234009780 comp rx=0 tx=0).stop 2024-08-17T02:24:55.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f92012b6700 1 Processor -- start 2024-08-17T02:24:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f014d583700 1 -- 172.21.15.31:0/4135061203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 msgr2=0x7f014806a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f014d583700 1 --2- 172.21.15.31:0/4135061203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 0x7f014806a1a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f01380099b0 tx=0x7f0138009250 comp rx=0 tx=0).stop 2024-08-17T02:24:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f014d583700 1 -- 172.21.15.31:0/4135061203 shutdown_connections 2024-08-17T02:24:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f014d583700 1 --2- 172.21.15.31:0/4135061203 >> v2:172.21.15.92:3300/0 conn(0x7f014806a6e0 0x7f01480af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f014d583700 1 --2- 172.21.15.31:0/4135061203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 0x7f014806a1a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f014d583700 1 -- 172.21.15.31:0/4135061203 >> 172.21.15.31:0/4135061203 conn(0x7f01480cbe50 msgr2=0x7f01480cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f014d583700 1 -- 172.21.15.31:0/4135061203 shutdown_connections 2024-08-17T02:24:55.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f014d583700 1 -- 172.21.15.31:0/4135061203 wait complete. 2024-08-17T02:24:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f92012b6700 1 -- start start 2024-08-17T02:24:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f499e12b700 1 -- 172.21.15.31:0/237068771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998154f60 msgr2=0x7f49980b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f499e12b700 1 --2- 172.21.15.31:0/237068771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998154f60 0x7f49980b14b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4998155330 tx=0x7f4994009250 comp rx=0 tx=0).stop 2024-08-17T02:24:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fbf5dd56700 1 -- 172.21.15.31:0/529765919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf40003a60 msgr2=0x7fbf40003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fbf5dd56700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf40003a60 0x7fbf40003e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf48012f40 tx=0x7fbf48007da0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f7a97fff700 1 -- 172.21.15.31:0/4101984984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a98069690 msgr2=0x7f7a98168720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f7a97fff700 1 --2- 172.21.15.31:0/4101984984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a98069690 0x7f7a98168720 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0099b0 tx=0x7f7a8c009250 comp rx=0 tx=0).stop 2024-08-17T02:24:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f7a97fff700 1 -- 172.21.15.31:0/4101984984 shutdown_connections 2024-08-17T02:24:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f7a97fff700 1 --2- 172.21.15.31:0/4101984984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a98069690 0x7f7a98168720 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f7a97fff700 1 -- 172.21.15.31:0/4101984984 >> 172.21.15.31:0/4101984984 conn(0x7f7a98067400 msgr2=0x7f7a980677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f499e12b700 1 -- 172.21.15.31:0/237068771 shutdown_connections 2024-08-17T02:24:55.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fbf5dd56700 1 -- 172.21.15.31:0/529765919 shutdown_connections 2024-08-17T02:24:55.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fbf5dd56700 1 --2- 172.21.15.31:0/529765919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf40003a60 0x7fbf40003e50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fbf5dd56700 1 -- 172.21.15.31:0/529765919 >> 172.21.15.31:0/529765919 conn(0x7fbf580cbe50 msgr2=0x7fbf580cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f499e12b700 1 --2- 172.21.15.31:0/237068771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998154f60 0x7f49980b14b0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4998155330 tx=0x7f4994009250 comp rx=0 tx=0).stop 2024-08-17T02:24:55.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f499e12b700 1 --2- 172.21.15.31:0/237068771 >> v2:172.21.15.31:3300/0 conn(0x7f4998154b90 0x7f49980b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f499e12b700 1 -- 172.21.15.31:0/237068771 >> 172.21.15.31:0/237068771 conn(0x7f4998067400 msgr2=0x7f49980677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff48be59700 1 Processor -- start 2024-08-17T02:24:55.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.914+0000 7f0601ae5700 1 -- 172.21.15.31:0/573170233 wait complete. 2024-08-17T02:24:55.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff48be59700 1 -- start start 2024-08-17T02:24:55.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f499e12b700 1 -- 172.21.15.31:0/237068771 shutdown_connections 2024-08-17T02:24:55.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f92012b6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc1503d0 0x7f91fc068f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f92012b6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f91fc1507a0 0x7f91fc0694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f92012b6700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc0add30 con 0x7f91fc0aca40 2024-08-17T02:24:55.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f92012b6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc0af070 con 0x7f91fc1507a0 2024-08-17T02:24:55.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f92012b6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0ad770 con 0x7f91fc1503d0 2024-08-17T02:24:55.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f014d583700 1 Processor -- start 2024-08-17T02:24:55.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f014d583700 1 -- start start 2024-08-17T02:24:55.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f499e12b700 1 -- 172.21.15.31:0/237068771 wait complete. 2024-08-17T02:24:55.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f9200ab5700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f91fc0aca40 0x7f91fc0acec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58468/0 (socket says 172.21.15.31:58468) 2024-08-17T02:24:55.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f9200ab5700 1 -- 172.21.15.31:0/2276422142 learned_addr learned my addr 172.21.15.31:0/2276422142 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:55.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fc241021700 1 -- 172.21.15.31:0/3885925686 shutdown_connections 2024-08-17T02:24:55.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fc241021700 1 --2- 172.21.15.31:0/3885925686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc23c0b12b0 0x7fc23c0c9b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fc241021700 1 -- 172.21.15.31:0/3885925686 >> 172.21.15.31:0/3885925686 conn(0x7fc23c0cbe50 msgr2=0x7fc23c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fc241021700 1 -- 172.21.15.31:0/3885925686 shutdown_connections 2024-08-17T02:24:55.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fc241021700 1 -- 172.21.15.31:0/3885925686 wait complete. 2024-08-17T02:24:55.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139102572 0 0) 0x7f91fc0add30 con 0x7f91fc0aca40 2024-08-17T02:24:55.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e4003570 con 0x7f91fc0aca40 2024-08-17T02:24:55.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 408455355 0 0) 0x7f91e4003570 con 0x7f91fc0aca40 2024-08-17T02:24:55.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc1503d0 msgr2=0x7f91fc068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 --2- 172.21.15.31:0/2276422142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc1503d0 0x7f91fc068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 >> v2:172.21.15.92:3300/0 conn(0x7f91fc1507a0 msgr2=0x7f91fc0694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 --2- 172.21.15.31:0/2276422142 >> v2:172.21.15.92:3300/0 conn(0x7f91fc1507a0 0x7f91fc0694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0ada50 con 0x7f91fc0aca40 2024-08-17T02:24:55.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f91f40017f0 con 0x7f91fc0aca40 2024-08-17T02:24:55.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 >> v1:172.21.15.31:6789/0 conn(0x7f91fc0aca40 legacy=0x7f91fc0acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 --2- 172.21.15.31:0/2276422142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc1503d0 0x7f91e4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 --2- 172.21.15.31:0/2276422142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91e4004170 0x7f91e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 --2- 172.21.15.31:0/2276422142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4004e70 0x7f91e40052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0af070 con 0x7f91e4004170 2024-08-17T02:24:55.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0ad770 con 0x7f91e4004e70 2024-08-17T02:24:55.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e400df80 con 0x7f91fc1503d0 2024-08-17T02:24:55.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f014d583700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014806a6e0 0x7f0148163910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f014d583700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01480ade80 0x7f01481610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f014d583700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 0x7f0148157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f014d583700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0148162400 con 0x7f01480ade80 2024-08-17T02:24:55.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f014d583700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c9a10 con 0x7f014806a6e0 2024-08-17T02:24:55.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f014d583700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01481615e0 con 0x7f014815d530 2024-08-17T02:24:55.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f01467fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01480ade80 0x7f01481610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f0146ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014806a6e0 0x7f0148163910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f01467fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01480ade80 0x7f01481610a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48804/0 (socket says 172.21.15.31:48804) 2024-08-17T02:24:55.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f01467fc700 1 -- 172.21.15.31:0/547429812 learned_addr learned my addr 172.21.15.31:0/547429812 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f7a97fff700 1 -- 172.21.15.31:0/4101984984 shutdown_connections 2024-08-17T02:24:55.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f0601ae5700 1 Processor -- start 2024-08-17T02:24:55.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f0601ae5700 1 -- start start 2024-08-17T02:24:55.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f499e12b700 1 Processor -- start 2024-08-17T02:24:55.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff48be59700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff48406a6e0 0x7ff4841500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff48be59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4840ade80 0x7ff4840aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff48be59700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff48415d530 0x7ff48406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff48be59700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840aaf80 con 0x7ff48415d530 2024-08-17T02:24:55.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff48be59700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840ab260 con 0x7ff4840ade80 2024-08-17T02:24:55.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff48be59700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840ab540 con 0x7ff48406a6e0 2024-08-17T02:24:55.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff4893f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4840ade80 0x7ff4840aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff489bf5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff48406a6e0 0x7ff4841500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f499e12b700 1 -- start start 2024-08-17T02:24:55.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff489bf5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff48406a6e0 0x7ff4841500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:41270/0 (socket says 172.21.15.31:41270) 2024-08-17T02:24:55.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff489bf5700 1 -- 172.21.15.31:0/1541776605 learned_addr learned my addr 172.21.15.31:0/1541776605 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff48a3f6700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff48415d530 0x7ff48406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff489bf5700 1 -- 172.21.15.31:0/1541776605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4840ade80 msgr2=0x7ff4840aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff489bf5700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4840ade80 0x7ff4840aa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff489bf5700 1 -- 172.21.15.31:0/1541776605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff48415d530 msgr2=0x7ff48406e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff489bf5700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff48415d530 0x7ff48406e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff489bf5700 1 -- 172.21.15.31:0/1541776605 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c009a20 con 0x7ff48406a6e0 2024-08-17T02:24:55.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f01477fe700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 0x7f0148157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f01467fc700 1 -- 172.21.15.31:0/547429812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 msgr2=0x7f0148157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f01467fc700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 0x7f0148157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f01467fc700 1 -- 172.21.15.31:0/547429812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014806a6e0 msgr2=0x7f0148163910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f01467fc700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014806a6e0 0x7f0148163910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f01467fc700 1 -- 172.21.15.31:0/547429812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01380094f0 con 0x7f01480ade80 2024-08-17T02:24:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff489bf5700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff48406a6e0 0x7ff4841500b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff48001f910 tx=0x7ff4800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f0601ae5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05fc0691b0 0x7f05fc135930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f0601ae5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc0ad930 0x7f05fc14b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f0601ae5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05fc147a70 0x7f05fc147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f0601ae5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc148430 con 0x7f05fc147a70 2024-08-17T02:24:55.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f0601ae5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc1371f0 con 0x7f05fc0ad930 2024-08-17T02:24:55.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f0601ae5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc1365e0 con 0x7f05fc0691b0 2024-08-17T02:24:55.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fbf5dd56700 1 -- 172.21.15.31:0/529765919 shutdown_connections 2024-08-17T02:24:55.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff479ffb700 1 -- 172.21.15.31:0/1541776605 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480024690 con 0x7ff48406a6e0 2024-08-17T02:24:55.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7ff48be59700 1 -- 172.21.15.31:0/1541776605 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4840ab820 con 0x7ff48406a6e0 2024-08-17T02:24:55.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91fb7fe700 1 --2- 172.21.15.31:0/2276422142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91e4004170 0x7f91e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91fbfff700 1 --2- 172.21.15.31:0/2276422142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc1503d0 0x7f91e4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91fbfff700 1 -- 172.21.15.31:0/2276422142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4004e70 msgr2=0x7f91e40052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91fbfff700 1 --2- 172.21.15.31:0/2276422142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4004e70 0x7f91e40052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91fbfff700 1 -- 172.21.15.31:0/2276422142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91e4004170 msgr2=0x7f91e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91fbfff700 1 --2- 172.21.15.31:0/2276422142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91e4004170 0x7f91e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91fbfff700 1 -- 172.21.15.31:0/2276422142 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0ada50 con 0x7f91fc1503d0 2024-08-17T02:24:55.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f91fbfff700 1 --2- 172.21.15.31:0/2276422142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc1503d0 0x7f91e4003a60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0099c0 tx=0x7f91ec009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bd6bc0e6e503316 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f01467fc700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01480ade80 0x7f01481610a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f013c00c7c0 tx=0x7f013c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7ff48be59700 1 -- 172.21.15.31:0/1541776605 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4841505f0 con 0x7ff48406a6e0 2024-08-17T02:24:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fbf5dd56700 1 -- 172.21.15.31:0/529765919 wait complete. 2024-08-17T02:24:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05fbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc0ad930 0x7f05fc14b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05fbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc0ad930 0x7f05fc14b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:58042/0 (socket says 172.21.15.31:58042) 2024-08-17T02:24:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05fbfff700 1 -- 172.21.15.31:0/2768815120 learned_addr learned my addr 172.21.15.31:0/2768815120 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec011420 con 0x7f91fc1503d0 2024-08-17T02:24:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec011580 con 0x7f91fc1503d0 2024-08-17T02:24:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f91faffd700 1 -- 172.21.15.31:0/2276422142 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec011940 con 0x7f91fc1503d0 2024-08-17T02:24:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fc241021700 1 Processor -- start 2024-08-17T02:24:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7fc241021700 1 -- start start 2024-08-17T02:24:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499e12b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49980c96e0 0x7f49980aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499e12b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4998154b90 0x7f499815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499e12b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998067a00 0x7f4998147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499e12b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4998159960 con 0x7f49980c96e0 2024-08-17T02:24:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499e12b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4998159bd0 con 0x7f4998067a00 2024-08-17T02:24:55.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499e12b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49981497c0 con 0x7f4998154b90 2024-08-17T02:24:55.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499d92a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998067a00 0x7f4998147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499d92a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998067a00 0x7f4998147b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:58056/0 (socket says 172.21.15.31:58056) 2024-08-17T02:24:55.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499d92a700 1 -- 172.21.15.31:0/726343892 learned_addr learned my addr 172.21.15.31:0/726343892 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.918+0000 7f7a97fff700 1 -- 172.21.15.31:0/4101984984 wait complete. 2024-08-17T02:24:55.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499c928700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4998154b90 0x7f499815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499d92a700 1 -- 172.21.15.31:0/726343892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4998154b90 msgr2=0x7f499815a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499d92a700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4998154b90 0x7f499815a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499d92a700 1 -- 172.21.15.31:0/726343892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49980c96e0 msgr2=0x7f49980aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499d92a700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49980c96e0 0x7f49980aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499d92a700 1 -- 172.21.15.31:0/726343892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940094f0 con 0x7f4998067a00 2024-08-17T02:24:55.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05fbfff700 1 -- 172.21.15.31:0/2768815120 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05fc0691b0 msgr2=0x7f05fc135930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05fbfff700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05fc0691b0 0x7f05fc135930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05fbfff700 1 -- 172.21.15.31:0/2768815120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05fc147a70 msgr2=0x7f05fc147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05fbfff700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05fc147a70 0x7f05fc147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05fbfff700 1 -- 172.21.15.31:0/2768815120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009420 con 0x7f05fc0ad930 2024-08-17T02:24:55.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05fbfff700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc0ad930 0x7f05fc14b6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05f0002000 tx=0x7f05f0016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499c928700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4998154b90 0x7f499815a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:55.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f92012b6700 1 -- 172.21.15.31:0/2276422142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc1503d0 msgr2=0x7f91e4003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f92012b6700 1 --2- 172.21.15.31:0/2276422142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc1503d0 0x7f91e4003a60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0099c0 tx=0x7f91ec009060 comp rx=0 tx=0).stop 2024-08-17T02:24:55.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05f8ff9700 1 -- 172.21.15.31:0/2768815120 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0011c40 con 0x7f05fc0ad930 2024-08-17T02:24:55.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05f8ff9700 1 -- 172.21.15.31:0/2768815120 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0020070 con 0x7f05fc0ad930 2024-08-17T02:24:55.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f0601ae5700 1 -- 172.21.15.31:0/2768815120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05fc1368c0 con 0x7f05fc0ad930 2024-08-17T02:24:55.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05f8ff9700 1 -- 172.21.15.31:0/2768815120 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f001b450 con 0x7f05fc0ad930 2024-08-17T02:24:55.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f0601ae5700 1 -- 172.21.15.31:0/2768815120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05fc136e80 con 0x7f05fc0ad930 2024-08-17T02:24:55.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fbf5dd56700 1 Processor -- start 2024-08-17T02:24:55.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a97fff700 1 Processor -- start 2024-08-17T02:24:55.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499d92a700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998067a00 0x7f4998147b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f499000c910 tx=0x7f4990001710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f012effd700 1 -- 172.21.15.31:0/547429812 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c011590 con 0x7f01480ade80 2024-08-17T02:24:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f9200ab5700 1 -- 172.21.15.31:0/2276422142 reap_dead start 2024-08-17T02:24:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7ff479ffb700 1 -- 172.21.15.31:0/1541776605 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4800247f0 con 0x7ff48406a6e0 2024-08-17T02:24:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7ff479ffb700 1 -- 172.21.15.31:0/1541776605 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480024b90 con 0x7ff48406a6e0 2024-08-17T02:24:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7ff48be59700 1 -- 172.21.15.31:0/1541776605 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4840712b0 con 0x7ff48406a6e0 2024-08-17T02:24:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a97fff700 1 -- start start 2024-08-17T02:24:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc241021700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc23c0b12b0 0x7fc23c14c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc241021700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc23c0ca070 0x7fc23c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc241021700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc23c156fd0 0x7fc23c14d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc241021700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c15bf20 con 0x7fc23c0b12b0 2024-08-17T02:24:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc241021700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c14cb30 con 0x7fc23c156fd0 2024-08-17T02:24:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc241021700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c152ad0 con 0x7fc23c0ca070 2024-08-17T02:24:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f92012b6700 1 -- 172.21.15.31:0/2276422142 shutdown_connections 2024-08-17T02:24:55.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f92012b6700 1 -- 172.21.15.31:0/2276422142 >> 172.21.15.31:0/2276422142 conn(0x7f91fc067400 msgr2=0x7f91fc067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f012effd700 1 -- 172.21.15.31:0/547429812 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c011710 con 0x7f01480ade80 2024-08-17T02:24:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f012effd700 1 -- 172.21.15.31:0/547429812 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c011ad0 con 0x7f01480ade80 2024-08-17T02:24:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f014d583700 1 -- 172.21.15.31:0/547429812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0148157650 con 0x7f01480ade80 2024-08-17T02:24:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc23a59c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc23c0ca070 0x7fc23c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc23a59c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc23c0ca070 0x7fc23c15c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:41338/0 (socket says 172.21.15.31:41338) 2024-08-17T02:24:55.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc23a59c700 1 -- 172.21.15.31:0/3829328124 learned_addr learned my addr 172.21.15.31:0/3829328124 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f498d7fa700 1 -- 172.21.15.31:0/726343892 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000a7a0 con 0x7f4998067a00 2024-08-17T02:24:55.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f498d7fa700 1 -- 172.21.15.31:0/726343892 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499000a900 con 0x7f4998067a00 2024-08-17T02:24:55.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499e12b700 1 -- 172.21.15.31:0/726343892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4998149aa0 con 0x7f4998067a00 2024-08-17T02:24:55.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f498d7fa700 1 -- 172.21.15.31:0/726343892 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000acc0 con 0x7f4998067a00 2024-08-17T02:24:55.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f499e12b700 1 -- 172.21.15.31:0/726343892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4998149450 con 0x7f4998067a00 2024-08-17T02:24:55.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a97fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a98069690 0x7f7a98156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a97fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a98140370 0x7f7a9813d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a97fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a98140740 0x7f7a9816c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a97fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a98158090 con 0x7f7a98140370 2024-08-17T02:24:55.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a97fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a98157480 con 0x7f7a98069690 2024-08-17T02:24:55.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a97fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a98157760 con 0x7f7a98140740 2024-08-17T02:24:55.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a96ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a98069690 0x7f7a98156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a96ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a98069690 0x7f7a98156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:58086/0 (socket says 172.21.15.31:58086) 2024-08-17T02:24:55.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f7a96ffd700 1 -- 172.21.15.31:0/2497200667 learned_addr learned my addr 172.21.15.31:0/2497200667 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fbf5dd56700 1 -- start start 2024-08-17T02:24:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f014d583700 1 -- 172.21.15.31:0/547429812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0148161e40 con 0x7f01480ade80 2024-08-17T02:24:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f0601ae5700 1 -- 172.21.15.31:0/2768815120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05fc0712b0 con 0x7f05fc0ad930 2024-08-17T02:24:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7f05f8ff9700 1 -- 172.21.15.31:0/2768815120 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f05f0022030 con 0x7f05fc0ad930 2024-08-17T02:24:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fbf5dd56700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf58167a20 0x7fbf580a75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fbf5dd56700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf580a7b00 0x7fbf580ac520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fbf5dd56700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf580aca60 0x7fbf58165d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fbf5dd56700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580acf00 con 0x7fbf58167a20 2024-08-17T02:24:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fbf5dd56700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580a8080 con 0x7fbf580aca60 2024-08-17T02:24:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fbf5dd56700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580a8360 con 0x7fbf580a7b00 2024-08-17T02:24:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf56ffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf580a7b00 0x7fbf580ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf56ffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf580a7b00 0x7fbf580ac520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:41356/0 (socket says 172.21.15.31:41356) 2024-08-17T02:24:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf56ffd700 1 -- 172.21.15.31:0/2867896488 learned_addr learned my addr 172.21.15.31:0/2867896488 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f499e12b700 1 -- 172.21.15.31:0/726343892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49780052b0 con 0x7f4998067a00 2024-08-17T02:24:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f05f8ff9700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f05e8060890 0x7f05e8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f05f8ff9700 1 -- 172.21.15.31:0/2768815120 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05f007ea80 con 0x7f05fc0ad930 2024-08-17T02:24:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f0600ae3700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f05e8060890 0x7f05e8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7ff479ffb700 1 -- 172.21.15.31:0/1541776605 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff4800233e0 con 0x7ff48406a6e0 2024-08-17T02:24:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7ff479ffb700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff468060890 0x7ff468062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7ff479ffb700 1 -- 172.21.15.31:0/1541776605 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff48008db70 con 0x7ff48406a6e0 2024-08-17T02:24:55.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7ff4893f4700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff468060890 0x7ff468062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf56ffd700 1 -- 172.21.15.31:0/2867896488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf580aca60 msgr2=0x7fbf58165d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:24:55.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf56ffd700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf580aca60 0x7fbf58165d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf56ffd700 1 -- 172.21.15.31:0/2867896488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf58167a20 msgr2=0x7fbf580a75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf56ffd700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf58167a20 0x7fbf580a75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf56ffd700 1 -- 172.21.15.31:0/2867896488 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf580a8640 con 0x7fbf580a7b00 2024-08-17T02:24:55.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf56ffd700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf580a7b00 0x7fbf580ac520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c007710 tx=0x7fbf4c0079d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf3f7fe700 1 -- 172.21.15.31:0/2867896488 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c018030 con 0x7fbf580a7b00 2024-08-17T02:24:55.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf3f7fe700 1 -- 172.21.15.31:0/2867896488 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c00fc60 con 0x7fbf580a7b00 2024-08-17T02:24:55.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf3f7fe700 1 -- 172.21.15.31:0/2867896488 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0133f0 con 0x7fbf580a7b00 2024-08-17T02:24:55.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f7a977fe700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a98140740 0x7f7a9816c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f7a96ffd700 1 -- 172.21.15.31:0/2497200667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a98140740 msgr2=0x7f7a9816c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f7a96ffd700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a98140740 0x7f7a9816c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f7a96ffd700 1 -- 172.21.15.31:0/2497200667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a98140370 msgr2=0x7f7a9813d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f7a96ffd700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a98140370 0x7f7a9813d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f7a96ffd700 1 -- 172.21.15.31:0/2497200667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0094f0 con 0x7f7a98069690 2024-08-17T02:24:55.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f7a96ffd700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a98069690 0x7f7a98156ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c5d0 tx=0x7f7a88007f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc23a59c700 1 -- 172.21.15.31:0/3829328124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc23c156fd0 msgr2=0x7fc23c14d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc23a59c700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc23c156fd0 0x7fc23c14d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc23a59c700 1 -- 172.21.15.31:0/3829328124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc23c0b12b0 msgr2=0x7fc23c14c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc23a59c700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc23c0b12b0 0x7fc23c14c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc23a59c700 1 -- 172.21.15.31:0/3829328124 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234009a20 con 0x7fc23c0ca070 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.922+0000 7fc23a59c700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc23c0ca070 0x7fc23c15c3b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc2340097c0 tx=0x7fc234019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fc222ffd700 1 -- 172.21.15.31:0/3829328124 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234012df0 con 0x7fc23c0ca070 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fc241021700 1 -- 172.21.15.31:0/3829328124 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c152db0 con 0x7fc23c0ca070 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fc241021700 1 -- 172.21.15.31:0/3829328124 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c15bbb0 con 0x7fc23c0ca070 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fc222ffd700 1 -- 172.21.15.31:0/3829328124 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234027470 con 0x7fc23c0ca070 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fc222ffd700 1 -- 172.21.15.31:0/3829328124 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234027830 con 0x7fc23c0ca070 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f92012b6700 1 -- 172.21.15.31:0/2276422142 shutdown_connections 2024-08-17T02:24:55.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f92012b6700 1 -- 172.21.15.31:0/2276422142 wait complete. 2024-08-17T02:24:55.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f92012b6700 1 Processor -- start 2024-08-17T02:24:55.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f92012b6700 1 -- start start 2024-08-17T02:24:55.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f012effd700 1 -- 172.21.15.31:0/547429812 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f013c01b3b0 con 0x7f01480ade80 2024-08-17T02:24:55.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f012effd700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01340609e0 0x7f0134062e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f012effd700 1 -- 172.21.15.31:0/547429812 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f013c07bdc0 con 0x7f01480ade80 2024-08-17T02:24:55.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f0146ffd700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01340609e0 0x7f0134062e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f014d583700 1 -- 172.21.15.31:0/547429812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01280052b0 con 0x7f01480ade80 2024-08-17T02:24:55.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f0146ffd700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01340609e0 0x7f0134062e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f01380099b0 tx=0x7f0138017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f0600ae3700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f05e8060890 0x7f05e8062d40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f05f4002d90 tx=0x7f05f4007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f498d7fa700 1 -- 172.21.15.31:0/726343892 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4990012630 con 0x7f4998067a00 2024-08-17T02:24:55.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f498d7fa700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f497c060860 0x7f497c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f498d7fa700 1 -- 172.21.15.31:0/726343892 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f499007ce90 con 0x7f4998067a00 2024-08-17T02:24:55.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f499d129700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f497c060860 0x7f497c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7f499d129700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f497c060860 0x7f497c062d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f49880097e0 tx=0x7f4988006d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7ff4893f4700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff468060890 0x7ff468062d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff4840ccde0 tx=0x7ff474009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf5dd56700 1 -- 172.21.15.31:0/2867896488 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf580a8920 con 0x7fbf580a7b00 2024-08-17T02:24:55.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.926+0000 7fbf5dd56700 1 -- 172.21.15.31:0/2867896488 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf580ae8e0 con 0x7fbf580a7b00 2024-08-17T02:24:55.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7fc241021700 1 -- 172.21.15.31:0/3829328124 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c0052b0 con 0x7fc23c0ca070 2024-08-17T02:24:55.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f92012b6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc168190 0x7f91fc152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f92012b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc1530e0 0x7f91fc1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f92012b6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91fc155b30 0x7f91fc14dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f92012b6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc165770 con 0x7f91fc1530e0 2024-08-17T02:24:55.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f92012b6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc153550 con 0x7f91fc155b30 2024-08-17T02:24:55.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f92012b6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc156f50 con 0x7f91fc168190 2024-08-17T02:24:55.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91fb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc1530e0 0x7f91fc1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7fbf5dd56700 1 -- 172.21.15.31:0/2867896488 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf380052b0 con 0x7fbf580a7b00 2024-08-17T02:24:55.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91fbfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc168190 0x7f91fc152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91fb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc1530e0 0x7f91fc1555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48860/0 (socket says 172.21.15.31:48860) 2024-08-17T02:24:55.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91fb7fe700 1 -- 172.21.15.31:0/965423651 learned_addr learned my addr 172.21.15.31:0/965423651 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:55.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f9200ab5700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91fc155b30 0x7f91fc14dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91fb7fe700 1 -- 172.21.15.31:0/965423651 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc168190 msgr2=0x7f91fc152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91fb7fe700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc168190 0x7f91fc152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91fb7fe700 1 -- 172.21.15.31:0/965423651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91fc155b30 msgr2=0x7f91fc14dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91fb7fe700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91fc155b30 0x7f91fc14dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91fb7fe700 1 -- 172.21.15.31:0/965423651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc156340 con 0x7f91fc1530e0 2024-08-17T02:24:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91fb7fe700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc1530e0 0x7f91fc1555f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f91f000d890 tx=0x7f91f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f7a7effd700 1 -- 172.21.15.31:0/2497200667 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88011590 con 0x7f7a98069690 2024-08-17T02:24:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f7a97fff700 1 -- 172.21.15.31:0/2497200667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a98157a40 con 0x7f7a98069690 2024-08-17T02:24:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f7a97fff700 1 -- 172.21.15.31:0/2497200667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a981570e0 con 0x7f7a98069690 2024-08-17T02:24:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f012effd700 1 -- 172.21.15.31:0/547429812 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f013c081060 con 0x7f01480ade80 2024-08-17T02:24:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91e3fff700 1 -- 172.21.15.31:0/965423651 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011590 con 0x7f91fc1530e0 2024-08-17T02:24:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91e3fff700 1 -- 172.21.15.31:0/965423651 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0011710 con 0x7f91fc1530e0 2024-08-17T02:24:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f92012b6700 1 -- 172.21.15.31:0/965423651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc156620 con 0x7f91fc1530e0 2024-08-17T02:24:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f91e3fff700 1 -- 172.21.15.31:0/965423651 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011ad0 con 0x7f91fc1530e0 2024-08-17T02:24:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f92012b6700 1 -- 172.21.15.31:0/965423651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc156be0 con 0x7f91fc1530e0 2024-08-17T02:24:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.930+0000 7f05f8ff9700 1 -- 172.21.15.31:0/2768815120 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f05f004eed0 con 0x7f05fc0ad930 2024-08-17T02:24:55.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7f7a97fff700 1 -- 172.21.15.31:0/2497200667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a981764a0 con 0x7f7a98069690 2024-08-17T02:24:55.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7f92012b6700 1 -- 172.21.15.31:0/965423651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc0712b0 con 0x7f91fc1530e0 2024-08-17T02:24:55.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7f91e3fff700 1 -- 172.21.15.31:0/965423651 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f91f001c460 con 0x7f91fc1530e0 2024-08-17T02:24:55.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7f91e3fff700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91e8060960 0x7f91e8062e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7f91e3fff700 1 -- 172.21.15.31:0/965423651 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91f007caa0 con 0x7f91fc1530e0 2024-08-17T02:24:55.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7f91fbfff700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91e8060960 0x7f91e8062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7f91fbfff700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91e8060960 0x7f91e8062e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009150 tx=0x7f91ec017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7fc222ffd700 1 -- 172.21.15.31:0/3829328124 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc234024070 con 0x7fc23c0ca070 2024-08-17T02:24:55.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7fc222ffd700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc228060860 0x7fc228062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7fc222ffd700 1 -- 172.21.15.31:0/3829328124 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc23407f7e0 con 0x7fc23c0ca070 2024-08-17T02:24:55.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7fc23ad9d700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc228060860 0x7fc228062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.934+0000 7fbf3f7fe700 1 -- 172.21.15.31:0/2867896488 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbf4c01b070 con 0x7fbf580a7b00 2024-08-17T02:24:55.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7ff479ffb700 1 -- 172.21.15.31:0/1541776605 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff48005dfc0 con 0x7ff48406a6e0 2024-08-17T02:24:55.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7fbf3f7fe700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbf44060890 0x7fbf44062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7fbf3f7fe700 1 -- 172.21.15.31:0/2867896488 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf4c019070 con 0x7fbf580a7b00 2024-08-17T02:24:55.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7fc23ad9d700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc228060860 0x7fc228062d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0b1120 tx=0x7fc22c007b40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7f7a7effd700 1 -- 172.21.15.31:0/2497200667 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a88011900 con 0x7f7a98069690 2024-08-17T02:24:55.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7f7a7effd700 1 -- 172.21.15.31:0/2497200667 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88011a90 con 0x7f7a98069690 2024-08-17T02:24:55.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7f498d7fa700 1 -- 172.21.15.31:0/726343892 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4990050d70 con 0x7f4998067a00 2024-08-17T02:24:55.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7fc222ffd700 1 -- 172.21.15.31:0/3829328124 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc23404fd60 con 0x7fc23c0ca070 2024-08-17T02:24:55.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7f7a7effd700 1 -- 172.21.15.31:0/2497200667 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7a88011bf0 con 0x7f7a98069690 2024-08-17T02:24:55.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7f91e3fff700 1 -- 172.21.15.31:0/965423651 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f91f004cf70 con 0x7f91fc1530e0 2024-08-17T02:24:55.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7f7a7effd700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a84060890 0x7f7a84062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7f7a7effd700 1 -- 172.21.15.31:0/2497200667 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a8807d270 con 0x7f7a98069690 2024-08-17T02:24:55.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7f7a967fc700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a84060890 0x7f7a84062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7fbf577fe700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbf44060890 0x7fbf44062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.938+0000 7fbf577fe700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbf44060890 0x7fbf44062d40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbf5806f5c0 tx=0x7fbf4800e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.942+0000 7f7a967fc700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a84060890 0x7f7a84062d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a9815d0f0 tx=0x7f7a90009370 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.942+0000 7f7a7effd700 1 -- 172.21.15.31:0/2497200667 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7a8804d6c0 con 0x7f7a98069690 2024-08-17T02:24:55.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:55.942+0000 7fbf3f7fe700 1 -- 172.21.15.31:0/2867896488 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbf4c04dd30 con 0x7fbf580a7b00 2024-08-17T02:24:56.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.262+0000 7f0601ae5700 1 -- 172.21.15.31:0/2768815120 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f05fc0712b0 con 0x7f05fc0ad930 2024-08-17T02:24:56.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.262+0000 7f05f8ff9700 1 -- 172.21.15.31:0/2768815120 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05f00524f0 con 0x7f05fc0ad930 2024-08-17T02:24:56.269 INFO:teuthology.orchestra.run.smithi031.stdout:64424509446 2024-08-17T02:24:56.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 -- 172.21.15.31:0/2768815120 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f05e8060890 msgr2=0x7f05e8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f05e8060890 0x7f05e8062d40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f05f4002d90 tx=0x7f05f4007ea0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 -- 172.21.15.31:0/2768815120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc0ad930 msgr2=0x7f05fc14b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc0ad930 0x7f05fc14b6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05f0002000 tx=0x7f05f0016000 comp rx=0 tx=0).stop 2024-08-17T02:24:56.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 -- 172.21.15.31:0/2768815120 shutdown_connections 2024-08-17T02:24:56.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f05e8060890 0x7f05e8062d40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05fc147a70 0x7f05fc147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05fc0ad930 0x7f05fc14b6f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 --2- 172.21.15.31:0/2768815120 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05fc0691b0 0x7f05fc135930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 -- 172.21.15.31:0/2768815120 >> 172.21.15.31:0/2768815120 conn(0x7f05fc067400 msgr2=0x7f05fc13d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7fc241021700 1 -- 172.21.15.31:0/3829328124 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc21c005830 con 0x7fc23c0ca070 2024-08-17T02:24:56.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 -- 172.21.15.31:0/2768815120 shutdown_connections 2024-08-17T02:24:56.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7f05e27fc700 1 -- 172.21.15.31:0/2768815120 wait complete. 2024-08-17T02:24:56.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.266+0000 7fc222ffd700 1 -- 172.21.15.31:0/3829328124 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc234053380 con 0x7fc23c0ca070 2024-08-17T02:24:56.272 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-08-17T02:24:56.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7ff48be59700 1 -- 172.21.15.31:0/1541776605 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff484069f90 con 0x7ff48406a6e0 2024-08-17T02:24:56.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 -- 172.21.15.31:0/3829328124 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc228060860 msgr2=0x7fc228062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc228060860 0x7fc228062d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0b1120 tx=0x7fc22c007b40 comp rx=0 tx=0).stop 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 -- 172.21.15.31:0/3829328124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc23c0ca070 msgr2=0x7fc23c15c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc23c0ca070 0x7fc23c15c3b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc2340097c0 tx=0x7fc234019000 comp rx=0 tx=0).stop 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 -- 172.21.15.31:0/3829328124 shutdown_connections 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc228060860 0x7fc228062d10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc23c156fd0 0x7fc23c14d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc23c0ca070 0x7fc23c15c3b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 --2- 172.21.15.31:0/3829328124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc23c0b12b0 0x7fc23c14c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 -- 172.21.15.31:0/3829328124 >> 172.21.15.31:0/3829328124 conn(0x7fc23c0cbe50 msgr2=0x7fc23c0ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 -- 172.21.15.31:0/3829328124 shutdown_connections 2024-08-17T02:24:56.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7fc241021700 1 -- 172.21.15.31:0/3829328124 wait complete. 2024-08-17T02:24:56.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7ff479ffb700 1 -- 172.21.15.31:0/1541776605 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4800615e0 con 0x7ff48406a6e0 2024-08-17T02:24:56.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7f499e12b700 1 -- 172.21.15.31:0/726343892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4978005830 con 0x7f4998067a00 2024-08-17T02:24:56.277 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-08-17T02:24:56.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.270+0000 7f498d7fa700 1 -- 172.21.15.31:0/726343892 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4990050900 con 0x7f4998067a00 2024-08-17T02:24:56.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7f92012b6700 1 -- 172.21.15.31:0/965423651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f91fc157090 con 0x7f91fc1530e0 2024-08-17T02:24:56.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7f014d583700 1 -- 172.21.15.31:0/547429812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0128005830 con 0x7f01480ade80 2024-08-17T02:24:56.278 INFO:teuthology.orchestra.run.smithi031.stdout:64424509446 2024-08-17T02:24:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7f012effd700 1 -- 172.21.15.31:0/547429812 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f013c017070 con 0x7f01480ade80 2024-08-17T02:24:56.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7f91e3fff700 1 -- 172.21.15.31:0/965423651 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91f0050590 con 0x7f91fc1530e0 2024-08-17T02:24:56.279 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-08-17T02:24:56.280 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 -- 172.21.15.31:0/1541776605 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff468060890 msgr2=0x7ff468062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff468060890 0x7ff468062d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff4840ccde0 tx=0x7ff474009040 comp rx=0 tx=0).stop 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 -- 172.21.15.31:0/1541776605 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff48406a6e0 msgr2=0x7ff4841500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff48406a6e0 0x7ff4841500b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff48001f910 tx=0x7ff4800091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 -- 172.21.15.31:0/1541776605 shutdown_connections 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff468060890 0x7ff468062d40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff48415d530 0x7ff48406e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4840ade80 0x7ff4840aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 --2- 172.21.15.31:0/1541776605 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff48406a6e0 0x7ff4841500b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 -- 172.21.15.31:0/1541776605 >> 172.21.15.31:0/1541776605 conn(0x7ff4840cbe50 msgr2=0x7ff484069170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 -- 172.21.15.31:0/1541776605 shutdown_connections 2024-08-17T02:24:56.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.274+0000 7ff48be59700 1 -- 172.21.15.31:0/1541776605 wait complete. 2024-08-17T02:24:56.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 -- 172.21.15.31:0/726343892 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f497c060860 msgr2=0x7f497c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f497c060860 0x7f497c062d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f49880097e0 tx=0x7f4988006d10 comp rx=0 tx=0).stop 2024-08-17T02:24:56.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 -- 172.21.15.31:0/726343892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998067a00 msgr2=0x7f4998147b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998067a00 0x7f4998147b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f499000c910 tx=0x7f4990001710 comp rx=0 tx=0).stop 2024-08-17T02:24:56.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 -- 172.21.15.31:0/726343892 shutdown_connections 2024-08-17T02:24:56.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f497c060860 0x7f497c062d10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4998067a00 0x7f4998147b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4998154b90 0x7f499815a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 --2- 172.21.15.31:0/726343892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49980c96e0 0x7f49980aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 -- 172.21.15.31:0/726343892 >> 172.21.15.31:0/726343892 conn(0x7f4998067400 msgr2=0x7f499815abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 -- 172.21.15.31:0/726343892 shutdown_connections 2024-08-17T02:24:56.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f499e12b700 1 -- 172.21.15.31:0/726343892 wait complete. 2024-08-17T02:24:56.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 -- 172.21.15.31:0/547429812 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01340609e0 msgr2=0x7f0134062e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f7a97fff700 1 -- 172.21.15.31:0/2497200667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7a980712b0 con 0x7f7a98069690 2024-08-17T02:24:56.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 -- 172.21.15.31:0/965423651 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91e8060960 msgr2=0x7f91e8062e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01340609e0 0x7f0134062e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f01380099b0 tx=0x7f0138017000 comp rx=0 tx=0).stop 2024-08-17T02:24:56.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91e8060960 0x7f91e8062e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009150 tx=0x7f91ec017000 comp rx=0 tx=0).stop 2024-08-17T02:24:56.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 -- 172.21.15.31:0/965423651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc1530e0 msgr2=0x7f91fc1555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc1530e0 0x7f91fc1555f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f91f000d890 tx=0x7f91f0008040 comp rx=0 tx=0).stop 2024-08-17T02:24:56.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 -- 172.21.15.31:0/965423651 shutdown_connections 2024-08-17T02:24:56.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91e8060960 0x7f91e8062e10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91fc155b30 0x7f91fc14dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc1530e0 0x7f91fc1555f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 --2- 172.21.15.31:0/965423651 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc168190 0x7f91fc152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 -- 172.21.15.31:0/547429812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01480ade80 msgr2=0x7f01481610a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 -- 172.21.15.31:0/965423651 >> 172.21.15.31:0/965423651 conn(0x7f91fc067400 msgr2=0x7f91fc06e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01480ade80 0x7f01481610a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f013c00c7c0 tx=0x7f013c007f50 comp rx=0 tx=0).stop 2024-08-17T02:24:56.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 -- 172.21.15.31:0/965423651 shutdown_connections 2024-08-17T02:24:56.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f7a7effd700 1 -- 172.21.15.31:0/2497200667 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a88050ce0 con 0x7f7a98069690 2024-08-17T02:24:56.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f92012b6700 1 -- 172.21.15.31:0/965423651 wait complete. 2024-08-17T02:24:56.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 -- 172.21.15.31:0/547429812 shutdown_connections 2024-08-17T02:24:56.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01340609e0 0x7f0134062e90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f014815d530 0x7f0148157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01480ade80 0x7f01481610a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 --2- 172.21.15.31:0/547429812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f014806a6e0 0x7f0148163910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 -- 172.21.15.31:0/547429812 >> 172.21.15.31:0/547429812 conn(0x7f01480cbe50 msgr2=0x7f014815dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 -- 172.21.15.31:0/547429812 shutdown_connections 2024-08-17T02:24:56.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7fbf5dd56700 1 -- 172.21.15.31:0/2867896488 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbf38005830 con 0x7fbf580a7b00 2024-08-17T02:24:56.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7f014d583700 1 -- 172.21.15.31:0/547429812 wait complete. 2024-08-17T02:24:56.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.278+0000 7fbf3f7fe700 1 -- 172.21.15.31:0/2867896488 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf4c051350 con 0x7fbf580a7b00 2024-08-17T02:24:56.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-08-17T02:24:56.290 INFO:teuthology.orchestra.run.smithi031.stdout:60129542150 2024-08-17T02:24:56.290 INFO:teuthology.orchestra.run.smithi031.stdout:64424509446 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 -- 172.21.15.31:0/2497200667 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a84060890 msgr2=0x7f7a84062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a84060890 0x7f7a84062d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a9815d0f0 tx=0x7f7a90009370 comp rx=0 tx=0).stop 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 -- 172.21.15.31:0/2497200667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a98069690 msgr2=0x7f7a98156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a98069690 0x7f7a98156ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c5d0 tx=0x7f7a88007f60 comp rx=0 tx=0).stop 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 -- 172.21.15.31:0/2497200667 shutdown_connections 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7a84060890 0x7f7a84062d40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a98140740 0x7f7a9816c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a98140370 0x7f7a9813d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 --2- 172.21.15.31:0/2497200667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a98069690 0x7f7a98156ba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 -- 172.21.15.31:0/2497200667 >> 172.21.15.31:0/2497200667 conn(0x7f7a98067400 msgr2=0x7f7a980ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 -- 172.21.15.31:0/2497200667 shutdown_connections 2024-08-17T02:24:56.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7f7a97fff700 1 -- 172.21.15.31:0/2497200667 wait complete. 2024-08-17T02:24:56.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 -- 172.21.15.31:0/2867896488 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbf44060890 msgr2=0x7fbf44062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbf44060890 0x7fbf44062d40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbf5806f5c0 tx=0x7fbf4800e000 comp rx=0 tx=0).stop 2024-08-17T02:24:56.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 -- 172.21.15.31:0/2867896488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf580a7b00 msgr2=0x7fbf580ac520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:56.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf580a7b00 0x7fbf580ac520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c007710 tx=0x7fbf4c0079d0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 -- 172.21.15.31:0/2867896488 shutdown_connections 2024-08-17T02:24:56.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbf44060890 0x7fbf44062d40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf580aca60 0x7fbf58165d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf580a7b00 0x7fbf580ac520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 --2- 172.21.15.31:0/2867896488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf58167a20 0x7fbf580a75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:56.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 -- 172.21.15.31:0/2867896488 >> 172.21.15.31:0/2867896488 conn(0x7fbf580cbe50 msgr2=0x7fbf58151330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:56.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 -- 172.21.15.31:0/2867896488 shutdown_connections 2024-08-17T02:24:56.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:56.286+0000 7fbf5dd56700 1 -- 172.21.15.31:0/2867896488 wait complete. 2024-08-17T02:24:56.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-08-17T02:24:56.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.3 2024-08-17T02:24:56.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-08-17T02:24:56.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-08-17T02:24:56.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-08-17T02:24:56.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.5 2024-08-17T02:24:56.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-08-17T02:24:57.291 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:24:57.295 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:24:57.299 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:24:57.301 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:24:57.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:24:57.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:24:57.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:24:57.306 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:24:57.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.418+0000 7f9328d13700 1 Processor -- start 2024-08-17T02:24:57.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9638b3f700 1 Processor -- start 2024-08-17T02:24:57.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.418+0000 7f9328d13700 1 -- start start 2024-08-17T02:24:57.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.418+0000 7f9328d13700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93240cc6a0 0x7f93240b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.418+0000 7f9328d13700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93240b1fb0 con 0x7f93240cca70 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.418+0000 7f9328d13700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932415f1b0 con 0x7f9324069600 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.418+0000 7f9328d13700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93240b19f0 con 0x7f93240cc6a0 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9321d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f93240cca70 0x7f9324068ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58474/0 (socket says 172.21.15.31:58474) 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9321d9b700 1 -- 172.21.15.31:0/760486172 learned_addr learned my addr 172.21.15.31:0/760486172 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932259c700 1 --2- 172.21.15.31:0/760486172 >> v2:172.21.15.31:3300/0 conn(0x7f93240cc6a0 0x7f93240b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932159a700 1 -- 172.21.15.31:0/760486172 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756472168 0 0) 0x7f9314001110 con 0x7f93240cca70 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932159a700 1 -- 172.21.15.31:0/760486172 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f930c003570 con 0x7f93240cca70 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932159a700 1 -- 172.21.15.31:0/760486172 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160593375 0 0) 0x7f932415f1b0 con 0x7f9324069600 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932259c700 1 -- 172.21.15.31:0/760486172 >> v1:172.21.15.92:6789/0 conn(0x7f9324069600 legacy=0x7f932415f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932259c700 1 -- 172.21.15.31:0/760486172 >> v1:172.21.15.31:6789/0 conn(0x7f93240cca70 legacy=0x7f9324068ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932259c700 1 -- 172.21.15.31:0/760486172 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93240b1cd0 con 0x7f93240cc6a0 2024-08-17T02:24:57.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9638b3f700 1 -- start start 2024-08-17T02:24:57.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9638b3f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9634069120 0x7f96340694f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9638b3f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f96340aef30 0x7f96340adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9638b3f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f96340af380 0x7f96340ae450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9638b3f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96340ada80 con 0x7f96340aef30 2024-08-17T02:24:57.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9638b3f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96340ace70 con 0x7f96340af380 2024-08-17T02:24:57.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9638b3f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96340ad150 con 0x7f9634069120 2024-08-17T02:24:57.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932259c700 1 --2- 172.21.15.31:0/760486172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93240cc6a0 0x7f93240b0e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f93180098e0 tx=0x7f93180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4657bc6b3da04d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9632d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f96340af380 0x7f96340ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9632d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f96340af380 0x7f96340ae450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:58120/0 (socket says 172.21.15.31:58120) 2024-08-17T02:24:57.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9632d9d700 1 -- 172.21.15.31:0/3089147737 learned_addr learned my addr 172.21.15.31:0/3089147737 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9631d9b700 1 --2- 172.21.15.31:0/3089147737 >> v2:172.21.15.31:3300/0 conn(0x7f96340aef30 0x7f96340adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932159a700 1 -- 172.21.15.31:0/760486172 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314001600 con 0x7f93240cc6a0 2024-08-17T02:24:57.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932159a700 1 -- 172.21.15.31:0/760486172 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318011420 con 0x7f93240cc6a0 2024-08-17T02:24:57.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f932159a700 1 -- 172.21.15.31:0/760486172 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180117c0 con 0x7f93240cc6a0 2024-08-17T02:24:57.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9632d9d700 1 -- 172.21.15.31:0/3089147737 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9634069120 msgr2=0x7f96340694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9632d9d700 1 --2- 172.21.15.31:0/3089147737 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9634069120 0x7f96340694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9632d9d700 1 -- 172.21.15.31:0/3089147737 >> v2:172.21.15.31:3300/0 conn(0x7f96340aef30 msgr2=0x7f96340adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9632d9d700 1 --2- 172.21.15.31:0/3089147737 >> v2:172.21.15.31:3300/0 conn(0x7f96340aef30 0x7f96340adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9632d9d700 1 -- 172.21.15.31:0/3089147737 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340ad430 con 0x7f96340af380 2024-08-17T02:24:57.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9631d9b700 1 --2- 172.21.15.31:0/3089147737 >> v2:172.21.15.31:3300/0 conn(0x7f96340aef30 0x7f96340adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:57.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9632d9d700 1 --2- 172.21.15.31:0/3089147737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96340af380 0x7f96340ae450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96340b0bc0 tx=0x7f962c007690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72f5bfca7c2fce33 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f963159a700 1 -- 172.21.15.31:0/3089147737 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c010070 con 0x7f96340af380 2024-08-17T02:24:57.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9328d13700 1 -- 172.21.15.31:0/760486172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93240cc6a0 msgr2=0x7f93240b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9328d13700 1 --2- 172.21.15.31:0/760486172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93240cc6a0 0x7f93240b0e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f93180098e0 tx=0x7f93180091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f963159a700 1 -- 172.21.15.31:0/3089147737 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c00dc80 con 0x7f96340af380 2024-08-17T02:24:57.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9328d13700 1 -- 172.21.15.31:0/760486172 shutdown_connections 2024-08-17T02:24:57.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.422+0000 7f9328d13700 1 --2- 172.21.15.31:0/760486172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93240cc6a0 0x7f93240b0e90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 -- 172.21.15.31:0/760486172 >> 172.21.15.31:0/760486172 conn(0x7f932406b330 msgr2=0x7f932406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f963159a700 1 -- 172.21.15.31:0/3089147737 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c007b40 con 0x7f96340af380 2024-08-17T02:24:57.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 -- 172.21.15.31:0/760486172 shutdown_connections 2024-08-17T02:24:57.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 -- 172.21.15.31:0/760486172 wait complete. 2024-08-17T02:24:57.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9638b3f700 1 -- 172.21.15.31:0/3089147737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96340af380 msgr2=0x7f96340ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9638b3f700 1 --2- 172.21.15.31:0/3089147737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96340af380 0x7f96340ae450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96340b0bc0 tx=0x7f962c007690 comp rx=0 tx=0).stop 2024-08-17T02:24:57.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9638b3f700 1 -- 172.21.15.31:0/3089147737 shutdown_connections 2024-08-17T02:24:57.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9638b3f700 1 --2- 172.21.15.31:0/3089147737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96340af380 0x7f96340ae450 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9638b3f700 1 --2- 172.21.15.31:0/3089147737 >> v2:172.21.15.31:3300/0 conn(0x7f96340aef30 0x7f96340adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9638b3f700 1 --2- 172.21.15.31:0/3089147737 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9634069120 0x7f96340694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9638b3f700 1 -- 172.21.15.31:0/3089147737 >> 172.21.15.31:0/3089147737 conn(0x7f963406b330 msgr2=0x7f963406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 Processor -- start 2024-08-17T02:24:57.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f8e4ca7a700 1 Processor -- start 2024-08-17T02:24:57.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 -- start start 2024-08-17T02:24:57.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9324069600 0x7f9324156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93240cc6a0 0x7f9324157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f8e4ca7a700 1 -- start start 2024-08-17T02:24:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93240cca70 0x7f9324152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9324159900 con 0x7f9324069600 2024-08-17T02:24:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932414e5f0 con 0x7f93240cca70 2024-08-17T02:24:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f9328d13700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9324153aa0 con 0x7f93240cc6a0 2024-08-17T02:24:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f8e4ca7a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e480af3b0 0x7f8e480adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f932259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9324069600 0x7f9324156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9321d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93240cc6a0 0x7f9324157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f932259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9324069600 0x7f9324156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48874/0 (socket says 172.21.15.31:48874) 2024-08-17T02:24:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f932259c700 1 -- 172.21.15.31:0/3666332078 learned_addr learned my addr 172.21.15.31:0/3666332078 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9638b3f700 1 -- 172.21.15.31:0/3089147737 shutdown_connections 2024-08-17T02:24:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f8e4ca7a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e480ada80 con 0x7f8e4806f390 2024-08-17T02:24:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f8e4ca7a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e48069830 con 0x7f8e480aef30 2024-08-17T02:24:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f8e4ca7a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e480ace70 con 0x7f8e480af3b0 2024-08-17T02:24:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.426+0000 7f8e46d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e480af3b0 0x7f8e480adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9322d9d700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93240cca70 0x7f9324152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e46d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e480af3b0 0x7f8e480adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48876/0 (socket says 172.21.15.31:48876) 2024-08-17T02:24:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e46d9d700 1 -- 172.21.15.31:0/2844077964 learned_addr learned my addr 172.21.15.31:0/2844077964 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e46d9d700 1 -- 172.21.15.31:0/2844077964 >> v1:172.21.15.92:6789/0 conn(0x7f8e480aef30 legacy=0x7f8e48069120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e46d9d700 1 -- 172.21.15.31:0/2844077964 >> v1:172.21.15.31:6789/0 conn(0x7f8e4806f390 legacy=0x7f8e48155950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e46d9d700 1 -- 172.21.15.31:0/2844077964 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e480ad150 con 0x7f8e480af3b0 2024-08-17T02:24:57.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9638b3f700 1 -- 172.21.15.31:0/3089147737 wait complete. 2024-08-17T02:24:57.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e46d9d700 1 --2- 172.21.15.31:0/2844077964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e480af3b0 0x7f8e480adf10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8e380099b0 tx=0x7f8e38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295f7d33d2ac391f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9321d9b700 1 -- 172.21.15.31:0/3666332078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93240cca70 msgr2=0x7f9324152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9321d9b700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93240cca70 0x7f9324152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9321d9b700 1 -- 172.21.15.31:0/3666332078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9324069600 msgr2=0x7f9324156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9321d9b700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9324069600 0x7f9324156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9321d9b700 1 -- 172.21.15.31:0/3666332078 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318009420 con 0x7f93240cc6a0 2024-08-17T02:24:57.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f932259c700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9324069600 0x7f9324156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:57.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e4559a700 1 -- 172.21.15.31:0/2844077964 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800b820 con 0x7f8e480af3b0 2024-08-17T02:24:57.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9321d9b700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93240cc6a0 0x7f9324157260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f931400cb60 tx=0x7f9314001010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e4559a700 1 -- 172.21.15.31:0/2844077964 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3800b980 con 0x7f8e480af3b0 2024-08-17T02:24:57.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e4559a700 1 -- 172.21.15.31:0/2844077964 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800bd00 con 0x7f8e480af3b0 2024-08-17T02:24:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f93127fc700 1 -- 172.21.15.31:0/3666332078 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400ce70 con 0x7f93240cc6a0 2024-08-17T02:24:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9328d13700 1 -- 172.21.15.31:0/3666332078 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9324153d80 con 0x7f93240cc6a0 2024-08-17T02:24:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9328d13700 1 -- 172.21.15.31:0/3666332078 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9324154340 con 0x7f93240cc6a0 2024-08-17T02:24:57.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f9638b3f700 1 Processor -- start 2024-08-17T02:24:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f93127fc700 1 -- 172.21.15.31:0/3666332078 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9314007360 con 0x7f93240cc6a0 2024-08-17T02:24:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f93127fc700 1 -- 172.21.15.31:0/3666332078 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314004830 con 0x7f93240cc6a0 2024-08-17T02:24:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f93127fc700 1 -- 172.21.15.31:0/3666332078 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9314004c20 con 0x7f93240cc6a0 2024-08-17T02:24:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/2844077964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e480af3b0 msgr2=0x7f8e480adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.430+0000 7f8e4ca7a700 1 --2- 172.21.15.31:0/2844077964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e480af3b0 0x7f8e480adf10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8e380099b0 tx=0x7f8e38009250 comp rx=0 tx=0).stop 2024-08-17T02:24:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f93127fc700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9304060860 0x7f9304062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f93127fc700 1 -- 172.21.15.31:0/3666332078 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f931407c080 con 0x7f93240cc6a0 2024-08-17T02:24:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f9638b3f700 1 -- start start 2024-08-17T02:24:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f932259c700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9304060860 0x7f9304062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f9638b3f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9634069120 0x7f9634157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f9638b3f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96340aef30 0x7f963414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f9638b3f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96340af380 0x7f963415b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f9638b3f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963414e1e0 con 0x7f9634069120 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f9638b3f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963414d350 con 0x7f96340aef30 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f9638b3f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963414d5d0 con 0x7f96340af380 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f963259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9634069120 0x7f9634157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f963259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9634069120 0x7f9634157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48890/0 (socket says 172.21.15.31:48890) 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f963259c700 1 -- 172.21.15.31:0/2016711936 learned_addr learned my addr 172.21.15.31:0/2016711936 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f9632d9d700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96340af380 0x7f963415b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f9631d9b700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96340aef30 0x7f963414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/2844077964 shutdown_connections 2024-08-17T02:24:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f932259c700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9304060860 0x7f9304062d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93180093c0 tx=0x7f9318017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f8e4ca7a700 1 --2- 172.21.15.31:0/2844077964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e480af3b0 0x7f8e480adf10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/2844077964 >> 172.21.15.31:0/2844077964 conn(0x7f8e4806b330 msgr2=0x7f8e4806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/2844077964 shutdown_connections 2024-08-17T02:24:57.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f963259c700 1 -- 172.21.15.31:0/2016711936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96340af380 msgr2=0x7f963415b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f963259c700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96340af380 0x7f963415b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f963259c700 1 -- 172.21.15.31:0/2016711936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96340aef30 msgr2=0x7f963414ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f963259c700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96340aef30 0x7f963414ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f963259c700 1 -- 172.21.15.31:0/2016711936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c00be70 con 0x7f9634069120 2024-08-17T02:24:57.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/2844077964 wait complete. 2024-08-17T02:24:57.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.434+0000 7f963259c700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9634069120 0x7f9634157700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f962400b810 tx=0x7f9624009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4ca7a700 1 Processor -- start 2024-08-17T02:24:57.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4ca7a700 1 -- start start 2024-08-17T02:24:57.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f9328d13700 1 -- 172.21.15.31:0/3666332078 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93080052b0 con 0x7f93240cc6a0 2024-08-17T02:24:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4ca7a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4806f390 0x7f8e48143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4ca7a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e480aef30 0x7f8e48145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4ca7a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e480af3b0 0x7f8e48152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4806f390 0x7f8e48143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4806f390 0x7f8e48143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48892/0 (socket says 172.21.15.31:48892) 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4ca7a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48146410 con 0x7f8e4806f390 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4ca7a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48157920 con 0x7f8e480aef30 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4ca7a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48156a70 con 0x7f8e480af3b0 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4659c700 1 -- 172.21.15.31:0/3870586266 learned_addr learned my addr 172.21.15.31:0/3870586266 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e45d9b700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e480aef30 0x7f8e48145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e46d9d700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e480af3b0 0x7f8e48152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4659c700 1 -- 172.21.15.31:0/3870586266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e480af3b0 msgr2=0x7f8e48152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4659c700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e480af3b0 0x7f8e48152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4659c700 1 -- 172.21.15.31:0/3870586266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e480aef30 msgr2=0x7f8e48145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4659c700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e480aef30 0x7f8e48145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4659c700 1 -- 172.21.15.31:0/3870586266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380094f0 con 0x7f8e4806f390 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e46d9d700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e480af3b0 0x7f8e48152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.438+0000 7f8e4659c700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4806f390 0x7f8e48143620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00b5e0 tx=0x7f8e3c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f8e367fc700 1 -- 172.21.15.31:0/3870586266 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00f510 con 0x7f8e4806f390 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f8e367fc700 1 -- 172.21.15.31:0/3870586266 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00f670 con 0x7f8e4806f390 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/3870586266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e48156d10 con 0x7f8e4806f390 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f8e367fc700 1 -- 172.21.15.31:0/3870586266 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00fa30 con 0x7f8e4806f390 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/3870586266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e48157350 con 0x7f8e4806f390 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f8e367fc700 1 -- 172.21.15.31:0/3870586266 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8e3c01a400 con 0x7f8e4806f390 2024-08-17T02:24:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f8e2ffff700 1 -- 172.21.15.31:0/3870586266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e481576d0 con 0x7f8e4806f390 2024-08-17T02:24:57.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f96227fc700 1 -- 172.21.15.31:0/2016711936 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962400f510 con 0x7f9634069120 2024-08-17T02:24:57.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f96227fc700 1 -- 172.21.15.31:0/2016711936 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962400f690 con 0x7f9634069120 2024-08-17T02:24:57.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f9638b3f700 1 -- 172.21.15.31:0/2016711936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963414d8b0 con 0x7f9634069120 2024-08-17T02:24:57.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f9638b3f700 1 -- 172.21.15.31:0/2016711936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963414de70 con 0x7f9634069120 2024-08-17T02:24:57.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.442+0000 7f96227fc700 1 -- 172.21.15.31:0/2016711936 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962400fa50 con 0x7f9634069120 2024-08-17T02:24:57.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.446+0000 7f8e367fc700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060b40 0x7f8e30062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.446+0000 7f8e367fc700 1 -- 172.21.15.31:0/3870586266 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e3c07c4f0 con 0x7f8e4806f390 2024-08-17T02:24:57.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.446+0000 7f8e45d9b700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060b40 0x7f8e30062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.446+0000 7f8e45d9b700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060b40 0x7f8e30062ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8e481466c0 tx=0x7f8e400016f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.446+0000 7f9638b3f700 1 -- 172.21.15.31:0/2016711936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96180052b0 con 0x7f9634069120 2024-08-17T02:24:57.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.450+0000 7f93127fc700 1 -- 172.21.15.31:0/3666332078 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f931404b480 con 0x7f93240cc6a0 2024-08-17T02:24:57.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.450+0000 7f8e367fc700 1 -- 172.21.15.31:0/3870586266 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8e3c050530 con 0x7f8e4806f390 2024-08-17T02:24:57.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.454+0000 7f96227fc700 1 -- 172.21.15.31:0/2016711936 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9624024430 con 0x7f9634069120 2024-08-17T02:24:57.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.454+0000 7f96227fc700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9614060930 0x7f9614062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.454+0000 7f96227fc700 1 -- 172.21.15.31:0/2016711936 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f962407d1b0 con 0x7f9634069120 2024-08-17T02:24:57.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.454+0000 7f9631d9b700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9614060930 0x7f9614062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.454+0000 7f9631d9b700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9614060930 0x7f9614062de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9634158440 tx=0x7f9628008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.458+0000 7f96227fc700 1 -- 172.21.15.31:0/2016711936 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f962404d660 con 0x7f9634069120 2024-08-17T02:24:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b425e1700 1 Processor -- start 2024-08-17T02:24:57.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b425e1700 1 -- start start 2024-08-17T02:24:57.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec95b23700 1 Processor -- start 2024-08-17T02:24:57.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec95b23700 1 -- start start 2024-08-17T02:24:57.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b425e1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8b3c068b20 0x7f8b3c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b425e1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3c0b0f50 con 0x7f8b3c160c10 2024-08-17T02:24:57.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b425e1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3c0b0340 con 0x7f8b3c160840 2024-08-17T02:24:57.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b425e1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c0ca2f0 con 0x7f8b3c068b20 2024-08-17T02:24:57.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b41de0700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8b3c160c10 0x7f8b3c0cadc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58490/0 (socket says 172.21.15.31:58490) 2024-08-17T02:24:57.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b41de0700 1 -- 172.21.15.31:0/3872817101 learned_addr learned my addr 172.21.15.31:0/3872817101 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec95b23700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec90159220 0x7fec90068f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec95b23700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec900694c0 0x7fec900a9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec95b23700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fec900a9dc0 0x7fec900aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec95b23700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9015cf70 con 0x7fec90159220 2024-08-17T02:24:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec95b23700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9015d810 con 0x7fec900a9dc0 2024-08-17T02:24:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec95b23700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec900698f0 con 0x7fec900694c0 2024-08-17T02:24:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039379411 0 0) 0x7f8b3c0b0f50 con 0x7f8b3c160c10 2024-08-17T02:24:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec94b21700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec90159220 0x7fec90068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec94b21700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec90159220 0x7fec90068f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48906/0 (socket says 172.21.15.31:48906) 2024-08-17T02:24:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec94b21700 1 -- 172.21.15.31:0/3704721129 learned_addr learned my addr 172.21.15.31:0/3704721129 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b28003570 con 0x7f8b3c160c10 2024-08-17T02:24:57.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b40dde700 1 --2- 172.21.15.31:0/3872817101 >> v2:172.21.15.92:3300/0 conn(0x7f8b3c068b20 0x7f8b3c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec8ffff700 1 --2- 172.21.15.31:0/3704721129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec900694c0 0x7fec900a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec95322700 1 --2- 172.21.15.31:0/3704721129 >> v2:172.21.15.92:3300/0 conn(0x7fec900a9dc0 0x7fec900aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463348744 0 0) 0x7f8b28003570 con 0x7f8b3c160c10 2024-08-17T02:24:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 >> v2:172.21.15.92:3300/0 conn(0x7f8b3c068b20 msgr2=0x7f8b3c0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 --2- 172.21.15.31:0/3872817101 >> v2:172.21.15.92:3300/0 conn(0x7f8b3c068b20 0x7f8b3c0afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 >> v1:172.21.15.92:6789/0 conn(0x7f8b3c160840 legacy=0x7f8b3c068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c0b0620 con 0x7f8b3c160c10 2024-08-17T02:24:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f8b340017f0 con 0x7f8b3c160c10 2024-08-17T02:24:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 >> v1:172.21.15.31:6789/0 conn(0x7f8b3c160c10 legacy=0x7f8b3c0cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 0x7f8b28003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b28004810 0x7f8b28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b280053c0 0x7f8b2800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0ca2f0 con 0x7f8b28004810 2024-08-17T02:24:57.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2800c250 con 0x7f8b28003a90 2024-08-17T02:24:57.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2800c410 con 0x7f8b280053c0 2024-08-17T02:24:57.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec94b21700 1 -- 172.21.15.31:0/3704721129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec900694c0 msgr2=0x7fec900a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec94b21700 1 --2- 172.21.15.31:0/3704721129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec900694c0 0x7fec900a9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec94b21700 1 -- 172.21.15.31:0/3704721129 >> v2:172.21.15.92:3300/0 conn(0x7fec900a9dc0 msgr2=0x7fec900aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec94b21700 1 --2- 172.21.15.31:0/3704721129 >> v2:172.21.15.92:3300/0 conn(0x7fec900a9dc0 0x7fec900aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec94b21700 1 -- 172.21.15.31:0/3704721129 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec900aa5b0 con 0x7fec90159220 2024-08-17T02:24:57.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b40dde700 1 --2- 172.21.15.31:0/3872817101 >> v2:172.21.15.92:3300/0 conn(0x7f8b3c068b20 0x7f8b3c0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:57.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b415df700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 0x7f8b28003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b40dde700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b28004810 0x7f8b28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7f8b41de0700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b280053c0 0x7f8b2800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.482+0000 7fec94b21700 1 --2- 172.21.15.31:0/3704721129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec90159220 0x7fec90068f80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fec900b1970 tx=0x7fec80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ca66a6d70a8c2e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7fec8f7fe700 1 -- 172.21.15.31:0/3704721129 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8000b640 con 0x7fec90159220 2024-08-17T02:24:57.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7fec8f7fe700 1 -- 172.21.15.31:0/3704721129 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8000b7a0 con 0x7fec90159220 2024-08-17T02:24:57.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7fec8f7fe700 1 -- 172.21.15.31:0/3704721129 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8000bb60 con 0x7fec90159220 2024-08-17T02:24:57.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b415df700 1 -- 172.21.15.31:0/3872817101 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b280053c0 msgr2=0x7f8b2800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b415df700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b280053c0 0x7f8b2800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b415df700 1 -- 172.21.15.31:0/3872817101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b28004810 msgr2=0x7f8b28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b415df700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b28004810 0x7f8b28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b415df700 1 -- 172.21.15.31:0/3872817101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28003570 con 0x7f8b28003a90 2024-08-17T02:24:57.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b41de0700 1 -- 172.21.15.31:0/3872817101 reap_dead start 2024-08-17T02:24:57.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b415df700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 0x7f8b28003e60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0019a0 tx=0x7f8b2c007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecc44ba1e37587d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c00c5d0 con 0x7f8b28003a90 2024-08-17T02:24:57.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c00c750 con 0x7f8b28003a90 2024-08-17T02:24:57.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b33fff700 1 -- 172.21.15.31:0/3872817101 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c00cb10 con 0x7f8b28003a90 2024-08-17T02:24:57.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7fec95b23700 1 -- 172.21.15.31:0/3704721129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec90159220 msgr2=0x7fec90068f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7fec95b23700 1 --2- 172.21.15.31:0/3704721129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec90159220 0x7fec90068f80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fec900b1970 tx=0x7fec80009250 comp rx=0 tx=0).stop 2024-08-17T02:24:57.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b425e1700 1 -- 172.21.15.31:0/3872817101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 msgr2=0x7f8b28003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b425e1700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 0x7f8b28003e60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0019a0 tx=0x7f8b2c007d10 comp rx=0 tx=0).stop 2024-08-17T02:24:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b425e1700 1 -- 172.21.15.31:0/3872817101 shutdown_connections 2024-08-17T02:24:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b425e1700 1 --2- 172.21.15.31:0/3872817101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 0x7f8b28003e60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b425e1700 1 -- 172.21.15.31:0/3872817101 >> 172.21.15.31:0/3872817101 conn(0x7f8b3c069ab0 msgr2=0x7f8b3c069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b425e1700 1 -- 172.21.15.31:0/3872817101 shutdown_connections 2024-08-17T02:24:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b425e1700 1 -- 172.21.15.31:0/3872817101 wait complete. 2024-08-17T02:24:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b425e1700 1 Processor -- start 2024-08-17T02:24:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.486+0000 7f8b425e1700 1 -- start start 2024-08-17T02:24:57.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7fec95b23700 1 -- 172.21.15.31:0/3704721129 shutdown_connections 2024-08-17T02:24:57.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7fec95b23700 1 --2- 172.21.15.31:0/3704721129 >> v2:172.21.15.92:3300/0 conn(0x7fec900a9dc0 0x7fec900aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7fec95b23700 1 --2- 172.21.15.31:0/3704721129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec900694c0 0x7fec900a9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7fec95b23700 1 --2- 172.21.15.31:0/3704721129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec90159220 0x7fec90068f80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7fec95b23700 1 -- 172.21.15.31:0/3704721129 >> 172.21.15.31:0/3704721129 conn(0x7fec90067400 msgr2=0x7fec90067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7fec95b23700 1 -- 172.21.15.31:0/3704721129 shutdown_connections 2024-08-17T02:24:57.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f101d8b4700 1 Processor -- start 2024-08-17T02:24:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f101d8b4700 1 -- start start 2024-08-17T02:24:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b425e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 0x7f8b3c1426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b425e1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b3c06ed40 0x7f8b3c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b425e1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b3c15e790 0x7f8b3c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b425e1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0b0160 con 0x7f8b3c15e790 2024-08-17T02:24:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b425e1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c06f6f0 con 0x7f8b28003a90 2024-08-17T02:24:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b425e1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c15f4e0 con 0x7f8b3c06ed40 2024-08-17T02:24:57.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7fec95b23700 1 -- 172.21.15.31:0/3704721129 wait complete. 2024-08-17T02:24:57.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b41de0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b3c15e790 0x7f8b3c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b41de0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b3c15e790 0x7f8b3c15ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48926/0 (socket says 172.21.15.31:48926) 2024-08-17T02:24:57.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b41de0700 1 -- 172.21.15.31:0/3381650165 learned_addr learned my addr 172.21.15.31:0/3381650165 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b415df700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 0x7f8b3c1426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f101d8b4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10181570c0 0x7f10180b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f101d8b4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1018157510 0x7f10180b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f101d8b4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10180ca8e0 con 0x7f1018156cf0 2024-08-17T02:24:57.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f101d8b4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10180c9cd0 con 0x7f1018157510 2024-08-17T02:24:57.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f101d8b4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10180c9fb0 con 0x7f10181570c0 2024-08-17T02:24:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b41de0700 1 -- 172.21.15.31:0/3381650165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b3c06ed40 msgr2=0x7f8b3c06f1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:24:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b41de0700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b3c06ed40 0x7f8b3c06f1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b41de0700 1 -- 172.21.15.31:0/3381650165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 msgr2=0x7f8b3c1426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b41de0700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 0x7f8b3c1426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b41de0700 1 -- 172.21.15.31:0/3381650165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c153c30 con 0x7f8b3c15e790 2024-08-17T02:24:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f10167fc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10181570c0 0x7f10180b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f1016ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1018156cf0 0x7f101815b540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:49084/0 (socket says 172.21.15.31:49084) 2024-08-17T02:24:57.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f1016ffd700 1 -- 172.21.15.31:0/1679969944 learned_addr learned my addr 172.21.15.31:0/1679969944 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:57.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b41de0700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b3c15e790 0x7f8b3c15ebe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0b0ec0 tx=0x7f8b34002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f1015ffb700 1 -- 172.21.15.31:0/1679969944 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253200151 0 0) 0x7f10180ca8e0 con 0x7f1018156cf0 2024-08-17T02:24:57.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f1015ffb700 1 -- 172.21.15.31:0/1679969944 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1000003570 con 0x7f1018156cf0 2024-08-17T02:24:57.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b317fa700 1 -- 172.21.15.31:0/3381650165 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3400ac90 con 0x7f8b3c15e790 2024-08-17T02:24:57.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b317fa700 1 -- 172.21.15.31:0/3381650165 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3400ae10 con 0x7f8b3c15e790 2024-08-17T02:24:57.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b425e1700 1 -- 172.21.15.31:0/3381650165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c153f10 con 0x7f8b3c15e790 2024-08-17T02:24:57.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b317fa700 1 -- 172.21.15.31:0/3381650165 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34013640 con 0x7f8b3c15e790 2024-08-17T02:24:57.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f10167fc700 1 -- 172.21.15.31:0/1679969944 >> v2:172.21.15.92:3300/0 conn(0x7f1018157510 msgr2=0x7f10180b16a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f10167fc700 1 --2- 172.21.15.31:0/1679969944 >> v2:172.21.15.92:3300/0 conn(0x7f1018157510 0x7f10180b16a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f10167fc700 1 -- 172.21.15.31:0/1679969944 >> v1:172.21.15.92:6789/0 conn(0x7f1018156cf0 legacy=0x7f101815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f10167fc700 1 -- 172.21.15.31:0/1679969944 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10180ca290 con 0x7f10181570c0 2024-08-17T02:24:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7f8b425e1700 1 -- 172.21.15.31:0/3381650165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c1544d0 con 0x7f8b3c15e790 2024-08-17T02:24:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7fec95b23700 1 Processor -- start 2024-08-17T02:24:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.490+0000 7fec95b23700 1 -- start start 2024-08-17T02:24:57.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f10167fc700 1 --2- 172.21.15.31:0/1679969944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10181570c0 0x7f10180b1160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1010009e60 tx=0x7f1010009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4da7b810c5acfc85 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec95b23700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec900694c0 0x7fec9015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec95b23700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec900a9dc0 0x7fec9006dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec95b23700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec90159220 0x7fec90155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec95b23700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec900b0b40 con 0x7fec900694c0 2024-08-17T02:24:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec95b23700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9015f360 con 0x7fec90159220 2024-08-17T02:24:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec95b23700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec900aff30 con 0x7fec900a9dc0 2024-08-17T02:24:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec94b21700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec900694c0 0x7fec9015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec94b21700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec900694c0 0x7fec9015ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48940/0 (socket says 172.21.15.31:48940) 2024-08-17T02:24:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec94b21700 1 -- 172.21.15.31:0/115913203 learned_addr learned my addr 172.21.15.31:0/115913203 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec8ffff700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec900a9dc0 0x7fec9006dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec95322700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec90159220 0x7fec90155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec94b21700 1 -- 172.21.15.31:0/115913203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec900a9dc0 msgr2=0x7fec9006dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f1015ffb700 1 -- 172.21.15.31:0/1679969944 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101000e070 con 0x7f10181570c0 2024-08-17T02:24:57.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec94b21700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec900a9dc0 0x7fec9006dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f1015ffb700 1 -- 172.21.15.31:0/1679969944 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101000bb60 con 0x7f10181570c0 2024-08-17T02:24:57.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f1015ffb700 1 -- 172.21.15.31:0/1679969944 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1010012430 con 0x7f10181570c0 2024-08-17T02:24:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec94b21700 1 -- 172.21.15.31:0/115913203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec90159220 msgr2=0x7fec90155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec94b21700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec90159220 0x7fec90155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec94b21700 1 -- 172.21.15.31:0/115913203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800094f0 con 0x7fec900694c0 2024-08-17T02:24:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec95322700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec90159220 0x7fec90155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec94b21700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec900694c0 0x7fec9015ee20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fec9006cb90 tx=0x7fec80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec8cff9700 1 -- 172.21.15.31:0/115913203 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80000c40 con 0x7fec900694c0 2024-08-17T02:24:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec8cff9700 1 -- 172.21.15.31:0/115913203 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8000b910 con 0x7fec900694c0 2024-08-17T02:24:57.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f8b317fa700 1 -- 172.21.15.31:0/3381650165 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8b34013a30 con 0x7f8b3c15e790 2024-08-17T02:24:57.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f101d8b4700 1 -- 172.21.15.31:0/1679969944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10181570c0 msgr2=0x7f10180b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f101d8b4700 1 --2- 172.21.15.31:0/1679969944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10181570c0 0x7f10180b1160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1010009e60 tx=0x7f1010009780 comp rx=0 tx=0).stop 2024-08-17T02:24:57.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec8cff9700 1 -- 172.21.15.31:0/115913203 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80025420 con 0x7fec900694c0 2024-08-17T02:24:57.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec95b23700 1 -- 172.21.15.31:0/115913203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec900b0210 con 0x7fec900694c0 2024-08-17T02:24:57.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f8b317fa700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8b200608e0 0x7f8b20062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f8b317fa700 1 -- 172.21.15.31:0/3381650165 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b3407ed00 con 0x7f8b3c15e790 2024-08-17T02:24:57.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f8b415df700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8b200608e0 0x7f8b20062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f101d8b4700 1 -- 172.21.15.31:0/1679969944 shutdown_connections 2024-08-17T02:24:57.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f101d8b4700 1 --2- 172.21.15.31:0/1679969944 >> v2:172.21.15.92:3300/0 conn(0x7f1018157510 0x7f10180b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f101d8b4700 1 --2- 172.21.15.31:0/1679969944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10181570c0 0x7f10180b1160 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f101d8b4700 1 -- 172.21.15.31:0/1679969944 >> 172.21.15.31:0/1679969944 conn(0x7f101806b330 msgr2=0x7f101806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7fec95b23700 1 -- 172.21.15.31:0/115913203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec900b07d0 con 0x7fec900694c0 2024-08-17T02:24:57.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f8b26ffd700 1 -- 172.21.15.31:0/3381650165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c1546f0 con 0x7f8b3c15e790 2024-08-17T02:24:57.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.494+0000 7f8b415df700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8b200608e0 0x7f8b20062d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0019a0 tx=0x7f8b2c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.498+0000 7f101d8b4700 1 -- 172.21.15.31:0/1679969944 shutdown_connections 2024-08-17T02:24:57.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.498+0000 7fec95b23700 1 -- 172.21.15.31:0/115913203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec900712b0 con 0x7fec900694c0 2024-08-17T02:24:57.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.498+0000 7fec8cff9700 1 -- 172.21.15.31:0/115913203 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fec80023070 con 0x7fec900694c0 2024-08-17T02:24:57.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.498+0000 7fec8cff9700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fec74060860 0x7fec74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.498+0000 7fec8cff9700 1 -- 172.21.15.31:0/115913203 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec8007dde0 con 0x7fec900694c0 2024-08-17T02:24:57.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.498+0000 7fec8ffff700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fec74060860 0x7fec74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.498+0000 7fec8ffff700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fec74060860 0x7fec74062d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec9006f2a0 tx=0x7fec840091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.502+0000 7f101d8b4700 1 -- 172.21.15.31:0/1679969944 wait complete. 2024-08-17T02:24:57.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.502+0000 7f1ad759e700 1 Processor -- start 2024-08-17T02:24:57.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.502+0000 7f8152d8a700 1 Processor -- start 2024-08-17T02:24:57.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.502+0000 7f1ad759e700 1 -- start start 2024-08-17T02:24:57.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.502+0000 7f8152d8a700 1 -- start start 2024-08-17T02:24:57.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.502+0000 7f101d8b4700 1 Processor -- start 2024-08-17T02:24:57.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.502+0000 7f8152d8a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f814c157010 0x7f814c0b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.502+0000 7f8152d8a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814c0aca40 con 0x7f814c1583f0 2024-08-17T02:24:57.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.502+0000 7f8152d8a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814c0abe30 con 0x7f814c0b14b0 2024-08-17T02:24:57.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8152d8a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814c0aced0 con 0x7f814c157010 2024-08-17T02:24:57.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad759e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1ad80691b0 0x7f1ad8069580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8152589700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f814c1583f0 0x7f814c0c97a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58500/0 (socket says 172.21.15.31:58500) 2024-08-17T02:24:57.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8152589700 1 -- 172.21.15.31:0/49766396 learned_addr learned my addr 172.21.15.31:0/49766396 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:57.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad659c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1ad80691b0 0x7f1ad8069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8b317fa700 1 -- 172.21.15.31:0/3381650165 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8b34082060 con 0x7f8b3c15e790 2024-08-17T02:24:57.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad659c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1ad80691b0 0x7f1ad8069580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:58202/0 (socket says 172.21.15.31:58202) 2024-08-17T02:24:57.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad659c700 1 -- 172.21.15.31:0/2323233367 learned_addr learned my addr 172.21.15.31:0/2323233367 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.502+0000 7f101d8b4700 1 -- start start 2024-08-17T02:24:57.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f101d8b4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1018156cf0 0x7f1018171870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f101d8b4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10181570c0 0x7f101816d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f101d8b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018157510 0x7f1018167650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f101d8b4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1018171db0 con 0x7f10181570c0 2024-08-17T02:24:57.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f101d8b4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101814b9a0 con 0x7f1018157510 2024-08-17T02:24:57.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f101d8b4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101814d2a0 con 0x7f1018156cf0 2024-08-17T02:24:57.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1016ffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1018156cf0 0x7f1018171870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad759e700 1 -- 172.21.15.31:0/2323233367 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad80add90 con 0x7f1ad80b0480 2024-08-17T02:24:57.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1016ffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1018156cf0 0x7f1018171870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:41430/0 (socket says 172.21.15.31:41430) 2024-08-17T02:24:57.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1016ffd700 1 -- 172.21.15.31:0/3873530515 learned_addr learned my addr 172.21.15.31:0/3873530515 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad759e700 1 -- 172.21.15.31:0/2323233367 --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad815ab70 con 0x7f1ad80ad930 2024-08-17T02:24:57.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad759e700 1 -- 172.21.15.31:0/2323233367 --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80b0910 con 0x7f1ad80691b0 2024-08-17T02:24:57.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8151d88700 1 --2- 172.21.15.31:0/49766396 >> v2:172.21.15.92:3300/0 conn(0x7f814c157010 0x7f814c0b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f10167fc700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10181570c0 0x7f101816d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad659c700 1 -- 172.21.15.31:0/2323233367 >> v1:172.21.15.92:6789/0 conn(0x7f1ad80ad930 legacy=0x7f1ad80afd70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:24:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad659c700 1 -- 172.21.15.31:0/2323233367 >> v1:172.21.15.31:6789/0 conn(0x7f1ad80b0480 legacy=0x7f1ad813f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f10177fe700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018157510 0x7f1018167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1016ffd700 1 -- 172.21.15.31:0/3873530515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018157510 msgr2=0x7f1018167650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1016ffd700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018157510 0x7f1018167650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1016ffd700 1 -- 172.21.15.31:0/3873530515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10181570c0 msgr2=0x7f101816d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1016ffd700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10181570c0 0x7f101816d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1016ffd700 1 -- 172.21.15.31:0/3873530515 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010009a20 con 0x7f1018156cf0 2024-08-17T02:24:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad659c700 1 -- 172.21.15.31:0/2323233367 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad80acb70 con 0x7f1ad80691b0 2024-08-17T02:24:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1016ffd700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1018156cf0 0x7f1018171870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c7c0 tx=0x7f100c007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8150d86700 1 -- 172.21.15.31:0/49766396 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438386800 0 0) 0x7f814c0abe30 con 0x7f814c0b14b0 2024-08-17T02:24:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8150d86700 1 -- 172.21.15.31:0/49766396 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8138003570 con 0x7f814c0b14b0 2024-08-17T02:24:57.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f1ad659c700 1 --2- 172.21.15.31:0/2323233367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad80691b0 0x7f1ad8069580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80099e0 tx=0x7f1ac8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2154708fdbdf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f0ffeffd700 1 -- 172.21.15.31:0/3873530515 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c005b30 con 0x7f1018156cf0 2024-08-17T02:24:57.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f0ffeffd700 1 -- 172.21.15.31:0/3873530515 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c005c90 con 0x7f1018156cf0 2024-08-17T02:24:57.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f101d8b4700 1 -- 172.21.15.31:0/3873530515 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101816dd10 con 0x7f1018156cf0 2024-08-17T02:24:57.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f101d8b4700 1 -- 172.21.15.31:0/3873530515 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101816e270 con 0x7f1018156cf0 2024-08-17T02:24:57.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8151d88700 1 -- 172.21.15.31:0/49766396 >> v1:172.21.15.92:6789/0 conn(0x7f814c0b14b0 legacy=0x7f814c0caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8151d88700 1 -- 172.21.15.31:0/49766396 >> v1:172.21.15.31:6789/0 conn(0x7f814c1583f0 legacy=0x7f814c0c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8151d88700 1 -- 172.21.15.31:0/49766396 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c0ac110 con 0x7f814c157010 2024-08-17T02:24:57.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8151d88700 1 --2- 172.21.15.31:0/49766396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c157010 0x7f814c0b0f70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8144009e60 tx=0x7f8144009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e36d183690f09eac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f0ffeffd700 1 -- 172.21.15.31:0/3873530515 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c007320 con 0x7f1018156cf0 2024-08-17T02:24:57.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8150d86700 1 -- 172.21.15.31:0/49766396 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400e070 con 0x7f814c157010 2024-08-17T02:24:57.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8150d86700 1 -- 172.21.15.31:0/49766396 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814400bb60 con 0x7f814c157010 2024-08-17T02:24:57.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.506+0000 7f8150d86700 1 -- 172.21.15.31:0/49766396 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8144012430 con 0x7f814c157010 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 -- 172.21.15.31:0/49766396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c157010 msgr2=0x7f814c0b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 --2- 172.21.15.31:0/49766396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c157010 0x7f814c0b0f70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8144009e60 tx=0x7f8144009780 comp rx=0 tx=0).stop 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 -- 172.21.15.31:0/49766396 shutdown_connections 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 --2- 172.21.15.31:0/49766396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c157010 0x7f814c0b0f70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 -- 172.21.15.31:0/49766396 >> 172.21.15.31:0/49766396 conn(0x7f814c067400 msgr2=0x7f814c067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 -- 172.21.15.31:0/49766396 shutdown_connections 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 -- 172.21.15.31:0/49766396 wait complete. 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 Processor -- start 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 -- start start 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c0b14b0 0x7f814c14bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f814c157010 0x7f814c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814c1583f0 0x7f814c0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c0b0d70 con 0x7f814c157010 2024-08-17T02:24:57.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c14c800 con 0x7f814c0b14b0 2024-08-17T02:24:57.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f8152d8a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814c14c050 con 0x7f814c1583f0 2024-08-17T02:24:57.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f0ffeffd700 1 -- 172.21.15.31:0/3873530515 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f100c01b3b0 con 0x7f1018156cf0 2024-08-17T02:24:57.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f0ffeffd700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1004060890 0x7f1004062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.510+0000 7f0ffeffd700 1 -- 172.21.15.31:0/3873530515 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f100c07c100 con 0x7f1018156cf0 2024-08-17T02:24:57.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f10167fc700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1004060890 0x7f1004062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f1ad559a700 1 -- 172.21.15.31:0/2323233367 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800b7e0 con 0x7f1ad80691b0 2024-08-17T02:24:57.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f1ad559a700 1 -- 172.21.15.31:0/2323233367 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac800b940 con 0x7f1ad80691b0 2024-08-17T02:24:57.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f1ad559a700 1 -- 172.21.15.31:0/2323233367 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800bce0 con 0x7f1ad80691b0 2024-08-17T02:24:57.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8152589700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814c1583f0 0x7f814c0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8152589700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814c1583f0 0x7f814c0af2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:41442/0 (socket says 172.21.15.31:41442) 2024-08-17T02:24:57.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8152589700 1 -- 172.21.15.31:0/274904518 learned_addr learned my addr 172.21.15.31:0/274904518 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8151587700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f814c157010 0x7f814c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f10167fc700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1004060890 0x7f1004062d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f10100097c0 tx=0x7f1010019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8151587700 1 -- 172.21.15.31:0/274904518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814c1583f0 msgr2=0x7f814c0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8151587700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814c1583f0 0x7f814c0af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8151587700 1 -- 172.21.15.31:0/274904518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c0b14b0 msgr2=0x7f814c14bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8151587700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c0b14b0 0x7f814c14bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8151587700 1 -- 172.21.15.31:0/274904518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144009a20 con 0x7f814c157010 2024-08-17T02:24:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f1ad759e700 1 -- 172.21.15.31:0/2323233367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad80691b0 msgr2=0x7f1ad8069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f1ad759e700 1 --2- 172.21.15.31:0/2323233367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad80691b0 0x7f1ad8069580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80099e0 tx=0x7f1ac8009250 comp rx=0 tx=0).stop 2024-08-17T02:24:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8151587700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f814c157010 0x7f814c0aed60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f813c00c590 tx=0x7f813c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7fec8cff9700 1 -- 172.21.15.31:0/115913203 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fec8004e230 con 0x7fec900694c0 2024-08-17T02:24:57.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8141ffb700 1 -- 172.21.15.31:0/274904518 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c010510 con 0x7f814c157010 2024-08-17T02:24:57.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8141ffb700 1 -- 172.21.15.31:0/274904518 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c010690 con 0x7f814c157010 2024-08-17T02:24:57.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8152d8a700 1 -- 172.21.15.31:0/274904518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814c0aaf80 con 0x7f814c157010 2024-08-17T02:24:57.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.514+0000 7f8152d8a700 1 -- 172.21.15.31:0/274904518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814c0aaca0 con 0x7f814c157010 2024-08-17T02:24:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.518+0000 7f101d8b4700 1 -- 172.21.15.31:0/3873530515 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff80052b0 con 0x7f1018156cf0 2024-08-17T02:24:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.518+0000 7f8141ffb700 1 -- 172.21.15.31:0/274904518 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c010a50 con 0x7f814c157010 2024-08-17T02:24:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.518+0000 7f8141ffb700 1 -- 172.21.15.31:0/274904518 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f813c01b400 con 0x7f814c157010 2024-08-17T02:24:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.518+0000 7f8141ffb700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8138060ea0 0x7f8138063350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.518+0000 7f8141ffb700 1 -- 172.21.15.31:0/274904518 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f813c07c750 con 0x7f814c157010 2024-08-17T02:24:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.518+0000 7f8151d88700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8138060ea0 0x7f8138063350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.518+0000 7f8151d88700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8138060ea0 0x7f8138063350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f814c0aa8b0 tx=0x7f8144019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.518+0000 7f1ad759e700 1 -- 172.21.15.31:0/2323233367 shutdown_connections 2024-08-17T02:24:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.518+0000 7f1ad759e700 1 --2- 172.21.15.31:0/2323233367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad80691b0 0x7f1ad8069580 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.518+0000 7f1ad759e700 1 -- 172.21.15.31:0/2323233367 >> 172.21.15.31:0/2323233367 conn(0x7f1ad8067400 msgr2=0x7f1ad80677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad759e700 1 -- 172.21.15.31:0/2323233367 shutdown_connections 2024-08-17T02:24:57.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad759e700 1 -- 172.21.15.31:0/2323233367 wait complete. 2024-08-17T02:24:57.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f8152d8a700 1 -- 172.21.15.31:0/274904518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c0052b0 con 0x7f814c157010 2024-08-17T02:24:57.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f0ffeffd700 1 -- 172.21.15.31:0/3873530515 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f100c04c550 con 0x7f1018156cf0 2024-08-17T02:24:57.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad759e700 1 Processor -- start 2024-08-17T02:24:57.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad759e700 1 -- start start 2024-08-17T02:24:57.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad80691b0 0x7f1ad8133a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ad80ad930 0x7f1ad8159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad80b0480 0x7f1ad814d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad759e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8150790 con 0x7f1ad80691b0 2024-08-17T02:24:57.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad759e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8168f60 con 0x7f1ad80b0480 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad759e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad814fef0 con 0x7f1ad80ad930 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad80691b0 0x7f1ad8133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad80691b0 0x7f1ad8133a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48968/0 (socket says 172.21.15.31:48968) 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.526+0000 7f1ad659c700 1 -- 172.21.15.31:0/585522031 learned_addr learned my addr 172.21.15.31:0/585522031 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.530+0000 7f1ad5d9b700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ad80ad930 0x7f1ad8159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.530+0000 7f1ad659c700 1 -- 172.21.15.31:0/585522031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ad80ad930 msgr2=0x7f1ad8159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.530+0000 7f1ad659c700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ad80ad930 0x7f1ad8159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.530+0000 7f1ad659c700 1 -- 172.21.15.31:0/585522031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad80b0480 msgr2=0x7f1ad814d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.530+0000 7f1ad6d9d700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad80b0480 0x7f1ad814d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.530+0000 7f1ad659c700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad80b0480 0x7f1ad814d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.530+0000 7f1ad659c700 1 -- 172.21.15.31:0/585522031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac80094f0 con 0x7f1ad80691b0 2024-08-17T02:24:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.530+0000 7f1ad6d9d700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad80b0480 0x7f1ad814d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:57.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.530+0000 7f1ad659c700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad80691b0 0x7f1ad8133a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009290 tx=0x7f1ac8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.534+0000 7f1ac67fc700 1 -- 172.21.15.31:0/585522031 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8011ea0 con 0x7f1ad80691b0 2024-08-17T02:24:57.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.534+0000 7f1ac67fc700 1 -- 172.21.15.31:0/585522031 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac801a640 con 0x7f1ad80691b0 2024-08-17T02:24:57.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.534+0000 7f1ad759e700 1 -- 172.21.15.31:0/585522031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad81501d0 con 0x7f1ad80691b0 2024-08-17T02:24:57.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.534+0000 7f1ad759e700 1 -- 172.21.15.31:0/585522031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad814fb10 con 0x7f1ad80691b0 2024-08-17T02:24:57.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.534+0000 7f1ac67fc700 1 -- 172.21.15.31:0/585522031 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac801a9e0 con 0x7f1ad80691b0 2024-08-17T02:24:57.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.534+0000 7f8141ffb700 1 -- 172.21.15.31:0/274904518 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f813c04cc00 con 0x7f814c157010 2024-08-17T02:24:57.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.538+0000 7f1ac67fc700 1 -- 172.21.15.31:0/585522031 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1ac802e450 con 0x7f1ad80691b0 2024-08-17T02:24:57.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.538+0000 7f1ac67fc700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ab8060930 0x7f1ab8062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.538+0000 7f1ac67fc700 1 -- 172.21.15.31:0/585522031 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ac807e870 con 0x7f1ad80691b0 2024-08-17T02:24:57.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.542+0000 7f1ad759e700 1 -- 172.21.15.31:0/585522031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad8168d30 con 0x7f1ad80691b0 2024-08-17T02:24:57.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.542+0000 7f1ad5d9b700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ab8060930 0x7f1ab8062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.550+0000 7f1ad5d9b700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ab8060930 0x7f1ab8062de0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ad813e0c0 tx=0x7f1acc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.550+0000 7f1ac67fc700 1 -- 172.21.15.31:0/585522031 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1ac804eca0 con 0x7f1ad80691b0 2024-08-17T02:24:57.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.762+0000 7f8e2ffff700 1 -- 172.21.15.31:0/3870586266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8e480712b0 con 0x7f8e4806f390 2024-08-17T02:24:57.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.762+0000 7f8e367fc700 1 -- 172.21.15.31:0/3870586266 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e3c0500c0 con 0x7f8e4806f390 2024-08-17T02:24:57.772 INFO:teuthology.orchestra.run.smithi031.stdout:64424509449 2024-08-17T02:24:57.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.766+0000 7f9328d13700 1 -- 172.21.15.31:0/3666332078 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9308005830 con 0x7f93240cc6a0 2024-08-17T02:24:57.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.766+0000 7f93127fc700 1 -- 172.21.15.31:0/3666332078 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9314018020 con 0x7f93240cc6a0 2024-08-17T02:24:57.776 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-08-17T02:24:57.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.770+0000 7f9638b3f700 1 -- 172.21.15.31:0/2016711936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9618005830 con 0x7f9634069120 2024-08-17T02:24:57.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/3870586266 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060b40 msgr2=0x7f8e30062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060b40 0x7f8e30062ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8e481466c0 tx=0x7f8e400016f0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/3870586266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4806f390 msgr2=0x7f8e48143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 -- 172.21.15.31:0/3666332078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9304060860 msgr2=0x7f9304062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9304060860 0x7f9304062d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93180093c0 tx=0x7f9318017000 comp rx=0 tx=0).stop 2024-08-17T02:24:57.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4806f390 0x7f8e48143620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00b5e0 tx=0x7f8e3c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 -- 172.21.15.31:0/3666332078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93240cc6a0 msgr2=0x7f9324157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f96227fc700 1 -- 172.21.15.31:0/2016711936 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9624050c80 con 0x7f9634069120 2024-08-17T02:24:57.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93240cc6a0 0x7f9324157260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f931400cb60 tx=0x7f9314001010 comp rx=0 tx=0).stop 2024-08-17T02:24:57.780 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-08-17T02:24:57.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/3870586266 shutdown_connections 2024-08-17T02:24:57.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060b40 0x7f8e30062ff0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e480af3b0 0x7f8e48152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e480aef30 0x7f8e48145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 --2- 172.21.15.31:0/3870586266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4806f390 0x7f8e48143620 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/3870586266 >> 172.21.15.31:0/3870586266 conn(0x7f8e4806b330 msgr2=0x7f8e48069120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/3870586266 shutdown_connections 2024-08-17T02:24:57.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f8e4ca7a700 1 -- 172.21.15.31:0/3870586266 wait complete. 2024-08-17T02:24:57.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 -- 172.21.15.31:0/3666332078 shutdown_connections 2024-08-17T02:24:57.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9304060860 0x7f9304062d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93240cca70 0x7f9324152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93240cc6a0 0x7f9324157260 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 --2- 172.21.15.31:0/3666332078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9324069600 0x7f9324156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 -- 172.21.15.31:0/3666332078 >> 172.21.15.31:0/3666332078 conn(0x7f932406b330 msgr2=0x7f9324161650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 -- 172.21.15.31:0/3666332078 shutdown_connections 2024-08-17T02:24:57.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.774+0000 7f9303fff700 1 -- 172.21.15.31:0/3666332078 wait complete. 2024-08-17T02:24:57.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 -- 172.21.15.31:0/2016711936 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9614060930 msgr2=0x7f9614062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9614060930 0x7f9614062de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9634158440 tx=0x7f9628008040 comp rx=0 tx=0).stop 2024-08-17T02:24:57.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 -- 172.21.15.31:0/2016711936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9634069120 msgr2=0x7f9634157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9634069120 0x7f9634157700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f962400b810 tx=0x7f9624009250 comp rx=0 tx=0).stop 2024-08-17T02:24:57.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 -- 172.21.15.31:0/2016711936 shutdown_connections 2024-08-17T02:24:57.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9614060930 0x7f9614062de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96340af380 0x7f963415b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96340aef30 0x7f963414ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 --2- 172.21.15.31:0/2016711936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9634069120 0x7f9634157700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 -- 172.21.15.31:0/2016711936 >> 172.21.15.31:0/2016711936 conn(0x7f963406b330 msgr2=0x7f963406d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 -- 172.21.15.31:0/2016711936 shutdown_connections 2024-08-17T02:24:57.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.778+0000 7f9638b3f700 1 -- 172.21.15.31:0/2016711936 wait complete. 2024-08-17T02:24:57.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-08-17T02:24:57.795 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:57.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-08-17T02:24:57.796 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:57.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-08-17T02:24:57.803 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:57.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.818+0000 7f8152d8a700 1 -- 172.21.15.31:0/274904518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f812c005560 con 0x7f814c157010 2024-08-17T02:24:57.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8141ffb700 1 -- 172.21.15.31:0/274904518 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f813c050220 con 0x7f814c157010 2024-08-17T02:24:57.826 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-08-17T02:24:57.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8b26ffd700 1 -- 172.21.15.31:0/3381650165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8b3c0712b0 con 0x7f8b3c15e790 2024-08-17T02:24:57.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 -- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8138060ea0 msgr2=0x7f8138063350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8138060ea0 0x7f8138063350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f814c0aa8b0 tx=0x7f8144019000 comp rx=0 tx=0).stop 2024-08-17T02:24:57.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 -- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f814c157010 msgr2=0x7f814c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f814c157010 0x7f814c0aed60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f813c00c590 tx=0x7f813c007de0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 -- 172.21.15.31:0/274904518 shutdown_connections 2024-08-17T02:24:57.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8138060ea0 0x7f8138063350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f814c1583f0 0x7f814c0af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f814c157010 0x7f814c0aed60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 --2- 172.21.15.31:0/274904518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c0b14b0 0x7f814c14bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 -- 172.21.15.31:0/274904518 >> 172.21.15.31:0/274904518 conn(0x7f814c067400 msgr2=0x7f814c069810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 -- 172.21.15.31:0/274904518 shutdown_connections 2024-08-17T02:24:57.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8b317fa700 1 -- 172.21.15.31:0/3381650165 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b340508d0 con 0x7f8b3c15e790 2024-08-17T02:24:57.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.822+0000 7f8152d8a700 1 -- 172.21.15.31:0/274904518 wait complete. 2024-08-17T02:24:57.830 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-08-17T02:24:57.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7fec95b23700 1 -- 172.21.15.31:0/115913203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fec90069ef0 con 0x7fec900694c0 2024-08-17T02:24:57.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7fec8cff9700 1 -- 172.21.15.31:0/115913203 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec80051850 con 0x7fec900694c0 2024-08-17T02:24:57.831 INFO:teuthology.orchestra.run.smithi031.stdout:64424509449 2024-08-17T02:24:57.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 -- 172.21.15.31:0/3381650165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8b200608e0 msgr2=0x7f8b20062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8b200608e0 0x7f8b20062d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0019a0 tx=0x7f8b2c015000 comp rx=0 tx=0).stop 2024-08-17T02:24:57.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 -- 172.21.15.31:0/3381650165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b3c15e790 msgr2=0x7f8b3c15ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b3c15e790 0x7f8b3c15ebe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0b0ec0 tx=0x7f8b34002120 comp rx=0 tx=0).stop 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 -- 172.21.15.31:0/3381650165 shutdown_connections 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8b200608e0 0x7f8b20062d90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b3c15e790 0x7f8b3c15ebe0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b3c06ed40 0x7f8b3c06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 --2- 172.21.15.31:0/3381650165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b28003a90 0x7f8b3c1426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 -- 172.21.15.31:0/3381650165 >> 172.21.15.31:0/3381650165 conn(0x7f8b3c069ab0 msgr2=0x7f8b3c0700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 -- 172.21.15.31:0/3381650165 shutdown_connections 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.826+0000 7f8b26ffd700 1 -- 172.21.15.31:0/3381650165 wait complete. 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 -- 172.21.15.31:0/115913203 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fec74060860 msgr2=0x7fec74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fec74060860 0x7fec74062d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec9006f2a0 tx=0x7fec840091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 -- 172.21.15.31:0/115913203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec900694c0 msgr2=0x7fec9015ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec900694c0 0x7fec9015ee20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fec9006cb90 tx=0x7fec80017000 comp rx=0 tx=0).stop 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 -- 172.21.15.31:0/115913203 shutdown_connections 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fec74060860 0x7fec74062d10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec90159220 0x7fec90155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec900a9dc0 0x7fec9006dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 --2- 172.21.15.31:0/115913203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec900694c0 0x7fec9015ee20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 -- 172.21.15.31:0/115913203 >> 172.21.15.31:0/115913203 conn(0x7fec90067400 msgr2=0x7fec9006d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 -- 172.21.15.31:0/115913203 shutdown_connections 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.830+0000 7fec95b23700 1 -- 172.21.15.31:0/115913203 wait complete. 2024-08-17T02:24:57.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-08-17T02:24:57.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.838+0000 7f101d8b4700 1 -- 172.21.15.31:0/3873530515 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0ff8005830 con 0x7f1018156cf0 2024-08-17T02:24:57.843 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:57.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-08-17T02:24:57.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.838+0000 7f0ffeffd700 1 -- 172.21.15.31:0/3873530515 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f100c017020 con 0x7f1018156cf0 2024-08-17T02:24:57.844 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-08-17T02:24:57.844 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:57.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 -- 172.21.15.31:0/3873530515 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1004060890 msgr2=0x7f1004062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1004060890 0x7f1004062d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f10100097c0 tx=0x7f1010019000 comp rx=0 tx=0).stop 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 -- 172.21.15.31:0/3873530515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1018156cf0 msgr2=0x7f1018171870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1018156cf0 0x7f1018171870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c7c0 tx=0x7f100c007e00 comp rx=0 tx=0).stop 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 -- 172.21.15.31:0/3873530515 shutdown_connections 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1004060890 0x7f1004062d40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1018157510 0x7f1018167650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10181570c0 0x7f101816d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 --2- 172.21.15.31:0/3873530515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1018156cf0 0x7f1018171870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 -- 172.21.15.31:0/3873530515 >> 172.21.15.31:0/3873530515 conn(0x7f101806b330 msgr2=0x7f10181536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 -- 172.21.15.31:0/3873530515 shutdown_connections 2024-08-17T02:24:57.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.842+0000 7f101d8b4700 1 -- 172.21.15.31:0/3873530515 wait complete. 2024-08-17T02:24:57.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-08-17T02:24:57.848 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:57.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-08-17T02:24:57.859 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.862+0000 7f1ad759e700 1 -- 172.21.15.31:0/585522031 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1ad8168d30 con 0x7f1ad80691b0 2024-08-17T02:24:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.862+0000 7f1ac67fc700 1 -- 172.21.15.31:0/585522031 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ac80522c0 con 0x7f1ad80691b0 2024-08-17T02:24:57.868 INFO:teuthology.orchestra.run.smithi031.stdout:60129542152 2024-08-17T02:24:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 -- 172.21.15.31:0/585522031 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ab8060930 msgr2=0x7f1ab8062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ab8060930 0x7f1ab8062de0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ad813e0c0 tx=0x7f1acc008040 comp rx=0 tx=0).stop 2024-08-17T02:24:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 -- 172.21.15.31:0/585522031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad80691b0 msgr2=0x7f1ad8133a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad80691b0 0x7f1ad8133a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009290 tx=0x7f1ac8016000 comp rx=0 tx=0).stop 2024-08-17T02:24:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 -- 172.21.15.31:0/585522031 shutdown_connections 2024-08-17T02:24:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ab8060930 0x7f1ab8062de0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad80b0480 0x7f1ad814d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ad80ad930 0x7f1ad8159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 --2- 172.21.15.31:0/585522031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad80691b0 0x7f1ad8133a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 -- 172.21.15.31:0/585522031 >> 172.21.15.31:0/585522031 conn(0x7f1ad8067400 msgr2=0x7f1ad81356e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 -- 172.21.15.31:0/585522031 shutdown_connections 2024-08-17T02:24:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.866+0000 7f1ad759e700 1 -- 172.21.15.31:0/585522031 wait complete. 2024-08-17T02:24:57.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.5 2024-08-17T02:24:57.885 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:57.885 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:24:57.885 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:57.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f7944905700 1 Processor -- start 2024-08-17T02:24:57.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f7944905700 1 -- start start 2024-08-17T02:24:57.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f7944905700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79380e1f40 0x7f7938005f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f7944905700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79380e63e0 0x7f7938034830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f7944905700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7938034460 con 0x7f79380e2310 2024-08-17T02:24:57.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f7944905700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7938006440 con 0x7f79380e63e0 2024-08-17T02:24:57.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f7944905700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79380066e0 con 0x7f79380e1f40 2024-08-17T02:24:57.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793e59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f79380e2310 0x7f79380e5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58518/0 (socket says 172.21.15.31:58518) 2024-08-17T02:24:57.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793e59c700 1 -- 172.21.15.31:0/379288019 learned_addr learned my addr 172.21.15.31:0/379288019 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:57.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793f59e700 1 --2- 172.21.15.31:0/379288019 >> v2:172.21.15.31:3300/0 conn(0x7f79380e63e0 0x7f7938034830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628669830 0 0) 0x7f7938034460 con 0x7f79380e2310 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f792c003570 con 0x7f79380e2310 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793ed9d700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79380e1f40 0x7f7938005f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2579576411 0 0) 0x7f792c003570 con 0x7f79380e2310 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79380e1f40 msgr2=0x7f7938005f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79380e1f40 0x7f7938005f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 >> v2:172.21.15.31:3300/0 conn(0x7f79380e63e0 msgr2=0x7f7938034830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 --2- 172.21.15.31:0/379288019 >> v2:172.21.15.31:3300/0 conn(0x7f79380e63e0 0x7f7938034830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79380069c0 con 0x7f79380e2310 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f794004c770 con 0x7f79380e2310 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793f59e700 1 --2- 172.21.15.31:0/379288019 >> v2:172.21.15.31:3300/0 conn(0x7f79380e63e0 0x7f7938034830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:57.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 >> v1:172.21.15.31:6789/0 conn(0x7f79380e2310 legacy=0x7f79380e5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f792c003ae0 0x7f792c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f792c004810 0x7f792c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79380e1f40 0x7f792c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7938006440 con 0x7f792c003ae0 2024-08-17T02:24:57.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79380066e0 con 0x7f792c004810 2024-08-17T02:24:57.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c00ba90 con 0x7f79380e1f40 2024-08-17T02:24:57.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793ed9d700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f792c003ae0 0x7f792c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793f59e700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79380e1f40 0x7f792c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793e59c700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f792c004810 0x7f792c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793ed9d700 1 -- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79380e1f40 msgr2=0x7f792c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793ed9d700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79380e1f40 0x7f792c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793ed9d700 1 -- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f792c004810 msgr2=0x7f792c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:57.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793ed9d700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f792c004810 0x7f792c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793ed9d700 1 -- 172.21.15.31:0/379288019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c003570 con 0x7f792c003ae0 2024-08-17T02:24:57.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793e59c700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f792c004810 0x7f792c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:57.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793f59e700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f79380e1f40 0x7f792c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:57.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793ed9d700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f792c003ae0 0x7f792c003ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7928009c00 tx=0x7f79280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccc3def56bde21c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800e6b0 con 0x7f792c003ae0 2024-08-17T02:24:57.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792800e810 con 0x7f792c003ae0 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.982+0000 7f793dd9b700 1 -- 172.21.15.31:0/379288019 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800ebd0 con 0x7f792c003ae0 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 -- 172.21.15.31:0/379288019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f792c003ae0 msgr2=0x7f792c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 --2- 172.21.15.31:0/379288019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f792c003ae0 0x7f792c003ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7928009c00 tx=0x7f79280091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793f59e700 1 -- 172.21.15.31:0/379288019 reap_dead start 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 -- 172.21.15.31:0/379288019 shutdown_connections 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 -- 172.21.15.31:0/379288019 >> 172.21.15.31:0/379288019 conn(0x7f7938054c20 msgr2=0x7f7938054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 -- 172.21.15.31:0/379288019 shutdown_connections 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 -- 172.21.15.31:0/379288019 wait complete. 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 Processor -- start 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 -- start start 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f793804d750 0x7f79380379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79380398e0 0x7f793804db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7938039040 0x7f79380d9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7938038bb0 con 0x7f793804d750 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7938037fa0 con 0x7f79380398e0 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f7944905700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7938038280 con 0x7f7938039040 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f793804d750 0x7f79380379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f793804d750 0x7f79380379c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48988/0 (socket says 172.21.15.31:48988) 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793ed9d700 1 -- 172.21.15.31:0/622770786 learned_addr learned my addr 172.21.15.31:0/622770786 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793f59e700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7938039040 0x7f79380d9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793e59c700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79380398e0 0x7f793804db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793ed9d700 1 -- 172.21.15.31:0/622770786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7938039040 msgr2=0x7f79380d9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793ed9d700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7938039040 0x7f79380d9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793ed9d700 1 -- 172.21.15.31:0/622770786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79380398e0 msgr2=0x7f793804db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:57.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793ed9d700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79380398e0 0x7f793804db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:57.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.986+0000 7f793ed9d700 1 -- 172.21.15.31:0/622770786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7938038560 con 0x7f793804d750 2024-08-17T02:24:57.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f793ed9d700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f793804d750 0x7f79380379c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f792c004730 tx=0x7f792801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:57.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f7936ffd700 1 -- 172.21.15.31:0/622770786 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928022070 con 0x7f793804d750 2024-08-17T02:24:57.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f7936ffd700 1 -- 172.21.15.31:0/622770786 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7928013af0 con 0x7f793804d750 2024-08-17T02:24:57.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f7936ffd700 1 -- 172.21.15.31:0/622770786 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800e6b0 con 0x7f793804d750 2024-08-17T02:24:57.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f7944905700 1 -- 172.21.15.31:0/622770786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7938038840 con 0x7f793804d750 2024-08-17T02:24:57.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f7944905700 1 -- 172.21.15.31:0/622770786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7938039490 con 0x7f793804d750 2024-08-17T02:24:57.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f7936ffd700 1 -- 172.21.15.31:0/622770786 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f792801c450 con 0x7f793804d750 2024-08-17T02:24:57.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f7944905700 1 -- 172.21.15.31:0/622770786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79380052e0 con 0x7f793804d750 2024-08-17T02:24:57.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f7936ffd700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7920060890 0x7f7920062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:57.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f7936ffd700 1 -- 172.21.15.31:0/622770786 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f792807e6f0 con 0x7f793804d750 2024-08-17T02:24:57.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f793e59c700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7920060890 0x7f7920062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:57.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.990+0000 7f793e59c700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7920060890 0x7f7920062d40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7940066290 tx=0x7f794008a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:57.998+0000 7f7936ffd700 1 -- 172.21.15.31:0/622770786 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f792804ebc0 con 0x7f793804d750 2024-08-17T02:24:58.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.154+0000 7f7944905700 1 -- 172.21.15.31:0/622770786 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7938052a30 con 0x7f7920060890 2024-08-17T02:24:58.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.170+0000 7f7936ffd700 1 -- 172.21.15.31:0/622770786 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264399 (secure 0 0 0) 0x7f7938052a30 con 0x7f7920060890 2024-08-17T02:24:58.179 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:58.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 -- 172.21.15.31:0/622770786 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7920060890 msgr2=0x7f7920062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7920060890 0x7f7920062d40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7940066290 tx=0x7f794008a040 comp rx=0 tx=0).stop 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 -- 172.21.15.31:0/622770786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f793804d750 msgr2=0x7f79380379c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f793804d750 0x7f79380379c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f792c004730 tx=0x7f792801a000 comp rx=0 tx=0).stop 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 -- 172.21.15.31:0/622770786 shutdown_connections 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7920060890 0x7f7920062d40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7938039040 0x7f79380d9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f79380398e0 0x7f793804db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 --2- 172.21.15.31:0/622770786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f793804d750 0x7f79380379c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 -- 172.21.15.31:0/622770786 >> 172.21.15.31:0/622770786 conn(0x7f7938054c20 msgr2=0x7f7938037020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 -- 172.21.15.31:0/622770786 shutdown_connections 2024-08-17T02:24:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.174+0000 7f7944905700 1 -- 172.21.15.31:0/622770786 wait complete. 2024-08-17T02:24:58.183 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:24:58.194 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-08-17T02:24:57.585397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381932,"kb_used_data":3048,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592788,"statfs":{"total":773094113280,"available":770655014912,"internally_reserved":0,"allocated":3121152,"data_stored":1830460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003118"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714546+0000","last_change":"2024-08-17T02:24:46.711137+0000","last_active":"2024-08-17T02:24:46.714546+0000","last_peered":"2024-08-17T02:24:46.714546+0000","last_clean":"2024-08-17T02:24:46.714546+0000","last_became_active":"2024-08-17T02:24:46.710820+0000","last_became_peered":"2024-08-17T02:24:46.710820+0000","last_unstale":"2024-08-17T02:24:46.714546+0000","last_undegraded":"2024-08-17T02:24:46.714546+0000","last_fullsized":"2024-08-17T02:24:46.714546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696492+0000","last_change":"2024-08-17T02:24:46.689088+0000","last_active":"2024-08-17T02:24:46.696492+0000","last_peered":"2024-08-17T02:24:46.696492+0000","last_clean":"2024-08-17T02:24:46.696492+0000","last_became_active":"2024-08-17T02:24:46.688753+0000","last_became_peered":"2024-08-17T02:24:46.688753+0000","last_unstale":"2024-08-17T02:24:46.696492+0000","last_undegraded":"2024-08-17T02:24:46.696492+0000","last_fullsized":"2024-08-17T02:24:46.696492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:20.964222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700771+0000","last_change":"2024-08-17T02:24:46.695883+0000","last_active":"2024-08-17T02:24:46.700771+0000","last_peered":"2024-08-17T02:24:46.700771+0000","last_clean":"2024-08-17T02:24:46.700771+0000","last_became_active":"2024-08-17T02:24:46.695594+0000","last_became_peered":"2024-08-17T02:24:46.695594+0000","last_unstale":"2024-08-17T02:24:46.700771+0000","last_undegraded":"2024-08-17T02:24:46.700771+0000","last_fullsized":"2024-08-17T02:24:46.700771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:45:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707546+0000","last_change":"2024-08-17T02:24:46.702343+0000","last_active":"2024-08-17T02:24:46.707546+0000","last_peered":"2024-08-17T02:24:46.707546+0000","last_clean":"2024-08-17T02:24:46.707546+0000","last_became_active":"2024-08-17T02:24:46.700536+0000","last_became_peered":"2024-08-17T02:24:46.700536+0000","last_unstale":"2024-08-17T02:24:46.707546+0000","last_undegraded":"2024-08-17T02:24:46.707546+0000","last_fullsized":"2024-08-17T02:24:46.707546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702344+0000","last_change":"2024-08-17T02:24:46.697977+0000","last_active":"2024-08-17T02:24:46.702344+0000","last_peered":"2024-08-17T02:24:46.702344+0000","last_clean":"2024-08-17T02:24:46.702344+0000","last_became_active":"2024-08-17T02:24:46.697680+0000","last_became_peered":"2024-08-17T02:24:46.697680+0000","last_unstale":"2024-08-17T02:24:46.702344+0000","last_undegraded":"2024-08-17T02:24:46.702344+0000","last_fullsized":"2024-08-17T02:24:46.702344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698897+0000","last_change":"2024-08-17T02:24:46.696070+0000","last_active":"2024-08-17T02:24:46.698897+0000","last_peered":"2024-08-17T02:24:46.698897+0000","last_clean":"2024-08-17T02:24:46.698897+0000","last_became_active":"2024-08-17T02:24:46.693809+0000","last_became_peered":"2024-08-17T02:24:46.693809+0000","last_unstale":"2024-08-17T02:24:46.698897+0000","last_undegraded":"2024-08-17T02:24:46.698897+0000","last_fullsized":"2024-08-17T02:24:46.698897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699991+0000","last_change":"2024-08-17T02:24:46.694034+0000","last_active":"2024-08-17T02:24:46.699991+0000","last_peered":"2024-08-17T02:24:46.699991+0000","last_clean":"2024-08-17T02:24:46.699991+0000","last_became_active":"2024-08-17T02:24:46.693720+0000","last_became_peered":"2024-08-17T02:24:46.693720+0000","last_unstale":"2024-08-17T02:24:46.699991+0000","last_undegraded":"2024-08-17T02:24:46.699991+0000","last_fullsized":"2024-08-17T02:24:46.699991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:25.120018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703650+0000","last_change":"2024-08-17T02:24:46.698687+0000","last_active":"2024-08-17T02:24:46.703650+0000","last_peered":"2024-08-17T02:24:46.703650+0000","last_clean":"2024-08-17T02:24:46.703650+0000","last_became_active":"2024-08-17T02:24:46.698410+0000","last_became_peered":"2024-08-17T02:24:46.698410+0000","last_unstale":"2024-08-17T02:24:46.703650+0000","last_undegraded":"2024-08-17T02:24:46.703650+0000","last_fullsized":"2024-08-17T02:24:46.703650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:40:14.395986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714270+0000","last_change":"2024-08-17T02:24:46.710805+0000","last_active":"2024-08-17T02:24:46.714270+0000","last_peered":"2024-08-17T02:24:46.714270+0000","last_clean":"2024-08-17T02:24:46.714270+0000","last_became_active":"2024-08-17T02:24:46.710510+0000","last_became_peered":"2024-08-17T02:24:46.710510+0000","last_unstale":"2024-08-17T02:24:46.714270+0000","last_undegraded":"2024-08-17T02:24:46.714270+0000","last_fullsized":"2024-08-17T02:24:46.714270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702497+0000","last_change":"2024-08-17T02:24:46.695508+0000","last_active":"2024-08-17T02:24:46.702497+0000","last_peered":"2024-08-17T02:24:46.702497+0000","last_clean":"2024-08-17T02:24:46.702497+0000","last_became_active":"2024-08-17T02:24:46.695174+0000","last_became_peered":"2024-08-17T02:24:46.695174+0000","last_unstale":"2024-08-17T02:24:46.702497+0000","last_undegraded":"2024-08-17T02:24:46.702497+0000","last_fullsized":"2024-08-17T02:24:46.702497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:26.358220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714534+0000","last_change":"2024-08-17T02:24:46.711058+0000","last_active":"2024-08-17T02:24:46.714534+0000","last_peered":"2024-08-17T02:24:46.714534+0000","last_clean":"2024-08-17T02:24:46.714534+0000","last_became_active":"2024-08-17T02:24:46.710739+0000","last_became_peered":"2024-08-17T02:24:46.710739+0000","last_unstale":"2024-08-17T02:24:46.714534+0000","last_undegraded":"2024-08-17T02:24:46.714534+0000","last_fullsized":"2024-08-17T02:24:46.714534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702585+0000","last_change":"2024-08-17T02:24:46.695791+0000","last_active":"2024-08-17T02:24:46.702585+0000","last_peered":"2024-08-17T02:24:46.702585+0000","last_clean":"2024-08-17T02:24:46.702585+0000","last_became_active":"2024-08-17T02:24:46.695116+0000","last_became_peered":"2024-08-17T02:24:46.695116+0000","last_unstale":"2024-08-17T02:24:46.702585+0000","last_undegraded":"2024-08-17T02:24:46.702585+0000","last_fullsized":"2024-08-17T02:24:46.702585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703379+0000","last_change":"2024-08-17T02:24:46.699896+0000","last_active":"2024-08-17T02:24:46.703379+0000","last_peered":"2024-08-17T02:24:46.703379+0000","last_clean":"2024-08-17T02:24:46.703379+0000","last_became_active":"2024-08-17T02:24:46.699645+0000","last_became_peered":"2024-08-17T02:24:46.699645+0000","last_unstale":"2024-08-17T02:24:46.703379+0000","last_undegraded":"2024-08-17T02:24:46.703379+0000","last_fullsized":"2024-08-17T02:24:46.703379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:36.261958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694896+0000","last_change":"2024-08-17T02:24:46.690505+0000","last_active":"2024-08-17T02:24:46.694896+0000","last_peered":"2024-08-17T02:24:46.694896+0000","last_clean":"2024-08-17T02:24:46.694896+0000","last_became_active":"2024-08-17T02:24:46.690185+0000","last_became_peered":"2024-08-17T02:24:46.690185+0000","last_unstale":"2024-08-17T02:24:46.694896+0000","last_undegraded":"2024-08-17T02:24:46.694896+0000","last_fullsized":"2024-08-17T02:24:46.694896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703730+0000","last_change":"2024-08-17T02:24:46.698787+0000","last_active":"2024-08-17T02:24:46.703730+0000","last_peered":"2024-08-17T02:24:46.703730+0000","last_clean":"2024-08-17T02:24:46.703730+0000","last_became_active":"2024-08-17T02:24:46.698418+0000","last_became_peered":"2024-08-17T02:24:46.698418+0000","last_unstale":"2024-08-17T02:24:46.703730+0000","last_undegraded":"2024-08-17T02:24:46.703730+0000","last_fullsized":"2024-08-17T02:24:46.703730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:40.310047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706590+0000","last_change":"2024-08-17T02:24:46.690550+0000","last_active":"2024-08-17T02:24:46.706590+0000","last_peered":"2024-08-17T02:24:46.706590+0000","last_clean":"2024-08-17T02:24:46.706590+0000","last_became_active":"2024-08-17T02:24:46.690231+0000","last_became_peered":"2024-08-17T02:24:46.690231+0000","last_unstale":"2024-08-17T02:24:46.706590+0000","last_undegraded":"2024-08-17T02:24:46.706590+0000","last_fullsized":"2024-08-17T02:24:46.706590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:40:04.175081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706996+0000","last_change":"2024-08-17T02:24:46.703443+0000","last_active":"2024-08-17T02:24:46.706996+0000","last_peered":"2024-08-17T02:24:46.706996+0000","last_clean":"2024-08-17T02:24:46.706996+0000","last_became_active":"2024-08-17T02:24:46.703111+0000","last_became_peered":"2024-08-17T02:24:46.703111+0000","last_unstale":"2024-08-17T02:24:46.706996+0000","last_undegraded":"2024-08-17T02:24:46.706996+0000","last_fullsized":"2024-08-17T02:24:46.706996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703691+0000","last_change":"2024-08-17T02:24:46.695275+0000","last_active":"2024-08-17T02:24:46.703691+0000","last_peered":"2024-08-17T02:24:46.703691+0000","last_clean":"2024-08-17T02:24:46.703691+0000","last_became_active":"2024-08-17T02:24:46.694600+0000","last_became_peered":"2024-08-17T02:24:46.694600+0000","last_unstale":"2024-08-17T02:24:46.703691+0000","last_undegraded":"2024-08-17T02:24:46.703691+0000","last_fullsized":"2024-08-17T02:24:46.703691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706899+0000","last_change":"2024-08-17T02:24:46.703289+0000","last_active":"2024-08-17T02:24:46.706899+0000","last_peered":"2024-08-17T02:24:46.706899+0000","last_clean":"2024-08-17T02:24:46.706899+0000","last_became_active":"2024-08-17T02:24:46.702961+0000","last_became_peered":"2024-08-17T02:24:46.702961+0000","last_unstale":"2024-08-17T02:24:46.706899+0000","last_undegraded":"2024-08-17T02:24:46.706899+0000","last_fullsized":"2024-08-17T02:24:46.706899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:26.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702603+0000","last_change":"2024-08-17T02:24:46.696080+0000","last_active":"2024-08-17T02:24:46.702603+0000","last_peered":"2024-08-17T02:24:46.702603+0000","last_clean":"2024-08-17T02:24:46.702603+0000","last_became_active":"2024-08-17T02:24:46.695753+0000","last_became_peered":"2024-08-17T02:24:46.695753+0000","last_unstale":"2024-08-17T02:24:46.702603+0000","last_undegraded":"2024-08-17T02:24:46.702603+0000","last_fullsized":"2024-08-17T02:24:46.702603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700418+0000","last_change":"2024-08-17T02:24:46.692695+0000","last_active":"2024-08-17T02:24:46.700418+0000","last_peered":"2024-08-17T02:24:46.700418+0000","last_clean":"2024-08-17T02:24:46.700418+0000","last_became_active":"2024-08-17T02:24:46.691145+0000","last_became_peered":"2024-08-17T02:24:46.691145+0000","last_unstale":"2024-08-17T02:24:46.700418+0000","last_undegraded":"2024-08-17T02:24:46.700418+0000","last_fullsized":"2024-08-17T02:24:46.700418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:25.233681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706334+0000","last_change":"2024-08-17T02:24:46.696761+0000","last_active":"2024-08-17T02:24:46.706334+0000","last_peered":"2024-08-17T02:24:46.706334+0000","last_clean":"2024-08-17T02:24:46.706334+0000","last_became_active":"2024-08-17T02:24:46.695844+0000","last_became_peered":"2024-08-17T02:24:46.695844+0000","last_unstale":"2024-08-17T02:24:46.706334+0000","last_undegraded":"2024-08-17T02:24:46.706334+0000","last_fullsized":"2024-08-17T02:24:46.706334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700724+0000","last_change":"2024-08-17T02:24:46.694929+0000","last_active":"2024-08-17T02:24:46.700724+0000","last_peered":"2024-08-17T02:24:46.700724+0000","last_clean":"2024-08-17T02:24:46.700724+0000","last_became_active":"2024-08-17T02:24:46.694374+0000","last_became_peered":"2024-08-17T02:24:46.694374+0000","last_unstale":"2024-08-17T02:24:46.700724+0000","last_undegraded":"2024-08-17T02:24:46.700724+0000","last_fullsized":"2024-08-17T02:24:46.700724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:46:46.027493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706231+0000","last_change":"2024-08-17T02:24:46.683686+0000","last_active":"2024-08-17T02:24:46.706231+0000","last_peered":"2024-08-17T02:24:46.706231+0000","last_clean":"2024-08-17T02:24:46.706231+0000","last_became_active":"2024-08-17T02:24:46.683416+0000","last_became_peered":"2024-08-17T02:24:46.683416+0000","last_unstale":"2024-08-17T02:24:46.706231+0000","last_undegraded":"2024-08-17T02:24:46.706231+0000","last_fullsized":"2024-08-17T02:24:46.706231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:38.075390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703466+0000","last_change":"2024-08-17T02:24:46.697382+0000","last_active":"2024-08-17T02:24:46.703466+0000","last_peered":"2024-08-17T02:24:46.703466+0000","last_clean":"2024-08-17T02:24:46.703466+0000","last_became_active":"2024-08-17T02:24:46.697033+0000","last_became_peered":"2024-08-17T02:24:46.697033+0000","last_unstale":"2024-08-17T02:24:46.703466+0000","last_undegraded":"2024-08-17T02:24:46.703466+0000","last_fullsized":"2024-08-17T02:24:46.703466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:28.290751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714222+0000","last_change":"2024-08-17T02:24:46.707560+0000","last_active":"2024-08-17T02:24:46.714222+0000","last_peered":"2024-08-17T02:24:46.714222+0000","last_clean":"2024-08-17T02:24:46.714222+0000","last_became_active":"2024-08-17T02:24:46.707234+0000","last_became_peered":"2024-08-17T02:24:46.707234+0000","last_unstale":"2024-08-17T02:24:46.714222+0000","last_undegraded":"2024-08-17T02:24:46.714222+0000","last_fullsized":"2024-08-17T02:24:46.714222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:32.930431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694875+0000","last_change":"2024-08-17T02:24:46.691514+0000","last_active":"2024-08-17T02:24:46.694875+0000","last_peered":"2024-08-17T02:24:46.694875+0000","last_clean":"2024-08-17T02:24:46.694875+0000","last_became_active":"2024-08-17T02:24:46.691231+0000","last_became_peered":"2024-08-17T02:24:46.691231+0000","last_unstale":"2024-08-17T02:24:46.694875+0000","last_undegraded":"2024-08-17T02:24:46.694875+0000","last_fullsized":"2024-08-17T02:24:46.694875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700286+0000","last_change":"2024-08-17T02:24:46.698271+0000","last_active":"2024-08-17T02:24:46.700286+0000","last_peered":"2024-08-17T02:24:46.700286+0000","last_clean":"2024-08-17T02:24:46.700286+0000","last_became_active":"2024-08-17T02:24:46.698020+0000","last_became_peered":"2024-08-17T02:24:46.698020+0000","last_unstale":"2024-08-17T02:24:46.700286+0000","last_undegraded":"2024-08-17T02:24:46.700286+0000","last_fullsized":"2024-08-17T02:24:46.700286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:51.758557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696520+0000","last_change":"2024-08-17T02:24:46.691079+0000","last_active":"2024-08-17T02:24:46.696520+0000","last_peered":"2024-08-17T02:24:46.696520+0000","last_clean":"2024-08-17T02:24:46.696520+0000","last_became_active":"2024-08-17T02:24:46.690659+0000","last_became_peered":"2024-08-17T02:24:46.690659+0000","last_unstale":"2024-08-17T02:24:46.696520+0000","last_undegraded":"2024-08-17T02:24:46.696520+0000","last_fullsized":"2024-08-17T02:24:46.696520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:16:36.446060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706285+0000","last_change":"2024-08-17T02:24:46.684857+0000","last_active":"2024-08-17T02:24:46.706285+0000","last_peered":"2024-08-17T02:24:46.706285+0000","last_clean":"2024-08-17T02:24:46.706285+0000","last_became_active":"2024-08-17T02:24:46.683949+0000","last_became_peered":"2024-08-17T02:24:46.683949+0000","last_unstale":"2024-08-17T02:24:46.706285+0000","last_undegraded":"2024-08-17T02:24:46.706285+0000","last_fullsized":"2024-08-17T02:24:46.706285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:06.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703787+0000","last_change":"2024-08-17T02:24:46.698926+0000","last_active":"2024-08-17T02:24:46.703787+0000","last_peered":"2024-08-17T02:24:46.703787+0000","last_clean":"2024-08-17T02:24:46.703787+0000","last_became_active":"2024-08-17T02:24:46.698650+0000","last_became_peered":"2024-08-17T02:24:46.698650+0000","last_unstale":"2024-08-17T02:24:46.703787+0000","last_undegraded":"2024-08-17T02:24:46.703787+0000","last_fullsized":"2024-08-17T02:24:46.703787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699472+0000","last_change":"2024-08-17T02:24:46.697443+0000","last_active":"2024-08-17T02:24:46.699472+0000","last_peered":"2024-08-17T02:24:46.699472+0000","last_clean":"2024-08-17T02:24:46.699472+0000","last_became_active":"2024-08-17T02:24:46.696404+0000","last_became_peered":"2024-08-17T02:24:46.696404+0000","last_unstale":"2024-08-17T02:24:46.699472+0000","last_undegraded":"2024-08-17T02:24:46.699472+0000","last_fullsized":"2024-08-17T02:24:46.699472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706357+0000","last_change":"2024-08-17T02:24:46.701561+0000","last_active":"2024-08-17T02:24:46.706357+0000","last_peered":"2024-08-17T02:24:46.706357+0000","last_clean":"2024-08-17T02:24:46.706357+0000","last_became_active":"2024-08-17T02:24:46.696208+0000","last_became_peered":"2024-08-17T02:24:46.696208+0000","last_unstale":"2024-08-17T02:24:46.706357+0000","last_undegraded":"2024-08-17T02:24:46.706357+0000","last_fullsized":"2024-08-17T02:24:46.706357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700595+0000","last_change":"2024-08-17T02:24:45.693597+0000","last_active":"2024-08-17T02:24:46.700595+0000","last_peered":"2024-08-17T02:24:46.700595+0000","last_clean":"2024-08-17T02:24:46.700595+0000","last_became_active":"2024-08-17T02:24:45.692136+0000","last_became_peered":"2024-08-17T02:24:45.692136+0000","last_unstale":"2024-08-17T02:24:46.700595+0000","last_undegraded":"2024-08-17T02:24:46.700595+0000","last_fullsized":"2024-08-17T02:24:46.700595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:51.770625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703406+0000","last_change":"2024-08-17T02:24:46.700557+0000","last_active":"2024-08-17T02:24:46.703406+0000","last_peered":"2024-08-17T02:24:46.703406+0000","last_clean":"2024-08-17T02:24:46.703406+0000","last_became_active":"2024-08-17T02:24:46.700114+0000","last_became_peered":"2024-08-17T02:24:46.700114+0000","last_unstale":"2024-08-17T02:24:46.703406+0000","last_undegraded":"2024-08-17T02:24:46.703406+0000","last_fullsized":"2024-08-17T02:24:46.703406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706413+0000","last_change":"2024-08-17T02:24:45.685965+0000","last_active":"2024-08-17T02:24:46.706413+0000","last_peered":"2024-08-17T02:24:46.706413+0000","last_clean":"2024-08-17T02:24:46.706413+0000","last_became_active":"2024-08-17T02:24:45.685019+0000","last_became_peered":"2024-08-17T02:24:45.685019+0000","last_unstale":"2024-08-17T02:24:46.706413+0000","last_undegraded":"2024-08-17T02:24:46.706413+0000","last_fullsized":"2024-08-17T02:24:46.706413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:33.322093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.681299+0000","last_change":"2024-08-17T02:24:45.695657+0000","last_active":"2024-08-17T02:24:46.681299+0000","last_peered":"2024-08-17T02:24:46.681299+0000","last_clean":"2024-08-17T02:24:46.681299+0000","last_became_active":"2024-08-17T02:24:45.695337+0000","last_became_peered":"2024-08-17T02:24:45.695337+0000","last_unstale":"2024-08-17T02:24:46.681299+0000","last_undegraded":"2024-08-17T02:24:46.681299+0000","last_fullsized":"2024-08-17T02:24:46.681299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696577+0000","last_change":"2024-08-17T02:24:46.691553+0000","last_active":"2024-08-17T02:24:46.696577+0000","last_peered":"2024-08-17T02:24:46.696577+0000","last_clean":"2024-08-17T02:24:46.696577+0000","last_became_active":"2024-08-17T02:24:46.688816+0000","last_became_peered":"2024-08-17T02:24:46.688816+0000","last_unstale":"2024-08-17T02:24:46.696577+0000","last_undegraded":"2024-08-17T02:24:46.696577+0000","last_fullsized":"2024-08-17T02:24:46.696577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:46:36.817383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673163+0000","last_change":"2024-08-17T02:24:45.683302+0000","last_active":"2024-08-17T02:24:46.673163+0000","last_peered":"2024-08-17T02:24:46.673163+0000","last_clean":"2024-08-17T02:24:46.673163+0000","last_became_active":"2024-08-17T02:24:45.682641+0000","last_became_peered":"2024-08-17T02:24:45.682641+0000","last_unstale":"2024-08-17T02:24:46.673163+0000","last_undegraded":"2024-08-17T02:24:46.673163+0000","last_fullsized":"2024-08-17T02:24:46.673163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:36.581167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700661+0000","last_change":"2024-08-17T02:24:46.693180+0000","last_active":"2024-08-17T02:24:46.700661+0000","last_peered":"2024-08-17T02:24:46.700661+0000","last_clean":"2024-08-17T02:24:46.700661+0000","last_became_active":"2024-08-17T02:24:46.692910+0000","last_became_peered":"2024-08-17T02:24:46.692910+0000","last_unstale":"2024-08-17T02:24:46.700661+0000","last_undegraded":"2024-08-17T02:24:46.700661+0000","last_fullsized":"2024-08-17T02:24:46.700661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:20.305646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691054+0000","last_change":"2024-08-17T02:24:45.689693+0000","last_active":"2024-08-17T02:24:46.691054+0000","last_peered":"2024-08-17T02:24:46.691054+0000","last_clean":"2024-08-17T02:24:46.691054+0000","last_became_active":"2024-08-17T02:24:45.689396+0000","last_became_peered":"2024-08-17T02:24:45.689396+0000","last_unstale":"2024-08-17T02:24:46.691054+0000","last_undegraded":"2024-08-17T02:24:46.691054+0000","last_fullsized":"2024-08-17T02:24:46.691054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:03:27.829684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714193+0000","last_change":"2024-08-17T02:24:46.707529+0000","last_active":"2024-08-17T02:24:46.714193+0000","last_peered":"2024-08-17T02:24:46.714193+0000","last_clean":"2024-08-17T02:24:46.714193+0000","last_became_active":"2024-08-17T02:24:46.706887+0000","last_became_peered":"2024-08-17T02:24:46.706887+0000","last_unstale":"2024-08-17T02:24:46.714193+0000","last_undegraded":"2024-08-17T02:24:46.714193+0000","last_fullsized":"2024-08-17T02:24:46.714193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682673+0000","last_change":"2024-08-17T02:24:45.689053+0000","last_active":"2024-08-17T02:24:46.682673+0000","last_peered":"2024-08-17T02:24:46.682673+0000","last_clean":"2024-08-17T02:24:46.682673+0000","last_became_active":"2024-08-17T02:24:45.688643+0000","last_became_peered":"2024-08-17T02:24:45.688643+0000","last_unstale":"2024-08-17T02:24:46.682673+0000","last_undegraded":"2024-08-17T02:24:46.682673+0000","last_fullsized":"2024-08-17T02:24:46.682673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711779+0000","last_change":"2024-08-17T02:24:46.708643+0000","last_active":"2024-08-17T02:24:46.711779+0000","last_peered":"2024-08-17T02:24:46.711779+0000","last_clean":"2024-08-17T02:24:46.711779+0000","last_became_active":"2024-08-17T02:24:46.708322+0000","last_became_peered":"2024-08-17T02:24:46.708322+0000","last_unstale":"2024-08-17T02:24:46.711779+0000","last_undegraded":"2024-08-17T02:24:46.711779+0000","last_fullsized":"2024-08-17T02:24:46.711779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:00.112973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703626+0000","last_change":"2024-08-17T02:24:45.686140+0000","last_active":"2024-08-17T02:24:46.703626+0000","last_peered":"2024-08-17T02:24:46.703626+0000","last_clean":"2024-08-17T02:24:46.703626+0000","last_became_active":"2024-08-17T02:24:45.685732+0000","last_became_peered":"2024-08-17T02:24:45.685732+0000","last_unstale":"2024-08-17T02:24:46.703626+0000","last_undegraded":"2024-08-17T02:24:46.703626+0000","last_fullsized":"2024-08-17T02:24:46.703626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710171+0000","last_change":"2024-08-17T02:24:46.703995+0000","last_active":"2024-08-17T02:24:46.710171+0000","last_peered":"2024-08-17T02:24:46.710171+0000","last_clean":"2024-08-17T02:24:46.710171+0000","last_became_active":"2024-08-17T02:24:46.703632+0000","last_became_peered":"2024-08-17T02:24:46.703632+0000","last_unstale":"2024-08-17T02:24:46.710171+0000","last_undegraded":"2024-08-17T02:24:46.710171+0000","last_fullsized":"2024-08-17T02:24:46.710171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711599+0000","last_change":"2024-08-17T02:24:45.691026+0000","last_active":"2024-08-17T02:24:46.711599+0000","last_peered":"2024-08-17T02:24:46.711599+0000","last_clean":"2024-08-17T02:24:46.711599+0000","last_became_active":"2024-08-17T02:24:45.690499+0000","last_became_peered":"2024-08-17T02:24:45.690499+0000","last_unstale":"2024-08-17T02:24:46.711599+0000","last_undegraded":"2024-08-17T02:24:46.711599+0000","last_fullsized":"2024-08-17T02:24:46.711599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:14.230300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700038+0000","last_change":"2024-08-17T02:24:46.694359+0000","last_active":"2024-08-17T02:24:46.700038+0000","last_peered":"2024-08-17T02:24:46.700038+0000","last_clean":"2024-08-17T02:24:46.700038+0000","last_became_active":"2024-08-17T02:24:46.693812+0000","last_became_peered":"2024-08-17T02:24:46.693812+0000","last_unstale":"2024-08-17T02:24:46.700038+0000","last_undegraded":"2024-08-17T02:24:46.700038+0000","last_fullsized":"2024-08-17T02:24:46.700038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:48:49.063780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703831+0000","last_change":"2024-08-17T02:24:45.689928+0000","last_active":"2024-08-17T02:24:46.703831+0000","last_peered":"2024-08-17T02:24:46.703831+0000","last_clean":"2024-08-17T02:24:46.703831+0000","last_became_active":"2024-08-17T02:24:45.689519+0000","last_became_peered":"2024-08-17T02:24:45.689519+0000","last_unstale":"2024-08-17T02:24:46.703831+0000","last_undegraded":"2024-08-17T02:24:46.703831+0000","last_fullsized":"2024-08-17T02:24:46.703831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.709142+0000","last_change":"2024-08-17T02:24:46.708134+0000","last_active":"2024-08-17T02:24:46.709142+0000","last_peered":"2024-08-17T02:24:46.709142+0000","last_clean":"2024-08-17T02:24:46.709142+0000","last_became_active":"2024-08-17T02:24:46.707822+0000","last_became_peered":"2024-08-17T02:24:46.707822+0000","last_unstale":"2024-08-17T02:24:46.709142+0000","last_undegraded":"2024-08-17T02:24:46.709142+0000","last_fullsized":"2024-08-17T02:24:46.709142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673821+0000","last_change":"2024-08-17T02:24:45.686232+0000","last_active":"2024-08-17T02:24:46.673821+0000","last_peered":"2024-08-17T02:24:46.673821+0000","last_clean":"2024-08-17T02:24:46.673821+0000","last_became_active":"2024-08-17T02:24:45.685407+0000","last_became_peered":"2024-08-17T02:24:45.685407+0000","last_unstale":"2024-08-17T02:24:46.673821+0000","last_undegraded":"2024-08-17T02:24:46.673821+0000","last_fullsized":"2024-08-17T02:24:46.673821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706888+0000","last_change":"2024-08-17T02:24:46.700959+0000","last_active":"2024-08-17T02:24:46.706888+0000","last_peered":"2024-08-17T02:24:46.706888+0000","last_clean":"2024-08-17T02:24:46.706888+0000","last_became_active":"2024-08-17T02:24:46.698769+0000","last_became_peered":"2024-08-17T02:24:46.698769+0000","last_unstale":"2024-08-17T02:24:46.706888+0000","last_undegraded":"2024-08-17T02:24:46.706888+0000","last_fullsized":"2024-08-17T02:24:46.706888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.683527+0000","last_change":"2024-08-17T02:24:45.687633+0000","last_active":"2024-08-17T02:24:46.683527+0000","last_peered":"2024-08-17T02:24:46.683527+0000","last_clean":"2024-08-17T02:24:46.683527+0000","last_became_active":"2024-08-17T02:24:45.687078+0000","last_became_peered":"2024-08-17T02:24:45.687078+0000","last_unstale":"2024-08-17T02:24:46.683527+0000","last_undegraded":"2024-08-17T02:24:46.683527+0000","last_fullsized":"2024-08-17T02:24:46.683527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706073+0000","last_change":"2024-08-17T02:24:46.696374+0000","last_active":"2024-08-17T02:24:46.706073+0000","last_peered":"2024-08-17T02:24:46.706073+0000","last_clean":"2024-08-17T02:24:46.706073+0000","last_became_active":"2024-08-17T02:24:46.695792+0000","last_became_peered":"2024-08-17T02:24:46.695792+0000","last_unstale":"2024-08-17T02:24:46.706073+0000","last_undegraded":"2024-08-17T02:24:46.706073+0000","last_fullsized":"2024-08-17T02:24:46.706073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.709576+0000","last_change":"2024-08-17T02:24:45.686489+0000","last_active":"2024-08-17T02:24:46.709576+0000","last_peered":"2024-08-17T02:24:46.709576+0000","last_clean":"2024-08-17T02:24:46.709576+0000","last_became_active":"2024-08-17T02:24:45.684809+0000","last_became_peered":"2024-08-17T02:24:45.684809+0000","last_unstale":"2024-08-17T02:24:46.709576+0000","last_undegraded":"2024-08-17T02:24:46.709576+0000","last_fullsized":"2024-08-17T02:24:46.709576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706951+0000","last_change":"2024-08-17T02:24:46.699050+0000","last_active":"2024-08-17T02:24:46.706951+0000","last_peered":"2024-08-17T02:24:46.706951+0000","last_clean":"2024-08-17T02:24:46.706951+0000","last_became_active":"2024-08-17T02:24:46.697848+0000","last_became_peered":"2024-08-17T02:24:46.697848+0000","last_unstale":"2024-08-17T02:24:46.706951+0000","last_undegraded":"2024-08-17T02:24:46.706951+0000","last_fullsized":"2024-08-17T02:24:46.706951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702818+0000","last_change":"2024-08-17T02:24:45.696348+0000","last_active":"2024-08-17T02:24:46.702818+0000","last_peered":"2024-08-17T02:24:46.702818+0000","last_clean":"2024-08-17T02:24:46.702818+0000","last_became_active":"2024-08-17T02:24:45.695978+0000","last_became_peered":"2024-08-17T02:24:45.695978+0000","last_unstale":"2024-08-17T02:24:46.702818+0000","last_undegraded":"2024-08-17T02:24:46.702818+0000","last_fullsized":"2024-08-17T02:24:46.702818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701299+0000","last_change":"2024-08-17T02:24:46.698921+0000","last_active":"2024-08-17T02:24:46.701299+0000","last_peered":"2024-08-17T02:24:46.701299+0000","last_clean":"2024-08-17T02:24:46.701299+0000","last_became_active":"2024-08-17T02:24:46.698688+0000","last_became_peered":"2024-08-17T02:24:46.698688+0000","last_unstale":"2024-08-17T02:24:46.701299+0000","last_undegraded":"2024-08-17T02:24:46.701299+0000","last_fullsized":"2024-08-17T02:24:46.701299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:37.590898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701865+0000","last_change":"2024-08-17T02:24:45.699315+0000","last_active":"2024-08-17T02:24:46.701865+0000","last_peered":"2024-08-17T02:24:46.701865+0000","last_clean":"2024-08-17T02:24:46.701865+0000","last_became_active":"2024-08-17T02:24:45.698964+0000","last_became_peered":"2024-08-17T02:24:45.698964+0000","last_unstale":"2024-08-17T02:24:46.701865+0000","last_undegraded":"2024-08-17T02:24:46.701865+0000","last_fullsized":"2024-08-17T02:24:46.701865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702236+0000","last_change":"2024-08-17T02:24:46.696697+0000","last_active":"2024-08-17T02:24:46.702236+0000","last_peered":"2024-08-17T02:24:46.702236+0000","last_clean":"2024-08-17T02:24:46.702236+0000","last_became_active":"2024-08-17T02:24:46.696387+0000","last_became_peered":"2024-08-17T02:24:46.696387+0000","last_unstale":"2024-08-17T02:24:46.702236+0000","last_undegraded":"2024-08-17T02:24:46.702236+0000","last_fullsized":"2024-08-17T02:24:46.702236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.705922+0000","last_change":"2024-08-17T02:24:45.693896+0000","last_active":"2024-08-17T02:24:46.705922+0000","last_peered":"2024-08-17T02:24:46.705922+0000","last_clean":"2024-08-17T02:24:46.705922+0000","last_became_active":"2024-08-17T02:24:45.693694+0000","last_became_peered":"2024-08-17T02:24:45.693694+0000","last_unstale":"2024-08-17T02:24:46.705922+0000","last_undegraded":"2024-08-17T02:24:46.705922+0000","last_fullsized":"2024-08-17T02:24:46.705922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:25.447726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702563+0000","last_change":"2024-08-17T02:24:46.695064+0000","last_active":"2024-08-17T02:24:46.702563+0000","last_peered":"2024-08-17T02:24:46.702563+0000","last_clean":"2024-08-17T02:24:46.702563+0000","last_became_active":"2024-08-17T02:24:46.694303+0000","last_became_peered":"2024-08-17T02:24:46.694303+0000","last_unstale":"2024-08-17T02:24:46.702563+0000","last_undegraded":"2024-08-17T02:24:46.702563+0000","last_fullsized":"2024-08-17T02:24:46.702563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682822+0000","last_change":"2024-08-17T02:24:45.693363+0000","last_active":"2024-08-17T02:24:46.682822+0000","last_peered":"2024-08-17T02:24:46.682822+0000","last_clean":"2024-08-17T02:24:46.682822+0000","last_became_active":"2024-08-17T02:24:45.693114+0000","last_became_peered":"2024-08-17T02:24:45.693114+0000","last_unstale":"2024-08-17T02:24:46.682822+0000","last_undegraded":"2024-08-17T02:24:46.682822+0000","last_fullsized":"2024-08-17T02:24:46.682822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706914+0000","last_change":"2024-08-17T02:24:46.703793+0000","last_active":"2024-08-17T02:24:46.706914+0000","last_peered":"2024-08-17T02:24:46.706914+0000","last_clean":"2024-08-17T02:24:46.706914+0000","last_became_active":"2024-08-17T02:24:46.703493+0000","last_became_peered":"2024-08-17T02:24:46.703493+0000","last_unstale":"2024-08-17T02:24:46.706914+0000","last_undegraded":"2024-08-17T02:24:46.706914+0000","last_fullsized":"2024-08-17T02:24:46.706914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.685754+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:24:46.685754+0000","last_peered":"2024-08-17T02:24:46.685754+0000","last_clean":"2024-08-17T02:24:46.685754+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:24:46.685754+0000","last_undegraded":"2024-08-17T02:24:46.685754+0000","last_fullsized":"2024-08-17T02:24:46.685754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.676656+0000","last_change":"2024-08-17T02:24:45.684657+0000","last_active":"2024-08-17T02:24:46.676656+0000","last_peered":"2024-08-17T02:24:46.676656+0000","last_clean":"2024-08-17T02:24:46.676656+0000","last_became_active":"2024-08-17T02:24:45.683930+0000","last_became_peered":"2024-08-17T02:24:45.683930+0000","last_unstale":"2024-08-17T02:24:46.676656+0000","last_undegraded":"2024-08-17T02:24:46.676656+0000","last_fullsized":"2024-08-17T02:24:46.676656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700029+0000","last_change":"2024-08-17T02:24:46.690032+0000","last_active":"2024-08-17T02:24:46.700029+0000","last_peered":"2024-08-17T02:24:46.700029+0000","last_clean":"2024-08-17T02:24:46.700029+0000","last_became_active":"2024-08-17T02:24:46.689692+0000","last_became_peered":"2024-08-17T02:24:46.689692+0000","last_unstale":"2024-08-17T02:24:46.700029+0000","last_undegraded":"2024-08-17T02:24:46.700029+0000","last_fullsized":"2024-08-17T02:24:46.700029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:49.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673191+0000","last_change":"2024-08-17T02:24:45.695195+0000","last_active":"2024-08-17T02:24:46.673191+0000","last_peered":"2024-08-17T02:24:46.673191+0000","last_clean":"2024-08-17T02:24:46.673191+0000","last_became_active":"2024-08-17T02:24:45.694908+0000","last_became_peered":"2024-08-17T02:24:45.694908+0000","last_unstale":"2024-08-17T02:24:46.673191+0000","last_undegraded":"2024-08-17T02:24:46.673191+0000","last_fullsized":"2024-08-17T02:24:46.673191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700963+0000","last_change":"2024-08-17T02:24:46.698400+0000","last_active":"2024-08-17T02:24:46.700963+0000","last_peered":"2024-08-17T02:24:46.700963+0000","last_clean":"2024-08-17T02:24:46.700963+0000","last_became_active":"2024-08-17T02:24:46.697641+0000","last_became_peered":"2024-08-17T02:24:46.697641+0000","last_unstale":"2024-08-17T02:24:46.700963+0000","last_undegraded":"2024-08-17T02:24:46.700963+0000","last_fullsized":"2024-08-17T02:24:46.700963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682928+0000","last_change":"2024-08-17T02:24:45.696585+0000","last_active":"2024-08-17T02:24:46.682928+0000","last_peered":"2024-08-17T02:24:46.682928+0000","last_clean":"2024-08-17T02:24:46.682928+0000","last_became_active":"2024-08-17T02:24:45.696243+0000","last_became_peered":"2024-08-17T02:24:45.696243+0000","last_unstale":"2024-08-17T02:24:46.682928+0000","last_undegraded":"2024-08-17T02:24:46.682928+0000","last_fullsized":"2024-08-17T02:24:46.682928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700945+0000","last_change":"2024-08-17T02:24:46.692661+0000","last_active":"2024-08-17T02:24:46.700945+0000","last_peered":"2024-08-17T02:24:46.700945+0000","last_clean":"2024-08-17T02:24:46.700945+0000","last_became_active":"2024-08-17T02:24:46.692144+0000","last_became_peered":"2024-08-17T02:24:46.692144+0000","last_unstale":"2024-08-17T02:24:46.700945+0000","last_undegraded":"2024-08-17T02:24:46.700945+0000","last_fullsized":"2024-08-17T02:24:46.700945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:16.650137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.674060+0000","last_change":"2024-08-17T02:24:45.689974+0000","last_active":"2024-08-17T02:24:46.674060+0000","last_peered":"2024-08-17T02:24:46.674060+0000","last_clean":"2024-08-17T02:24:46.674060+0000","last_became_active":"2024-08-17T02:24:45.689686+0000","last_became_peered":"2024-08-17T02:24:45.689686+0000","last_unstale":"2024-08-17T02:24:46.674060+0000","last_undegraded":"2024-08-17T02:24:46.674060+0000","last_fullsized":"2024-08-17T02:24:46.674060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:02.113673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702323+0000","last_change":"2024-08-17T02:24:46.695491+0000","last_active":"2024-08-17T02:24:46.702323+0000","last_peered":"2024-08-17T02:24:46.702323+0000","last_clean":"2024-08-17T02:24:46.702323+0000","last_became_active":"2024-08-17T02:24:46.694910+0000","last_became_peered":"2024-08-17T02:24:46.694910+0000","last_unstale":"2024-08-17T02:24:46.702323+0000","last_undegraded":"2024-08-17T02:24:46.702323+0000","last_fullsized":"2024-08-17T02:24:46.702323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:17.309712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.675664+0000","last_change":"2024-08-17T02:24:45.693494+0000","last_active":"2024-08-17T02:24:46.675664+0000","last_peered":"2024-08-17T02:24:46.675664+0000","last_clean":"2024-08-17T02:24:46.675664+0000","last_became_active":"2024-08-17T02:24:45.691399+0000","last_became_peered":"2024-08-17T02:24:45.691399+0000","last_unstale":"2024-08-17T02:24:46.675664+0000","last_undegraded":"2024-08-17T02:24:46.675664+0000","last_fullsized":"2024-08-17T02:24:46.675664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:47.538687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699510+0000","last_change":"2024-08-17T02:24:46.697272+0000","last_active":"2024-08-17T02:24:46.699510+0000","last_peered":"2024-08-17T02:24:46.699510+0000","last_clean":"2024-08-17T02:24:46.699510+0000","last_became_active":"2024-08-17T02:24:46.696866+0000","last_became_peered":"2024-08-17T02:24:46.696866+0000","last_unstale":"2024-08-17T02:24:46.699510+0000","last_undegraded":"2024-08-17T02:24:46.699510+0000","last_fullsized":"2024-08-17T02:24:46.699510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.677187+0000","last_change":"2024-08-17T02:24:45.689340+0000","last_active":"2024-08-17T02:24:46.677187+0000","last_peered":"2024-08-17T02:24:46.677187+0000","last_clean":"2024-08-17T02:24:46.677187+0000","last_became_active":"2024-08-17T02:24:45.687263+0000","last_became_peered":"2024-08-17T02:24:45.687263+0000","last_unstale":"2024-08-17T02:24:46.677187+0000","last_undegraded":"2024-08-17T02:24:46.677187+0000","last_fullsized":"2024-08-17T02:24:46.677187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694607+0000","last_change":"2024-08-17T02:24:46.687663+0000","last_active":"2024-08-17T02:24:46.694607+0000","last_peered":"2024-08-17T02:24:46.694607+0000","last_clean":"2024-08-17T02:24:46.694607+0000","last_became_active":"2024-08-17T02:24:46.687285+0000","last_became_peered":"2024-08-17T02:24:46.687285+0000","last_unstale":"2024-08-17T02:24:46.694607+0000","last_undegraded":"2024-08-17T02:24:46.694607+0000","last_fullsized":"2024-08-17T02:24:46.694607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-08-17T02:24:47.813909+0000","last_change":"2024-08-17T02:24:45.692340+0000","last_active":"2024-08-17T02:24:47.813909+0000","last_peered":"2024-08-17T02:24:47.813909+0000","last_clean":"2024-08-17T02:24:47.813909+0000","last_became_active":"2024-08-17T02:24:45.691959+0000","last_became_peered":"2024-08-17T02:24:45.691959+0000","last_unstale":"2024-08-17T02:24:47.813909+0000","last_undegraded":"2024-08-17T02:24:47.813909+0000","last_fullsized":"2024-08-17T02:24:47.813909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701175+0000","last_change":"2024-08-17T02:24:46.699671+0000","last_active":"2024-08-17T02:24:46.701175+0000","last_peered":"2024-08-17T02:24:46.701175+0000","last_clean":"2024-08-17T02:24:46.701175+0000","last_became_active":"2024-08-17T02:24:46.699384+0000","last_became_peered":"2024-08-17T02:24:46.699384+0000","last_unstale":"2024-08-17T02:24:46.701175+0000","last_undegraded":"2024-08-17T02:24:46.701175+0000","last_fullsized":"2024-08-17T02:24:46.701175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706578+0000","last_change":"2024-08-17T02:24:45.689016+0000","last_active":"2024-08-17T02:24:46.706578+0000","last_peered":"2024-08-17T02:24:46.706578+0000","last_clean":"2024-08-17T02:24:46.706578+0000","last_became_active":"2024-08-17T02:24:45.688568+0000","last_became_peered":"2024-08-17T02:24:45.688568+0000","last_unstale":"2024-08-17T02:24:46.706578+0000","last_undegraded":"2024-08-17T02:24:46.706578+0000","last_fullsized":"2024-08-17T02:24:46.706578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:31.920700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700042+0000","last_change":"2024-08-17T02:24:46.690217+0000","last_active":"2024-08-17T02:24:46.700042+0000","last_peered":"2024-08-17T02:24:46.700042+0000","last_clean":"2024-08-17T02:24:46.700042+0000","last_became_active":"2024-08-17T02:24:46.689945+0000","last_became_peered":"2024-08-17T02:24:46.689945+0000","last_unstale":"2024-08-17T02:24:46.700042+0000","last_undegraded":"2024-08-17T02:24:46.700042+0000","last_fullsized":"2024-08-17T02:24:46.700042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691093+0000","last_change":"2024-08-17T02:24:45.692162+0000","last_active":"2024-08-17T02:24:46.691093+0000","last_peered":"2024-08-17T02:24:46.691093+0000","last_clean":"2024-08-17T02:24:46.691093+0000","last_became_active":"2024-08-17T02:24:45.691864+0000","last_became_peered":"2024-08-17T02:24:45.691864+0000","last_unstale":"2024-08-17T02:24:46.691093+0000","last_undegraded":"2024-08-17T02:24:46.691093+0000","last_fullsized":"2024-08-17T02:24:46.691093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706928+0000","last_change":"2024-08-17T02:24:46.693752+0000","last_active":"2024-08-17T02:24:46.706928+0000","last_peered":"2024-08-17T02:24:46.706928+0000","last_clean":"2024-08-17T02:24:46.706928+0000","last_became_active":"2024-08-17T02:24:46.693452+0000","last_became_peered":"2024-08-17T02:24:46.693452+0000","last_unstale":"2024-08-17T02:24:46.706928+0000","last_undegraded":"2024-08-17T02:24:46.706928+0000","last_fullsized":"2024-08-17T02:24:46.706928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.504743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682032+0000","last_change":"2024-08-17T02:24:45.695549+0000","last_active":"2024-08-17T02:24:46.682032+0000","last_peered":"2024-08-17T02:24:46.682032+0000","last_clean":"2024-08-17T02:24:46.682032+0000","last_became_active":"2024-08-17T02:24:45.695270+0000","last_became_peered":"2024-08-17T02:24:45.695270+0000","last_unstale":"2024-08-17T02:24:46.682032+0000","last_undegraded":"2024-08-17T02:24:46.682032+0000","last_fullsized":"2024-08-17T02:24:46.682032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700059+0000","last_change":"2024-08-17T02:24:46.689650+0000","last_active":"2024-08-17T02:24:46.700059+0000","last_peered":"2024-08-17T02:24:46.700059+0000","last_clean":"2024-08-17T02:24:46.700059+0000","last_became_active":"2024-08-17T02:24:46.689361+0000","last_became_peered":"2024-08-17T02:24:46.689361+0000","last_unstale":"2024-08-17T02:24:46.700059+0000","last_undegraded":"2024-08-17T02:24:46.700059+0000","last_fullsized":"2024-08-17T02:24:46.700059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.685591+0000","last_change":"2024-08-17T02:24:45.688479+0000","last_active":"2024-08-17T02:24:46.685591+0000","last_peered":"2024-08-17T02:24:46.685591+0000","last_clean":"2024-08-17T02:24:46.685591+0000","last_became_active":"2024-08-17T02:24:45.688105+0000","last_became_peered":"2024-08-17T02:24:45.688105+0000","last_unstale":"2024-08-17T02:24:46.685591+0000","last_undegraded":"2024-08-17T02:24:46.685591+0000","last_fullsized":"2024-08-17T02:24:46.685591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703549+0000","last_change":"2024-08-17T02:24:46.693894+0000","last_active":"2024-08-17T02:24:46.703549+0000","last_peered":"2024-08-17T02:24:46.703549+0000","last_clean":"2024-08-17T02:24:46.703549+0000","last_became_active":"2024-08-17T02:24:46.693611+0000","last_became_peered":"2024-08-17T02:24:46.693611+0000","last_unstale":"2024-08-17T02:24:46.703549+0000","last_undegraded":"2024-08-17T02:24:46.703549+0000","last_fullsized":"2024-08-17T02:24:46.703549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706372+0000","last_change":"2024-08-17T02:24:45.684136+0000","last_active":"2024-08-17T02:24:46.706372+0000","last_peered":"2024-08-17T02:24:46.706372+0000","last_clean":"2024-08-17T02:24:46.706372+0000","last_became_active":"2024-08-17T02:24:45.683723+0000","last_became_peered":"2024-08-17T02:24:45.683723+0000","last_unstale":"2024-08-17T02:24:46.706372+0000","last_undegraded":"2024-08-17T02:24:46.706372+0000","last_fullsized":"2024-08-17T02:24:46.706372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707394+0000","last_change":"2024-08-17T02:24:46.691308+0000","last_active":"2024-08-17T02:24:46.707394+0000","last_peered":"2024-08-17T02:24:46.707394+0000","last_clean":"2024-08-17T02:24:46.707394+0000","last_became_active":"2024-08-17T02:24:46.691046+0000","last_became_peered":"2024-08-17T02:24:46.691046+0000","last_unstale":"2024-08-17T02:24:46.707394+0000","last_undegraded":"2024-08-17T02:24:46.707394+0000","last_fullsized":"2024-08-17T02:24:46.707394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706877+0000","last_change":"2024-08-17T02:24:46.699150+0000","last_active":"2024-08-17T02:24:46.706877+0000","last_peered":"2024-08-17T02:24:46.706877+0000","last_clean":"2024-08-17T02:24:46.706877+0000","last_became_active":"2024-08-17T02:24:46.697504+0000","last_became_peered":"2024-08-17T02:24:46.697504+0000","last_unstale":"2024-08-17T02:24:46.706877+0000","last_undegraded":"2024-08-17T02:24:46.706877+0000","last_fullsized":"2024-08-17T02:24:46.706877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711183+0000","last_change":"2024-08-17T02:24:45.690864+0000","last_active":"2024-08-17T02:24:46.711183+0000","last_peered":"2024-08-17T02:24:46.711183+0000","last_clean":"2024-08-17T02:24:46.711183+0000","last_became_active":"2024-08-17T02:24:45.687405+0000","last_became_peered":"2024-08-17T02:24:45.687405+0000","last_unstale":"2024-08-17T02:24:46.711183+0000","last_undegraded":"2024-08-17T02:24:46.711183+0000","last_fullsized":"2024-08-17T02:24:46.711183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710456+0000","last_change":"2024-08-17T02:24:46.702644+0000","last_active":"2024-08-17T02:24:46.710456+0000","last_peered":"2024-08-17T02:24:46.710456+0000","last_clean":"2024-08-17T02:24:46.710456+0000","last_became_active":"2024-08-17T02:24:46.701576+0000","last_became_peered":"2024-08-17T02:24:46.701576+0000","last_unstale":"2024-08-17T02:24:46.710456+0000","last_undegraded":"2024-08-17T02:24:46.710456+0000","last_fullsized":"2024-08-17T02:24:46.710456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:12.393424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710630+0000","last_change":"2024-08-17T02:24:45.689395+0000","last_active":"2024-08-17T02:24:46.710630+0000","last_peered":"2024-08-17T02:24:46.710630+0000","last_clean":"2024-08-17T02:24:46.710630+0000","last_became_active":"2024-08-17T02:24:45.689082+0000","last_became_peered":"2024-08-17T02:24:45.689082+0000","last_unstale":"2024-08-17T02:24:46.710630+0000","last_undegraded":"2024-08-17T02:24:46.710630+0000","last_fullsized":"2024-08-17T02:24:46.710630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703445+0000","last_change":"2024-08-17T02:24:46.697195+0000","last_active":"2024-08-17T02:24:46.703445+0000","last_peered":"2024-08-17T02:24:46.703445+0000","last_clean":"2024-08-17T02:24:46.703445+0000","last_became_active":"2024-08-17T02:24:46.696949+0000","last_became_peered":"2024-08-17T02:24:46.696949+0000","last_unstale":"2024-08-17T02:24:46.703445+0000","last_undegraded":"2024-08-17T02:24:46.703445+0000","last_fullsized":"2024-08-17T02:24:46.703445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:22.938256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703915+0000","last_change":"2024-08-17T02:24:45.687064+0000","last_active":"2024-08-17T02:24:46.703915+0000","last_peered":"2024-08-17T02:24:46.703915+0000","last_clean":"2024-08-17T02:24:46.703915+0000","last_became_active":"2024-08-17T02:24:45.686543+0000","last_became_peered":"2024-08-17T02:24:45.686543+0000","last_unstale":"2024-08-17T02:24:46.703915+0000","last_undegraded":"2024-08-17T02:24:46.703915+0000","last_fullsized":"2024-08-17T02:24:46.703915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:47.125586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696443+0000","last_change":"2024-08-17T02:24:46.688626+0000","last_active":"2024-08-17T02:24:46.696443+0000","last_peered":"2024-08-17T02:24:46.696443+0000","last_clean":"2024-08-17T02:24:46.696443+0000","last_became_active":"2024-08-17T02:24:46.688208+0000","last_became_peered":"2024-08-17T02:24:46.688208+0000","last_unstale":"2024-08-17T02:24:46.696443+0000","last_undegraded":"2024-08-17T02:24:46.696443+0000","last_fullsized":"2024-08-17T02:24:46.696443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:20.339019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708842+0000","last_change":"2024-08-17T02:24:45.687257+0000","last_active":"2024-08-17T02:24:46.708842+0000","last_peered":"2024-08-17T02:24:46.708842+0000","last_clean":"2024-08-17T02:24:46.708842+0000","last_became_active":"2024-08-17T02:24:45.686911+0000","last_became_peered":"2024-08-17T02:24:45.686911+0000","last_unstale":"2024-08-17T02:24:46.708842+0000","last_undegraded":"2024-08-17T02:24:46.708842+0000","last_fullsized":"2024-08-17T02:24:46.708842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":241664,"data_stored":80755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":233472,"data_stored":80631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":253952,"data_stored":82843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":81201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":245760,"data_stored":82183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":831488,"data_stored":671069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":241664,"data_stored":80687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":835584,"data_stored":671091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:58.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:24:58.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f30126dd700 1 Processor -- start 2024-08-17T02:24:58.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f30126dd700 1 -- start start 2024-08-17T02:24:58.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f30126dd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f300c14c7e0 0x7f300c0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f30126dd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300c1564a0 con 0x7f300c14cc40 2024-08-17T02:24:58.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f30126dd700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300c156780 con 0x7f300c155ed0 2024-08-17T02:24:58.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f30126dd700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300c1562a0 con 0x7f300c14c7e0 2024-08-17T02:24:58.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f3011edc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f300c14cc40 0x7f300c0abd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58520/0 (socket says 172.21.15.31:58520) 2024-08-17T02:24:58.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f3011edc700 1 -- 172.21.15.31:0/400148385 learned_addr learned my addr 172.21.15.31:0/400148385 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:58.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f3010eda700 1 --2- 172.21.15.31:0/400148385 >> v2:172.21.15.92:3300/0 conn(0x7f300c14c7e0 0x7f300c0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f3003fff700 1 -- 172.21.15.31:0/400148385 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280272168 0 0) 0x7f300c1564a0 con 0x7f300c14cc40 2024-08-17T02:24:58.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f3003fff700 1 -- 172.21.15.31:0/400148385 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff4003570 con 0x7f300c14cc40 2024-08-17T02:24:58.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f3010eda700 1 -- 172.21.15.31:0/400148385 >> v1:172.21.15.92:6789/0 conn(0x7f300c155ed0 legacy=0x7f300c0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.294+0000 7f3010eda700 1 -- 172.21.15.31:0/400148385 >> v1:172.21.15.31:6789/0 conn(0x7f300c14cc40 legacy=0x7f300c0abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f3010eda700 1 -- 172.21.15.31:0/400148385 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c156a60 con 0x7f300c14c7e0 2024-08-17T02:24:58.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f3010eda700 1 --2- 172.21.15.31:0/400148385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f300c14c7e0 0x7f300c0b16b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3008009e60 tx=0x7f3008009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=714f49afd3a21959 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f3003fff700 1 -- 172.21.15.31:0/400148385 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800e070 con 0x7f300c14c7e0 2024-08-17T02:24:58.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f3003fff700 1 -- 172.21.15.31:0/400148385 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800bb60 con 0x7f300c14c7e0 2024-08-17T02:24:58.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f3003fff700 1 -- 172.21.15.31:0/400148385 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3008012430 con 0x7f300c14c7e0 2024-08-17T02:24:58.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f30126dd700 1 -- 172.21.15.31:0/400148385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f300c14c7e0 msgr2=0x7f300c0b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f30126dd700 1 --2- 172.21.15.31:0/400148385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f300c14c7e0 0x7f300c0b16b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3008009e60 tx=0x7f3008009780 comp rx=0 tx=0).stop 2024-08-17T02:24:58.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f30126dd700 1 -- 172.21.15.31:0/400148385 shutdown_connections 2024-08-17T02:24:58.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f30126dd700 1 --2- 172.21.15.31:0/400148385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f300c14c7e0 0x7f300c0b16b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f30126dd700 1 -- 172.21.15.31:0/400148385 >> 172.21.15.31:0/400148385 conn(0x7f300c067400 msgr2=0x7f300c067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f30126dd700 1 -- 172.21.15.31:0/400148385 shutdown_connections 2024-08-17T02:24:58.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f30126dd700 1 -- 172.21.15.31:0/400148385 wait complete. 2024-08-17T02:24:58.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f30126dd700 1 Processor -- start 2024-08-17T02:24:58.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.298+0000 7f30126dd700 1 -- start start 2024-08-17T02:24:58.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30126dd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f300c14c7e0 0x7f300c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30126dd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f300c155ed0 0x7f300c149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30126dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f300c14a190 0x7f300c0cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30126dd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c153320 con 0x7f300c14a190 2024-08-17T02:24:58.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30126dd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c1529f0 con 0x7f300c155ed0 2024-08-17T02:24:58.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30126dd700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300c152cd0 con 0x7f300c14c7e0 2024-08-17T02:24:58.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f3011edc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f300c14a190 0x7f300c0cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f3011edc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f300c14a190 0x7f300c0cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48992/0 (socket says 172.21.15.31:48992) 2024-08-17T02:24:58.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f3011edc700 1 -- 172.21.15.31:0/1804133805 learned_addr learned my addr 172.21.15.31:0/1804133805 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:58.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f3010eda700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f300c155ed0 0x7f300c149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30116db700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f300c14c7e0 0x7f300c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f3011edc700 1 -- 172.21.15.31:0/1804133805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f300c14c7e0 msgr2=0x7f300c0c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f3011edc700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f300c14c7e0 0x7f300c0c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f3011edc700 1 -- 172.21.15.31:0/1804133805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f300c155ed0 msgr2=0x7f300c149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f3011edc700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f300c155ed0 0x7f300c149890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f3011edc700 1 -- 172.21.15.31:0/1804133805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008009a20 con 0x7f300c14a190 2024-08-17T02:24:58.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f3011edc700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f300c14a190 0x7f300c0cab50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f300400c790 tx=0x7f3004007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30017fa700 1 -- 172.21.15.31:0/1804133805 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004005c00 con 0x7f300c14a190 2024-08-17T02:24:58.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30126dd700 1 -- 172.21.15.31:0/1804133805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300c152fb0 con 0x7f300c14a190 2024-08-17T02:24:58.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30126dd700 1 -- 172.21.15.31:0/1804133805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300c0c9400 con 0x7f300c14a190 2024-08-17T02:24:58.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30017fa700 1 -- 172.21.15.31:0/1804133805 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30040070d0 con 0x7f300c14a190 2024-08-17T02:24:58.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.302+0000 7f30017fa700 1 -- 172.21.15.31:0/1804133805 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004007240 con 0x7f300c14a190 2024-08-17T02:24:58.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.306+0000 7f30126dd700 1 -- 172.21.15.31:0/1804133805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300c0712b0 con 0x7f300c14a190 2024-08-17T02:24:58.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.306+0000 7f30017fa700 1 -- 172.21.15.31:0/1804133805 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f30040073a0 con 0x7f300c14a190 2024-08-17T02:24:58.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.306+0000 7f30017fa700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ff8060890 0x7f2ff8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.306+0000 7f30017fa700 1 -- 172.21.15.31:0/1804133805 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f300407bd30 con 0x7f300c14a190 2024-08-17T02:24:58.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.306+0000 7f30116db700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ff8060890 0x7f2ff8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.306+0000 7f30116db700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ff8060890 0x7f2ff8062d40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f300c158b70 tx=0x7f2ffc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.310+0000 7f30017fa700 1 -- 172.21.15.31:0/1804133805 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f300404c1a0 con 0x7f300c14a190 2024-08-17T02:24:58.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.466+0000 7f30126dd700 1 -- 172.21.15.31:0/1804133805 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f300c152b60 con 0x7f2ff8060890 2024-08-17T02:24:58.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.482+0000 7f30017fa700 1 -- 172.21.15.31:0/1804133805 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264399 (secure 0 0 0) 0x7f300c152b60 con 0x7f2ff8060890 2024-08-17T02:24:58.492 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:58.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 -- 172.21.15.31:0/1804133805 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ff8060890 msgr2=0x7f2ff8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ff8060890 0x7f2ff8062d40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f300c158b70 tx=0x7f2ffc009040 comp rx=0 tx=0).stop 2024-08-17T02:24:58.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 -- 172.21.15.31:0/1804133805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f300c14a190 msgr2=0x7f300c0cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f300c14a190 0x7f300c0cab50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f300400c790 tx=0x7f3004007d90 comp rx=0 tx=0).stop 2024-08-17T02:24:58.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 -- 172.21.15.31:0/1804133805 shutdown_connections 2024-08-17T02:24:58.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ff8060890 0x7f2ff8062d40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f300c14a190 0x7f300c0cab50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f300c155ed0 0x7f300c149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 --2- 172.21.15.31:0/1804133805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f300c14c7e0 0x7f300c0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 -- 172.21.15.31:0/1804133805 >> 172.21.15.31:0/1804133805 conn(0x7f300c067400 msgr2=0x7f300c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 -- 172.21.15.31:0/1804133805 shutdown_connections 2024-08-17T02:24:58.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.486+0000 7f30126dd700 1 -- 172.21.15.31:0/1804133805 wait complete. 2024-08-17T02:24:58.495 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:24:58.508 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-08-17T02:24:57.585397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381932,"kb_used_data":3048,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752592788,"statfs":{"total":773094113280,"available":770655014912,"internally_reserved":0,"allocated":3121152,"data_stored":1830460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003118"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714546+0000","last_change":"2024-08-17T02:24:46.711137+0000","last_active":"2024-08-17T02:24:46.714546+0000","last_peered":"2024-08-17T02:24:46.714546+0000","last_clean":"2024-08-17T02:24:46.714546+0000","last_became_active":"2024-08-17T02:24:46.710820+0000","last_became_peered":"2024-08-17T02:24:46.710820+0000","last_unstale":"2024-08-17T02:24:46.714546+0000","last_undegraded":"2024-08-17T02:24:46.714546+0000","last_fullsized":"2024-08-17T02:24:46.714546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696492+0000","last_change":"2024-08-17T02:24:46.689088+0000","last_active":"2024-08-17T02:24:46.696492+0000","last_peered":"2024-08-17T02:24:46.696492+0000","last_clean":"2024-08-17T02:24:46.696492+0000","last_became_active":"2024-08-17T02:24:46.688753+0000","last_became_peered":"2024-08-17T02:24:46.688753+0000","last_unstale":"2024-08-17T02:24:46.696492+0000","last_undegraded":"2024-08-17T02:24:46.696492+0000","last_fullsized":"2024-08-17T02:24:46.696492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:20.964222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700771+0000","last_change":"2024-08-17T02:24:46.695883+0000","last_active":"2024-08-17T02:24:46.700771+0000","last_peered":"2024-08-17T02:24:46.700771+0000","last_clean":"2024-08-17T02:24:46.700771+0000","last_became_active":"2024-08-17T02:24:46.695594+0000","last_became_peered":"2024-08-17T02:24:46.695594+0000","last_unstale":"2024-08-17T02:24:46.700771+0000","last_undegraded":"2024-08-17T02:24:46.700771+0000","last_fullsized":"2024-08-17T02:24:46.700771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:45:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707546+0000","last_change":"2024-08-17T02:24:46.702343+0000","last_active":"2024-08-17T02:24:46.707546+0000","last_peered":"2024-08-17T02:24:46.707546+0000","last_clean":"2024-08-17T02:24:46.707546+0000","last_became_active":"2024-08-17T02:24:46.700536+0000","last_became_peered":"2024-08-17T02:24:46.700536+0000","last_unstale":"2024-08-17T02:24:46.707546+0000","last_undegraded":"2024-08-17T02:24:46.707546+0000","last_fullsized":"2024-08-17T02:24:46.707546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702344+0000","last_change":"2024-08-17T02:24:46.697977+0000","last_active":"2024-08-17T02:24:46.702344+0000","last_peered":"2024-08-17T02:24:46.702344+0000","last_clean":"2024-08-17T02:24:46.702344+0000","last_became_active":"2024-08-17T02:24:46.697680+0000","last_became_peered":"2024-08-17T02:24:46.697680+0000","last_unstale":"2024-08-17T02:24:46.702344+0000","last_undegraded":"2024-08-17T02:24:46.702344+0000","last_fullsized":"2024-08-17T02:24:46.702344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.698897+0000","last_change":"2024-08-17T02:24:46.696070+0000","last_active":"2024-08-17T02:24:46.698897+0000","last_peered":"2024-08-17T02:24:46.698897+0000","last_clean":"2024-08-17T02:24:46.698897+0000","last_became_active":"2024-08-17T02:24:46.693809+0000","last_became_peered":"2024-08-17T02:24:46.693809+0000","last_unstale":"2024-08-17T02:24:46.698897+0000","last_undegraded":"2024-08-17T02:24:46.698897+0000","last_fullsized":"2024-08-17T02:24:46.698897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699991+0000","last_change":"2024-08-17T02:24:46.694034+0000","last_active":"2024-08-17T02:24:46.699991+0000","last_peered":"2024-08-17T02:24:46.699991+0000","last_clean":"2024-08-17T02:24:46.699991+0000","last_became_active":"2024-08-17T02:24:46.693720+0000","last_became_peered":"2024-08-17T02:24:46.693720+0000","last_unstale":"2024-08-17T02:24:46.699991+0000","last_undegraded":"2024-08-17T02:24:46.699991+0000","last_fullsized":"2024-08-17T02:24:46.699991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:25.120018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703650+0000","last_change":"2024-08-17T02:24:46.698687+0000","last_active":"2024-08-17T02:24:46.703650+0000","last_peered":"2024-08-17T02:24:46.703650+0000","last_clean":"2024-08-17T02:24:46.703650+0000","last_became_active":"2024-08-17T02:24:46.698410+0000","last_became_peered":"2024-08-17T02:24:46.698410+0000","last_unstale":"2024-08-17T02:24:46.703650+0000","last_undegraded":"2024-08-17T02:24:46.703650+0000","last_fullsized":"2024-08-17T02:24:46.703650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:40:14.395986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714270+0000","last_change":"2024-08-17T02:24:46.710805+0000","last_active":"2024-08-17T02:24:46.714270+0000","last_peered":"2024-08-17T02:24:46.714270+0000","last_clean":"2024-08-17T02:24:46.714270+0000","last_became_active":"2024-08-17T02:24:46.710510+0000","last_became_peered":"2024-08-17T02:24:46.710510+0000","last_unstale":"2024-08-17T02:24:46.714270+0000","last_undegraded":"2024-08-17T02:24:46.714270+0000","last_fullsized":"2024-08-17T02:24:46.714270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702497+0000","last_change":"2024-08-17T02:24:46.695508+0000","last_active":"2024-08-17T02:24:46.702497+0000","last_peered":"2024-08-17T02:24:46.702497+0000","last_clean":"2024-08-17T02:24:46.702497+0000","last_became_active":"2024-08-17T02:24:46.695174+0000","last_became_peered":"2024-08-17T02:24:46.695174+0000","last_unstale":"2024-08-17T02:24:46.702497+0000","last_undegraded":"2024-08-17T02:24:46.702497+0000","last_fullsized":"2024-08-17T02:24:46.702497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:26.358220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714534+0000","last_change":"2024-08-17T02:24:46.711058+0000","last_active":"2024-08-17T02:24:46.714534+0000","last_peered":"2024-08-17T02:24:46.714534+0000","last_clean":"2024-08-17T02:24:46.714534+0000","last_became_active":"2024-08-17T02:24:46.710739+0000","last_became_peered":"2024-08-17T02:24:46.710739+0000","last_unstale":"2024-08-17T02:24:46.714534+0000","last_undegraded":"2024-08-17T02:24:46.714534+0000","last_fullsized":"2024-08-17T02:24:46.714534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702585+0000","last_change":"2024-08-17T02:24:46.695791+0000","last_active":"2024-08-17T02:24:46.702585+0000","last_peered":"2024-08-17T02:24:46.702585+0000","last_clean":"2024-08-17T02:24:46.702585+0000","last_became_active":"2024-08-17T02:24:46.695116+0000","last_became_peered":"2024-08-17T02:24:46.695116+0000","last_unstale":"2024-08-17T02:24:46.702585+0000","last_undegraded":"2024-08-17T02:24:46.702585+0000","last_fullsized":"2024-08-17T02:24:46.702585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703379+0000","last_change":"2024-08-17T02:24:46.699896+0000","last_active":"2024-08-17T02:24:46.703379+0000","last_peered":"2024-08-17T02:24:46.703379+0000","last_clean":"2024-08-17T02:24:46.703379+0000","last_became_active":"2024-08-17T02:24:46.699645+0000","last_became_peered":"2024-08-17T02:24:46.699645+0000","last_unstale":"2024-08-17T02:24:46.703379+0000","last_undegraded":"2024-08-17T02:24:46.703379+0000","last_fullsized":"2024-08-17T02:24:46.703379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:02:36.261958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694896+0000","last_change":"2024-08-17T02:24:46.690505+0000","last_active":"2024-08-17T02:24:46.694896+0000","last_peered":"2024-08-17T02:24:46.694896+0000","last_clean":"2024-08-17T02:24:46.694896+0000","last_became_active":"2024-08-17T02:24:46.690185+0000","last_became_peered":"2024-08-17T02:24:46.690185+0000","last_unstale":"2024-08-17T02:24:46.694896+0000","last_undegraded":"2024-08-17T02:24:46.694896+0000","last_fullsized":"2024-08-17T02:24:46.694896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703730+0000","last_change":"2024-08-17T02:24:46.698787+0000","last_active":"2024-08-17T02:24:46.703730+0000","last_peered":"2024-08-17T02:24:46.703730+0000","last_clean":"2024-08-17T02:24:46.703730+0000","last_became_active":"2024-08-17T02:24:46.698418+0000","last_became_peered":"2024-08-17T02:24:46.698418+0000","last_unstale":"2024-08-17T02:24:46.703730+0000","last_undegraded":"2024-08-17T02:24:46.703730+0000","last_fullsized":"2024-08-17T02:24:46.703730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:40.310047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706590+0000","last_change":"2024-08-17T02:24:46.690550+0000","last_active":"2024-08-17T02:24:46.706590+0000","last_peered":"2024-08-17T02:24:46.706590+0000","last_clean":"2024-08-17T02:24:46.706590+0000","last_became_active":"2024-08-17T02:24:46.690231+0000","last_became_peered":"2024-08-17T02:24:46.690231+0000","last_unstale":"2024-08-17T02:24:46.706590+0000","last_undegraded":"2024-08-17T02:24:46.706590+0000","last_fullsized":"2024-08-17T02:24:46.706590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:40:04.175081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706996+0000","last_change":"2024-08-17T02:24:46.703443+0000","last_active":"2024-08-17T02:24:46.706996+0000","last_peered":"2024-08-17T02:24:46.706996+0000","last_clean":"2024-08-17T02:24:46.706996+0000","last_became_active":"2024-08-17T02:24:46.703111+0000","last_became_peered":"2024-08-17T02:24:46.703111+0000","last_unstale":"2024-08-17T02:24:46.706996+0000","last_undegraded":"2024-08-17T02:24:46.706996+0000","last_fullsized":"2024-08-17T02:24:46.706996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703691+0000","last_change":"2024-08-17T02:24:46.695275+0000","last_active":"2024-08-17T02:24:46.703691+0000","last_peered":"2024-08-17T02:24:46.703691+0000","last_clean":"2024-08-17T02:24:46.703691+0000","last_became_active":"2024-08-17T02:24:46.694600+0000","last_became_peered":"2024-08-17T02:24:46.694600+0000","last_unstale":"2024-08-17T02:24:46.703691+0000","last_undegraded":"2024-08-17T02:24:46.703691+0000","last_fullsized":"2024-08-17T02:24:46.703691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706899+0000","last_change":"2024-08-17T02:24:46.703289+0000","last_active":"2024-08-17T02:24:46.706899+0000","last_peered":"2024-08-17T02:24:46.706899+0000","last_clean":"2024-08-17T02:24:46.706899+0000","last_became_active":"2024-08-17T02:24:46.702961+0000","last_became_peered":"2024-08-17T02:24:46.702961+0000","last_unstale":"2024-08-17T02:24:46.706899+0000","last_undegraded":"2024-08-17T02:24:46.706899+0000","last_fullsized":"2024-08-17T02:24:46.706899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:26.523808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702603+0000","last_change":"2024-08-17T02:24:46.696080+0000","last_active":"2024-08-17T02:24:46.702603+0000","last_peered":"2024-08-17T02:24:46.702603+0000","last_clean":"2024-08-17T02:24:46.702603+0000","last_became_active":"2024-08-17T02:24:46.695753+0000","last_became_peered":"2024-08-17T02:24:46.695753+0000","last_unstale":"2024-08-17T02:24:46.702603+0000","last_undegraded":"2024-08-17T02:24:46.702603+0000","last_fullsized":"2024-08-17T02:24:46.702603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700418+0000","last_change":"2024-08-17T02:24:46.692695+0000","last_active":"2024-08-17T02:24:46.700418+0000","last_peered":"2024-08-17T02:24:46.700418+0000","last_clean":"2024-08-17T02:24:46.700418+0000","last_became_active":"2024-08-17T02:24:46.691145+0000","last_became_peered":"2024-08-17T02:24:46.691145+0000","last_unstale":"2024-08-17T02:24:46.700418+0000","last_undegraded":"2024-08-17T02:24:46.700418+0000","last_fullsized":"2024-08-17T02:24:46.700418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:25.233681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706334+0000","last_change":"2024-08-17T02:24:46.696761+0000","last_active":"2024-08-17T02:24:46.706334+0000","last_peered":"2024-08-17T02:24:46.706334+0000","last_clean":"2024-08-17T02:24:46.706334+0000","last_became_active":"2024-08-17T02:24:46.695844+0000","last_became_peered":"2024-08-17T02:24:46.695844+0000","last_unstale":"2024-08-17T02:24:46.706334+0000","last_undegraded":"2024-08-17T02:24:46.706334+0000","last_fullsized":"2024-08-17T02:24:46.706334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700724+0000","last_change":"2024-08-17T02:24:46.694929+0000","last_active":"2024-08-17T02:24:46.700724+0000","last_peered":"2024-08-17T02:24:46.700724+0000","last_clean":"2024-08-17T02:24:46.700724+0000","last_became_active":"2024-08-17T02:24:46.694374+0000","last_became_peered":"2024-08-17T02:24:46.694374+0000","last_unstale":"2024-08-17T02:24:46.700724+0000","last_undegraded":"2024-08-17T02:24:46.700724+0000","last_fullsized":"2024-08-17T02:24:46.700724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:46:46.027493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706231+0000","last_change":"2024-08-17T02:24:46.683686+0000","last_active":"2024-08-17T02:24:46.706231+0000","last_peered":"2024-08-17T02:24:46.706231+0000","last_clean":"2024-08-17T02:24:46.706231+0000","last_became_active":"2024-08-17T02:24:46.683416+0000","last_became_peered":"2024-08-17T02:24:46.683416+0000","last_unstale":"2024-08-17T02:24:46.706231+0000","last_undegraded":"2024-08-17T02:24:46.706231+0000","last_fullsized":"2024-08-17T02:24:46.706231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:50:38.075390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703466+0000","last_change":"2024-08-17T02:24:46.697382+0000","last_active":"2024-08-17T02:24:46.703466+0000","last_peered":"2024-08-17T02:24:46.703466+0000","last_clean":"2024-08-17T02:24:46.703466+0000","last_became_active":"2024-08-17T02:24:46.697033+0000","last_became_peered":"2024-08-17T02:24:46.697033+0000","last_unstale":"2024-08-17T02:24:46.703466+0000","last_undegraded":"2024-08-17T02:24:46.703466+0000","last_fullsized":"2024-08-17T02:24:46.703466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:52:28.290751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714222+0000","last_change":"2024-08-17T02:24:46.707560+0000","last_active":"2024-08-17T02:24:46.714222+0000","last_peered":"2024-08-17T02:24:46.714222+0000","last_clean":"2024-08-17T02:24:46.714222+0000","last_became_active":"2024-08-17T02:24:46.707234+0000","last_became_peered":"2024-08-17T02:24:46.707234+0000","last_unstale":"2024-08-17T02:24:46.714222+0000","last_undegraded":"2024-08-17T02:24:46.714222+0000","last_fullsized":"2024-08-17T02:24:46.714222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:32.930431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694875+0000","last_change":"2024-08-17T02:24:46.691514+0000","last_active":"2024-08-17T02:24:46.694875+0000","last_peered":"2024-08-17T02:24:46.694875+0000","last_clean":"2024-08-17T02:24:46.694875+0000","last_became_active":"2024-08-17T02:24:46.691231+0000","last_became_peered":"2024-08-17T02:24:46.691231+0000","last_unstale":"2024-08-17T02:24:46.694875+0000","last_undegraded":"2024-08-17T02:24:46.694875+0000","last_fullsized":"2024-08-17T02:24:46.694875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:42:38.641881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700286+0000","last_change":"2024-08-17T02:24:46.698271+0000","last_active":"2024-08-17T02:24:46.700286+0000","last_peered":"2024-08-17T02:24:46.700286+0000","last_clean":"2024-08-17T02:24:46.700286+0000","last_became_active":"2024-08-17T02:24:46.698020+0000","last_became_peered":"2024-08-17T02:24:46.698020+0000","last_unstale":"2024-08-17T02:24:46.700286+0000","last_undegraded":"2024-08-17T02:24:46.700286+0000","last_fullsized":"2024-08-17T02:24:46.700286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:07:51.758557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696520+0000","last_change":"2024-08-17T02:24:46.691079+0000","last_active":"2024-08-17T02:24:46.696520+0000","last_peered":"2024-08-17T02:24:46.696520+0000","last_clean":"2024-08-17T02:24:46.696520+0000","last_became_active":"2024-08-17T02:24:46.690659+0000","last_became_peered":"2024-08-17T02:24:46.690659+0000","last_unstale":"2024-08-17T02:24:46.696520+0000","last_undegraded":"2024-08-17T02:24:46.696520+0000","last_fullsized":"2024-08-17T02:24:46.696520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:16:36.446060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706285+0000","last_change":"2024-08-17T02:24:46.684857+0000","last_active":"2024-08-17T02:24:46.706285+0000","last_peered":"2024-08-17T02:24:46.706285+0000","last_clean":"2024-08-17T02:24:46.706285+0000","last_became_active":"2024-08-17T02:24:46.683949+0000","last_became_peered":"2024-08-17T02:24:46.683949+0000","last_unstale":"2024-08-17T02:24:46.706285+0000","last_undegraded":"2024-08-17T02:24:46.706285+0000","last_fullsized":"2024-08-17T02:24:46.706285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:06.464866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703787+0000","last_change":"2024-08-17T02:24:46.698926+0000","last_active":"2024-08-17T02:24:46.703787+0000","last_peered":"2024-08-17T02:24:46.703787+0000","last_clean":"2024-08-17T02:24:46.703787+0000","last_became_active":"2024-08-17T02:24:46.698650+0000","last_became_peered":"2024-08-17T02:24:46.698650+0000","last_unstale":"2024-08-17T02:24:46.703787+0000","last_undegraded":"2024-08-17T02:24:46.703787+0000","last_fullsized":"2024-08-17T02:24:46.703787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699472+0000","last_change":"2024-08-17T02:24:46.697443+0000","last_active":"2024-08-17T02:24:46.699472+0000","last_peered":"2024-08-17T02:24:46.699472+0000","last_clean":"2024-08-17T02:24:46.699472+0000","last_became_active":"2024-08-17T02:24:46.696404+0000","last_became_peered":"2024-08-17T02:24:46.696404+0000","last_unstale":"2024-08-17T02:24:46.699472+0000","last_undegraded":"2024-08-17T02:24:46.699472+0000","last_fullsized":"2024-08-17T02:24:46.699472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:08.003306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706357+0000","last_change":"2024-08-17T02:24:46.701561+0000","last_active":"2024-08-17T02:24:46.706357+0000","last_peered":"2024-08-17T02:24:46.706357+0000","last_clean":"2024-08-17T02:24:46.706357+0000","last_became_active":"2024-08-17T02:24:46.696208+0000","last_became_peered":"2024-08-17T02:24:46.696208+0000","last_unstale":"2024-08-17T02:24:46.706357+0000","last_undegraded":"2024-08-17T02:24:46.706357+0000","last_fullsized":"2024-08-17T02:24:46.706357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700595+0000","last_change":"2024-08-17T02:24:45.693597+0000","last_active":"2024-08-17T02:24:46.700595+0000","last_peered":"2024-08-17T02:24:46.700595+0000","last_clean":"2024-08-17T02:24:46.700595+0000","last_became_active":"2024-08-17T02:24:45.692136+0000","last_became_peered":"2024-08-17T02:24:45.692136+0000","last_unstale":"2024-08-17T02:24:46.700595+0000","last_undegraded":"2024-08-17T02:24:46.700595+0000","last_fullsized":"2024-08-17T02:24:46.700595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:24:51.770625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703406+0000","last_change":"2024-08-17T02:24:46.700557+0000","last_active":"2024-08-17T02:24:46.703406+0000","last_peered":"2024-08-17T02:24:46.703406+0000","last_clean":"2024-08-17T02:24:46.703406+0000","last_became_active":"2024-08-17T02:24:46.700114+0000","last_became_peered":"2024-08-17T02:24:46.700114+0000","last_unstale":"2024-08-17T02:24:46.703406+0000","last_undegraded":"2024-08-17T02:24:46.703406+0000","last_fullsized":"2024-08-17T02:24:46.703406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:07:03.912845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706413+0000","last_change":"2024-08-17T02:24:45.685965+0000","last_active":"2024-08-17T02:24:46.706413+0000","last_peered":"2024-08-17T02:24:46.706413+0000","last_clean":"2024-08-17T02:24:46.706413+0000","last_became_active":"2024-08-17T02:24:45.685019+0000","last_became_peered":"2024-08-17T02:24:45.685019+0000","last_unstale":"2024-08-17T02:24:46.706413+0000","last_undegraded":"2024-08-17T02:24:46.706413+0000","last_fullsized":"2024-08-17T02:24:46.706413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:33.322093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.681299+0000","last_change":"2024-08-17T02:24:45.695657+0000","last_active":"2024-08-17T02:24:46.681299+0000","last_peered":"2024-08-17T02:24:46.681299+0000","last_clean":"2024-08-17T02:24:46.681299+0000","last_became_active":"2024-08-17T02:24:45.695337+0000","last_became_peered":"2024-08-17T02:24:45.695337+0000","last_unstale":"2024-08-17T02:24:46.681299+0000","last_undegraded":"2024-08-17T02:24:46.681299+0000","last_fullsized":"2024-08-17T02:24:46.681299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696577+0000","last_change":"2024-08-17T02:24:46.691553+0000","last_active":"2024-08-17T02:24:46.696577+0000","last_peered":"2024-08-17T02:24:46.696577+0000","last_clean":"2024-08-17T02:24:46.696577+0000","last_became_active":"2024-08-17T02:24:46.688816+0000","last_became_peered":"2024-08-17T02:24:46.688816+0000","last_unstale":"2024-08-17T02:24:46.696577+0000","last_undegraded":"2024-08-17T02:24:46.696577+0000","last_fullsized":"2024-08-17T02:24:46.696577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:46:36.817383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673163+0000","last_change":"2024-08-17T02:24:45.683302+0000","last_active":"2024-08-17T02:24:46.673163+0000","last_peered":"2024-08-17T02:24:46.673163+0000","last_clean":"2024-08-17T02:24:46.673163+0000","last_became_active":"2024-08-17T02:24:45.682641+0000","last_became_peered":"2024-08-17T02:24:45.682641+0000","last_unstale":"2024-08-17T02:24:46.673163+0000","last_undegraded":"2024-08-17T02:24:46.673163+0000","last_fullsized":"2024-08-17T02:24:46.673163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:36.581167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700661+0000","last_change":"2024-08-17T02:24:46.693180+0000","last_active":"2024-08-17T02:24:46.700661+0000","last_peered":"2024-08-17T02:24:46.700661+0000","last_clean":"2024-08-17T02:24:46.700661+0000","last_became_active":"2024-08-17T02:24:46.692910+0000","last_became_peered":"2024-08-17T02:24:46.692910+0000","last_unstale":"2024-08-17T02:24:46.700661+0000","last_undegraded":"2024-08-17T02:24:46.700661+0000","last_fullsized":"2024-08-17T02:24:46.700661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:49:20.305646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691054+0000","last_change":"2024-08-17T02:24:45.689693+0000","last_active":"2024-08-17T02:24:46.691054+0000","last_peered":"2024-08-17T02:24:46.691054+0000","last_clean":"2024-08-17T02:24:46.691054+0000","last_became_active":"2024-08-17T02:24:45.689396+0000","last_became_peered":"2024-08-17T02:24:45.689396+0000","last_unstale":"2024-08-17T02:24:46.691054+0000","last_undegraded":"2024-08-17T02:24:46.691054+0000","last_fullsized":"2024-08-17T02:24:46.691054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:03:27.829684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.714193+0000","last_change":"2024-08-17T02:24:46.707529+0000","last_active":"2024-08-17T02:24:46.714193+0000","last_peered":"2024-08-17T02:24:46.714193+0000","last_clean":"2024-08-17T02:24:46.714193+0000","last_became_active":"2024-08-17T02:24:46.706887+0000","last_became_peered":"2024-08-17T02:24:46.706887+0000","last_unstale":"2024-08-17T02:24:46.714193+0000","last_undegraded":"2024-08-17T02:24:46.714193+0000","last_fullsized":"2024-08-17T02:24:46.714193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682673+0000","last_change":"2024-08-17T02:24:45.689053+0000","last_active":"2024-08-17T02:24:46.682673+0000","last_peered":"2024-08-17T02:24:46.682673+0000","last_clean":"2024-08-17T02:24:46.682673+0000","last_became_active":"2024-08-17T02:24:45.688643+0000","last_became_peered":"2024-08-17T02:24:45.688643+0000","last_unstale":"2024-08-17T02:24:46.682673+0000","last_undegraded":"2024-08-17T02:24:46.682673+0000","last_fullsized":"2024-08-17T02:24:46.682673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711779+0000","last_change":"2024-08-17T02:24:46.708643+0000","last_active":"2024-08-17T02:24:46.711779+0000","last_peered":"2024-08-17T02:24:46.711779+0000","last_clean":"2024-08-17T02:24:46.711779+0000","last_became_active":"2024-08-17T02:24:46.708322+0000","last_became_peered":"2024-08-17T02:24:46.708322+0000","last_unstale":"2024-08-17T02:24:46.711779+0000","last_undegraded":"2024-08-17T02:24:46.711779+0000","last_fullsized":"2024-08-17T02:24:46.711779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:00.112973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703626+0000","last_change":"2024-08-17T02:24:45.686140+0000","last_active":"2024-08-17T02:24:46.703626+0000","last_peered":"2024-08-17T02:24:46.703626+0000","last_clean":"2024-08-17T02:24:46.703626+0000","last_became_active":"2024-08-17T02:24:45.685732+0000","last_became_peered":"2024-08-17T02:24:45.685732+0000","last_unstale":"2024-08-17T02:24:46.703626+0000","last_undegraded":"2024-08-17T02:24:46.703626+0000","last_fullsized":"2024-08-17T02:24:46.703626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:15.899238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710171+0000","last_change":"2024-08-17T02:24:46.703995+0000","last_active":"2024-08-17T02:24:46.710171+0000","last_peered":"2024-08-17T02:24:46.710171+0000","last_clean":"2024-08-17T02:24:46.710171+0000","last_became_active":"2024-08-17T02:24:46.703632+0000","last_became_peered":"2024-08-17T02:24:46.703632+0000","last_unstale":"2024-08-17T02:24:46.710171+0000","last_undegraded":"2024-08-17T02:24:46.710171+0000","last_fullsized":"2024-08-17T02:24:46.710171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:55:30.614313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711599+0000","last_change":"2024-08-17T02:24:45.691026+0000","last_active":"2024-08-17T02:24:46.711599+0000","last_peered":"2024-08-17T02:24:46.711599+0000","last_clean":"2024-08-17T02:24:46.711599+0000","last_became_active":"2024-08-17T02:24:45.690499+0000","last_became_peered":"2024-08-17T02:24:45.690499+0000","last_unstale":"2024-08-17T02:24:46.711599+0000","last_undegraded":"2024-08-17T02:24:46.711599+0000","last_fullsized":"2024-08-17T02:24:46.711599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:00:14.230300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700038+0000","last_change":"2024-08-17T02:24:46.694359+0000","last_active":"2024-08-17T02:24:46.700038+0000","last_peered":"2024-08-17T02:24:46.700038+0000","last_clean":"2024-08-17T02:24:46.700038+0000","last_became_active":"2024-08-17T02:24:46.693812+0000","last_became_peered":"2024-08-17T02:24:46.693812+0000","last_unstale":"2024-08-17T02:24:46.700038+0000","last_undegraded":"2024-08-17T02:24:46.700038+0000","last_fullsized":"2024-08-17T02:24:46.700038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:48:49.063780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703831+0000","last_change":"2024-08-17T02:24:45.689928+0000","last_active":"2024-08-17T02:24:46.703831+0000","last_peered":"2024-08-17T02:24:46.703831+0000","last_clean":"2024-08-17T02:24:46.703831+0000","last_became_active":"2024-08-17T02:24:45.689519+0000","last_became_peered":"2024-08-17T02:24:45.689519+0000","last_unstale":"2024-08-17T02:24:46.703831+0000","last_undegraded":"2024-08-17T02:24:46.703831+0000","last_fullsized":"2024-08-17T02:24:46.703831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.709142+0000","last_change":"2024-08-17T02:24:46.708134+0000","last_active":"2024-08-17T02:24:46.709142+0000","last_peered":"2024-08-17T02:24:46.709142+0000","last_clean":"2024-08-17T02:24:46.709142+0000","last_became_active":"2024-08-17T02:24:46.707822+0000","last_became_peered":"2024-08-17T02:24:46.707822+0000","last_unstale":"2024-08-17T02:24:46.709142+0000","last_undegraded":"2024-08-17T02:24:46.709142+0000","last_fullsized":"2024-08-17T02:24:46.709142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673821+0000","last_change":"2024-08-17T02:24:45.686232+0000","last_active":"2024-08-17T02:24:46.673821+0000","last_peered":"2024-08-17T02:24:46.673821+0000","last_clean":"2024-08-17T02:24:46.673821+0000","last_became_active":"2024-08-17T02:24:45.685407+0000","last_became_peered":"2024-08-17T02:24:45.685407+0000","last_unstale":"2024-08-17T02:24:46.673821+0000","last_undegraded":"2024-08-17T02:24:46.673821+0000","last_fullsized":"2024-08-17T02:24:46.673821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706888+0000","last_change":"2024-08-17T02:24:46.700959+0000","last_active":"2024-08-17T02:24:46.706888+0000","last_peered":"2024-08-17T02:24:46.706888+0000","last_clean":"2024-08-17T02:24:46.706888+0000","last_became_active":"2024-08-17T02:24:46.698769+0000","last_became_peered":"2024-08-17T02:24:46.698769+0000","last_unstale":"2024-08-17T02:24:46.706888+0000","last_undegraded":"2024-08-17T02:24:46.706888+0000","last_fullsized":"2024-08-17T02:24:46.706888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.683527+0000","last_change":"2024-08-17T02:24:45.687633+0000","last_active":"2024-08-17T02:24:46.683527+0000","last_peered":"2024-08-17T02:24:46.683527+0000","last_clean":"2024-08-17T02:24:46.683527+0000","last_became_active":"2024-08-17T02:24:45.687078+0000","last_became_peered":"2024-08-17T02:24:45.687078+0000","last_unstale":"2024-08-17T02:24:46.683527+0000","last_undegraded":"2024-08-17T02:24:46.683527+0000","last_fullsized":"2024-08-17T02:24:46.683527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706073+0000","last_change":"2024-08-17T02:24:46.696374+0000","last_active":"2024-08-17T02:24:46.706073+0000","last_peered":"2024-08-17T02:24:46.706073+0000","last_clean":"2024-08-17T02:24:46.706073+0000","last_became_active":"2024-08-17T02:24:46.695792+0000","last_became_peered":"2024-08-17T02:24:46.695792+0000","last_unstale":"2024-08-17T02:24:46.706073+0000","last_undegraded":"2024-08-17T02:24:46.706073+0000","last_fullsized":"2024-08-17T02:24:46.706073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:28.126860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.709576+0000","last_change":"2024-08-17T02:24:45.686489+0000","last_active":"2024-08-17T02:24:46.709576+0000","last_peered":"2024-08-17T02:24:46.709576+0000","last_clean":"2024-08-17T02:24:46.709576+0000","last_became_active":"2024-08-17T02:24:45.684809+0000","last_became_peered":"2024-08-17T02:24:45.684809+0000","last_unstale":"2024-08-17T02:24:46.709576+0000","last_undegraded":"2024-08-17T02:24:46.709576+0000","last_fullsized":"2024-08-17T02:24:46.709576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706951+0000","last_change":"2024-08-17T02:24:46.699050+0000","last_active":"2024-08-17T02:24:46.706951+0000","last_peered":"2024-08-17T02:24:46.706951+0000","last_clean":"2024-08-17T02:24:46.706951+0000","last_became_active":"2024-08-17T02:24:46.697848+0000","last_became_peered":"2024-08-17T02:24:46.697848+0000","last_unstale":"2024-08-17T02:24:46.706951+0000","last_undegraded":"2024-08-17T02:24:46.706951+0000","last_fullsized":"2024-08-17T02:24:46.706951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:41.765899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702818+0000","last_change":"2024-08-17T02:24:45.696348+0000","last_active":"2024-08-17T02:24:46.702818+0000","last_peered":"2024-08-17T02:24:46.702818+0000","last_clean":"2024-08-17T02:24:46.702818+0000","last_became_active":"2024-08-17T02:24:45.695978+0000","last_became_peered":"2024-08-17T02:24:45.695978+0000","last_unstale":"2024-08-17T02:24:46.702818+0000","last_undegraded":"2024-08-17T02:24:46.702818+0000","last_fullsized":"2024-08-17T02:24:46.702818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701299+0000","last_change":"2024-08-17T02:24:46.698921+0000","last_active":"2024-08-17T02:24:46.701299+0000","last_peered":"2024-08-17T02:24:46.701299+0000","last_clean":"2024-08-17T02:24:46.701299+0000","last_became_active":"2024-08-17T02:24:46.698688+0000","last_became_peered":"2024-08-17T02:24:46.698688+0000","last_unstale":"2024-08-17T02:24:46.701299+0000","last_undegraded":"2024-08-17T02:24:46.701299+0000","last_fullsized":"2024-08-17T02:24:46.701299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:37.590898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701865+0000","last_change":"2024-08-17T02:24:45.699315+0000","last_active":"2024-08-17T02:24:46.701865+0000","last_peered":"2024-08-17T02:24:46.701865+0000","last_clean":"2024-08-17T02:24:46.701865+0000","last_became_active":"2024-08-17T02:24:45.698964+0000","last_became_peered":"2024-08-17T02:24:45.698964+0000","last_unstale":"2024-08-17T02:24:46.701865+0000","last_undegraded":"2024-08-17T02:24:46.701865+0000","last_fullsized":"2024-08-17T02:24:46.701865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:06.993576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702236+0000","last_change":"2024-08-17T02:24:46.696697+0000","last_active":"2024-08-17T02:24:46.702236+0000","last_peered":"2024-08-17T02:24:46.702236+0000","last_clean":"2024-08-17T02:24:46.702236+0000","last_became_active":"2024-08-17T02:24:46.696387+0000","last_became_peered":"2024-08-17T02:24:46.696387+0000","last_unstale":"2024-08-17T02:24:46.702236+0000","last_undegraded":"2024-08-17T02:24:46.702236+0000","last_fullsized":"2024-08-17T02:24:46.702236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:09.543055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.705922+0000","last_change":"2024-08-17T02:24:45.693896+0000","last_active":"2024-08-17T02:24:46.705922+0000","last_peered":"2024-08-17T02:24:46.705922+0000","last_clean":"2024-08-17T02:24:46.705922+0000","last_became_active":"2024-08-17T02:24:45.693694+0000","last_became_peered":"2024-08-17T02:24:45.693694+0000","last_unstale":"2024-08-17T02:24:46.705922+0000","last_undegraded":"2024-08-17T02:24:46.705922+0000","last_fullsized":"2024-08-17T02:24:46.705922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:25.447726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702563+0000","last_change":"2024-08-17T02:24:46.695064+0000","last_active":"2024-08-17T02:24:46.702563+0000","last_peered":"2024-08-17T02:24:46.702563+0000","last_clean":"2024-08-17T02:24:46.702563+0000","last_became_active":"2024-08-17T02:24:46.694303+0000","last_became_peered":"2024-08-17T02:24:46.694303+0000","last_unstale":"2024-08-17T02:24:46.702563+0000","last_undegraded":"2024-08-17T02:24:46.702563+0000","last_fullsized":"2024-08-17T02:24:46.702563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:25.686767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682822+0000","last_change":"2024-08-17T02:24:45.693363+0000","last_active":"2024-08-17T02:24:46.682822+0000","last_peered":"2024-08-17T02:24:46.682822+0000","last_clean":"2024-08-17T02:24:46.682822+0000","last_became_active":"2024-08-17T02:24:45.693114+0000","last_became_peered":"2024-08-17T02:24:45.693114+0000","last_unstale":"2024-08-17T02:24:46.682822+0000","last_undegraded":"2024-08-17T02:24:46.682822+0000","last_fullsized":"2024-08-17T02:24:46.682822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:42:28.363959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706914+0000","last_change":"2024-08-17T02:24:46.703793+0000","last_active":"2024-08-17T02:24:46.706914+0000","last_peered":"2024-08-17T02:24:46.706914+0000","last_clean":"2024-08-17T02:24:46.706914+0000","last_became_active":"2024-08-17T02:24:46.703493+0000","last_became_peered":"2024-08-17T02:24:46.703493+0000","last_unstale":"2024-08-17T02:24:46.706914+0000","last_undegraded":"2024-08-17T02:24:46.706914+0000","last_fullsized":"2024-08-17T02:24:46.706914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.685754+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:24:46.685754+0000","last_peered":"2024-08-17T02:24:46.685754+0000","last_clean":"2024-08-17T02:24:46.685754+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:24:46.685754+0000","last_undegraded":"2024-08-17T02:24:46.685754+0000","last_fullsized":"2024-08-17T02:24:46.685754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.676656+0000","last_change":"2024-08-17T02:24:45.684657+0000","last_active":"2024-08-17T02:24:46.676656+0000","last_peered":"2024-08-17T02:24:46.676656+0000","last_clean":"2024-08-17T02:24:46.676656+0000","last_became_active":"2024-08-17T02:24:45.683930+0000","last_became_peered":"2024-08-17T02:24:45.683930+0000","last_unstale":"2024-08-17T02:24:46.676656+0000","last_undegraded":"2024-08-17T02:24:46.676656+0000","last_fullsized":"2024-08-17T02:24:46.676656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:22:23.133122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700029+0000","last_change":"2024-08-17T02:24:46.690032+0000","last_active":"2024-08-17T02:24:46.700029+0000","last_peered":"2024-08-17T02:24:46.700029+0000","last_clean":"2024-08-17T02:24:46.700029+0000","last_became_active":"2024-08-17T02:24:46.689692+0000","last_became_peered":"2024-08-17T02:24:46.689692+0000","last_unstale":"2024-08-17T02:24:46.700029+0000","last_undegraded":"2024-08-17T02:24:46.700029+0000","last_fullsized":"2024-08-17T02:24:46.700029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:49.510607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.673191+0000","last_change":"2024-08-17T02:24:45.695195+0000","last_active":"2024-08-17T02:24:46.673191+0000","last_peered":"2024-08-17T02:24:46.673191+0000","last_clean":"2024-08-17T02:24:46.673191+0000","last_became_active":"2024-08-17T02:24:45.694908+0000","last_became_peered":"2024-08-17T02:24:45.694908+0000","last_unstale":"2024-08-17T02:24:46.673191+0000","last_undegraded":"2024-08-17T02:24:46.673191+0000","last_fullsized":"2024-08-17T02:24:46.673191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:58:27.117129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700963+0000","last_change":"2024-08-17T02:24:46.698400+0000","last_active":"2024-08-17T02:24:46.700963+0000","last_peered":"2024-08-17T02:24:46.700963+0000","last_clean":"2024-08-17T02:24:46.700963+0000","last_became_active":"2024-08-17T02:24:46.697641+0000","last_became_peered":"2024-08-17T02:24:46.697641+0000","last_unstale":"2024-08-17T02:24:46.700963+0000","last_undegraded":"2024-08-17T02:24:46.700963+0000","last_fullsized":"2024-08-17T02:24:46.700963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:34.331824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682928+0000","last_change":"2024-08-17T02:24:45.696585+0000","last_active":"2024-08-17T02:24:46.682928+0000","last_peered":"2024-08-17T02:24:46.682928+0000","last_clean":"2024-08-17T02:24:46.682928+0000","last_became_active":"2024-08-17T02:24:45.696243+0000","last_became_peered":"2024-08-17T02:24:45.696243+0000","last_unstale":"2024-08-17T02:24:46.682928+0000","last_undegraded":"2024-08-17T02:24:46.682928+0000","last_fullsized":"2024-08-17T02:24:46.682928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700945+0000","last_change":"2024-08-17T02:24:46.692661+0000","last_active":"2024-08-17T02:24:46.700945+0000","last_peered":"2024-08-17T02:24:46.700945+0000","last_clean":"2024-08-17T02:24:46.700945+0000","last_became_active":"2024-08-17T02:24:46.692144+0000","last_became_peered":"2024-08-17T02:24:46.692144+0000","last_unstale":"2024-08-17T02:24:46.700945+0000","last_undegraded":"2024-08-17T02:24:46.700945+0000","last_fullsized":"2024-08-17T02:24:46.700945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:24:16.650137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.674060+0000","last_change":"2024-08-17T02:24:45.689974+0000","last_active":"2024-08-17T02:24:46.674060+0000","last_peered":"2024-08-17T02:24:46.674060+0000","last_clean":"2024-08-17T02:24:46.674060+0000","last_became_active":"2024-08-17T02:24:45.689686+0000","last_became_peered":"2024-08-17T02:24:45.689686+0000","last_unstale":"2024-08-17T02:24:46.674060+0000","last_undegraded":"2024-08-17T02:24:46.674060+0000","last_fullsized":"2024-08-17T02:24:46.674060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:02.113673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.702323+0000","last_change":"2024-08-17T02:24:46.695491+0000","last_active":"2024-08-17T02:24:46.702323+0000","last_peered":"2024-08-17T02:24:46.702323+0000","last_clean":"2024-08-17T02:24:46.702323+0000","last_became_active":"2024-08-17T02:24:46.694910+0000","last_became_peered":"2024-08-17T02:24:46.694910+0000","last_unstale":"2024-08-17T02:24:46.702323+0000","last_undegraded":"2024-08-17T02:24:46.702323+0000","last_fullsized":"2024-08-17T02:24:46.702323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:17.309712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.675664+0000","last_change":"2024-08-17T02:24:45.693494+0000","last_active":"2024-08-17T02:24:46.675664+0000","last_peered":"2024-08-17T02:24:46.675664+0000","last_clean":"2024-08-17T02:24:46.675664+0000","last_became_active":"2024-08-17T02:24:45.691399+0000","last_became_peered":"2024-08-17T02:24:45.691399+0000","last_unstale":"2024-08-17T02:24:46.675664+0000","last_undegraded":"2024-08-17T02:24:46.675664+0000","last_fullsized":"2024-08-17T02:24:46.675664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:47.538687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.699510+0000","last_change":"2024-08-17T02:24:46.697272+0000","last_active":"2024-08-17T02:24:46.699510+0000","last_peered":"2024-08-17T02:24:46.699510+0000","last_clean":"2024-08-17T02:24:46.699510+0000","last_became_active":"2024-08-17T02:24:46.696866+0000","last_became_peered":"2024-08-17T02:24:46.696866+0000","last_unstale":"2024-08-17T02:24:46.699510+0000","last_undegraded":"2024-08-17T02:24:46.699510+0000","last_fullsized":"2024-08-17T02:24:46.699510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.265104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.677187+0000","last_change":"2024-08-17T02:24:45.689340+0000","last_active":"2024-08-17T02:24:46.677187+0000","last_peered":"2024-08-17T02:24:46.677187+0000","last_clean":"2024-08-17T02:24:46.677187+0000","last_became_active":"2024-08-17T02:24:45.687263+0000","last_became_peered":"2024-08-17T02:24:45.687263+0000","last_unstale":"2024-08-17T02:24:46.677187+0000","last_undegraded":"2024-08-17T02:24:46.677187+0000","last_fullsized":"2024-08-17T02:24:46.677187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.694607+0000","last_change":"2024-08-17T02:24:46.687663+0000","last_active":"2024-08-17T02:24:46.694607+0000","last_peered":"2024-08-17T02:24:46.694607+0000","last_clean":"2024-08-17T02:24:46.694607+0000","last_became_active":"2024-08-17T02:24:46.687285+0000","last_became_peered":"2024-08-17T02:24:46.687285+0000","last_unstale":"2024-08-17T02:24:46.694607+0000","last_undegraded":"2024-08-17T02:24:46.694607+0000","last_fullsized":"2024-08-17T02:24:46.694607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:03.123404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-08-17T02:24:47.813909+0000","last_change":"2024-08-17T02:24:45.692340+0000","last_active":"2024-08-17T02:24:47.813909+0000","last_peered":"2024-08-17T02:24:47.813909+0000","last_clean":"2024-08-17T02:24:47.813909+0000","last_became_active":"2024-08-17T02:24:45.691959+0000","last_became_peered":"2024-08-17T02:24:45.691959+0000","last_unstale":"2024-08-17T02:24:47.813909+0000","last_undegraded":"2024-08-17T02:24:47.813909+0000","last_fullsized":"2024-08-17T02:24:47.813909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.701175+0000","last_change":"2024-08-17T02:24:46.699671+0000","last_active":"2024-08-17T02:24:46.701175+0000","last_peered":"2024-08-17T02:24:46.701175+0000","last_clean":"2024-08-17T02:24:46.701175+0000","last_became_active":"2024-08-17T02:24:46.699384+0000","last_became_peered":"2024-08-17T02:24:46.699384+0000","last_unstale":"2024-08-17T02:24:46.701175+0000","last_undegraded":"2024-08-17T02:24:46.701175+0000","last_fullsized":"2024-08-17T02:24:46.701175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:43:46.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706578+0000","last_change":"2024-08-17T02:24:45.689016+0000","last_active":"2024-08-17T02:24:46.706578+0000","last_peered":"2024-08-17T02:24:46.706578+0000","last_clean":"2024-08-17T02:24:46.706578+0000","last_became_active":"2024-08-17T02:24:45.688568+0000","last_became_peered":"2024-08-17T02:24:45.688568+0000","last_unstale":"2024-08-17T02:24:46.706578+0000","last_undegraded":"2024-08-17T02:24:46.706578+0000","last_fullsized":"2024-08-17T02:24:46.706578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:31.920700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700042+0000","last_change":"2024-08-17T02:24:46.690217+0000","last_active":"2024-08-17T02:24:46.700042+0000","last_peered":"2024-08-17T02:24:46.700042+0000","last_clean":"2024-08-17T02:24:46.700042+0000","last_became_active":"2024-08-17T02:24:46.689945+0000","last_became_peered":"2024-08-17T02:24:46.689945+0000","last_unstale":"2024-08-17T02:24:46.700042+0000","last_undegraded":"2024-08-17T02:24:46.700042+0000","last_fullsized":"2024-08-17T02:24:46.700042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:25:11.276589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.691093+0000","last_change":"2024-08-17T02:24:45.692162+0000","last_active":"2024-08-17T02:24:46.691093+0000","last_peered":"2024-08-17T02:24:46.691093+0000","last_clean":"2024-08-17T02:24:46.691093+0000","last_became_active":"2024-08-17T02:24:45.691864+0000","last_became_peered":"2024-08-17T02:24:45.691864+0000","last_unstale":"2024-08-17T02:24:46.691093+0000","last_undegraded":"2024-08-17T02:24:46.691093+0000","last_fullsized":"2024-08-17T02:24:46.691093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706928+0000","last_change":"2024-08-17T02:24:46.693752+0000","last_active":"2024-08-17T02:24:46.706928+0000","last_peered":"2024-08-17T02:24:46.706928+0000","last_clean":"2024-08-17T02:24:46.706928+0000","last_became_active":"2024-08-17T02:24:46.693452+0000","last_became_peered":"2024-08-17T02:24:46.693452+0000","last_unstale":"2024-08-17T02:24:46.706928+0000","last_undegraded":"2024-08-17T02:24:46.706928+0000","last_fullsized":"2024-08-17T02:24:46.706928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:48:08.504743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.682032+0000","last_change":"2024-08-17T02:24:45.695549+0000","last_active":"2024-08-17T02:24:46.682032+0000","last_peered":"2024-08-17T02:24:46.682032+0000","last_clean":"2024-08-17T02:24:46.682032+0000","last_became_active":"2024-08-17T02:24:45.695270+0000","last_became_peered":"2024-08-17T02:24:45.695270+0000","last_unstale":"2024-08-17T02:24:46.682032+0000","last_undegraded":"2024-08-17T02:24:46.682032+0000","last_fullsized":"2024-08-17T02:24:46.682032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.700059+0000","last_change":"2024-08-17T02:24:46.689650+0000","last_active":"2024-08-17T02:24:46.700059+0000","last_peered":"2024-08-17T02:24:46.700059+0000","last_clean":"2024-08-17T02:24:46.700059+0000","last_became_active":"2024-08-17T02:24:46.689361+0000","last_became_peered":"2024-08-17T02:24:46.689361+0000","last_unstale":"2024-08-17T02:24:46.700059+0000","last_undegraded":"2024-08-17T02:24:46.700059+0000","last_fullsized":"2024-08-17T02:24:46.700059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:40.645032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.685591+0000","last_change":"2024-08-17T02:24:45.688479+0000","last_active":"2024-08-17T02:24:46.685591+0000","last_peered":"2024-08-17T02:24:46.685591+0000","last_clean":"2024-08-17T02:24:46.685591+0000","last_became_active":"2024-08-17T02:24:45.688105+0000","last_became_peered":"2024-08-17T02:24:45.688105+0000","last_unstale":"2024-08-17T02:24:46.685591+0000","last_undegraded":"2024-08-17T02:24:46.685591+0000","last_fullsized":"2024-08-17T02:24:46.685591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:16.867653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703549+0000","last_change":"2024-08-17T02:24:46.693894+0000","last_active":"2024-08-17T02:24:46.703549+0000","last_peered":"2024-08-17T02:24:46.703549+0000","last_clean":"2024-08-17T02:24:46.703549+0000","last_became_active":"2024-08-17T02:24:46.693611+0000","last_became_peered":"2024-08-17T02:24:46.693611+0000","last_unstale":"2024-08-17T02:24:46.703549+0000","last_undegraded":"2024-08-17T02:24:46.703549+0000","last_fullsized":"2024-08-17T02:24:46.703549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:01.090426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706372+0000","last_change":"2024-08-17T02:24:45.684136+0000","last_active":"2024-08-17T02:24:46.706372+0000","last_peered":"2024-08-17T02:24:46.706372+0000","last_clean":"2024-08-17T02:24:46.706372+0000","last_became_active":"2024-08-17T02:24:45.683723+0000","last_became_peered":"2024-08-17T02:24:45.683723+0000","last_unstale":"2024-08-17T02:24:46.706372+0000","last_undegraded":"2024-08-17T02:24:46.706372+0000","last_fullsized":"2024-08-17T02:24:46.706372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:10:20.495402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.707394+0000","last_change":"2024-08-17T02:24:46.691308+0000","last_active":"2024-08-17T02:24:46.707394+0000","last_peered":"2024-08-17T02:24:46.707394+0000","last_clean":"2024-08-17T02:24:46.707394+0000","last_became_active":"2024-08-17T02:24:46.691046+0000","last_became_peered":"2024-08-17T02:24:46.691046+0000","last_unstale":"2024-08-17T02:24:46.707394+0000","last_undegraded":"2024-08-17T02:24:46.707394+0000","last_fullsized":"2024-08-17T02:24:46.707394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:28:54.432358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.706877+0000","last_change":"2024-08-17T02:24:46.699150+0000","last_active":"2024-08-17T02:24:46.706877+0000","last_peered":"2024-08-17T02:24:46.706877+0000","last_clean":"2024-08-17T02:24:46.706877+0000","last_became_active":"2024-08-17T02:24:46.697504+0000","last_became_peered":"2024-08-17T02:24:46.697504+0000","last_unstale":"2024-08-17T02:24:46.706877+0000","last_undegraded":"2024-08-17T02:24:46.706877+0000","last_fullsized":"2024-08-17T02:24:46.706877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:46.895163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.711183+0000","last_change":"2024-08-17T02:24:45.690864+0000","last_active":"2024-08-17T02:24:46.711183+0000","last_peered":"2024-08-17T02:24:46.711183+0000","last_clean":"2024-08-17T02:24:46.711183+0000","last_became_active":"2024-08-17T02:24:45.687405+0000","last_became_peered":"2024-08-17T02:24:45.687405+0000","last_unstale":"2024-08-17T02:24:46.711183+0000","last_undegraded":"2024-08-17T02:24:46.711183+0000","last_fullsized":"2024-08-17T02:24:46.711183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:16.255373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710456+0000","last_change":"2024-08-17T02:24:46.702644+0000","last_active":"2024-08-17T02:24:46.710456+0000","last_peered":"2024-08-17T02:24:46.710456+0000","last_clean":"2024-08-17T02:24:46.710456+0000","last_became_active":"2024-08-17T02:24:46.701576+0000","last_became_peered":"2024-08-17T02:24:46.701576+0000","last_unstale":"2024-08-17T02:24:46.710456+0000","last_undegraded":"2024-08-17T02:24:46.710456+0000","last_fullsized":"2024-08-17T02:24:46.710456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:12.393424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.710630+0000","last_change":"2024-08-17T02:24:45.689395+0000","last_active":"2024-08-17T02:24:46.710630+0000","last_peered":"2024-08-17T02:24:46.710630+0000","last_clean":"2024-08-17T02:24:46.710630+0000","last_became_active":"2024-08-17T02:24:45.689082+0000","last_became_peered":"2024-08-17T02:24:45.689082+0000","last_unstale":"2024-08-17T02:24:46.710630+0000","last_undegraded":"2024-08-17T02:24:46.710630+0000","last_fullsized":"2024-08-17T02:24:46.710630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:53:00.080695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703445+0000","last_change":"2024-08-17T02:24:46.697195+0000","last_active":"2024-08-17T02:24:46.703445+0000","last_peered":"2024-08-17T02:24:46.703445+0000","last_clean":"2024-08-17T02:24:46.703445+0000","last_became_active":"2024-08-17T02:24:46.696949+0000","last_became_peered":"2024-08-17T02:24:46.696949+0000","last_unstale":"2024-08-17T02:24:46.703445+0000","last_undegraded":"2024-08-17T02:24:46.703445+0000","last_fullsized":"2024-08-17T02:24:46.703445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:22.938256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.703915+0000","last_change":"2024-08-17T02:24:45.687064+0000","last_active":"2024-08-17T02:24:46.703915+0000","last_peered":"2024-08-17T02:24:46.703915+0000","last_clean":"2024-08-17T02:24:46.703915+0000","last_became_active":"2024-08-17T02:24:45.686543+0000","last_became_peered":"2024-08-17T02:24:45.686543+0000","last_unstale":"2024-08-17T02:24:46.703915+0000","last_undegraded":"2024-08-17T02:24:46.703915+0000","last_fullsized":"2024-08-17T02:24:46.703915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:47.125586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.696443+0000","last_change":"2024-08-17T02:24:46.688626+0000","last_active":"2024-08-17T02:24:46.696443+0000","last_peered":"2024-08-17T02:24:46.696443+0000","last_clean":"2024-08-17T02:24:46.696443+0000","last_became_active":"2024-08-17T02:24:46.688208+0000","last_became_peered":"2024-08-17T02:24:46.688208+0000","last_unstale":"2024-08-17T02:24:46.696443+0000","last_undegraded":"2024-08-17T02:24:46.696443+0000","last_fullsized":"2024-08-17T02:24:46.696443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:45.654560+0000","last_clean_scrub_stamp":"2024-08-17T02:24:45.654560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:20.339019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:24:46.708842+0000","last_change":"2024-08-17T02:24:45.687257+0000","last_active":"2024-08-17T02:24:46.708842+0000","last_peered":"2024-08-17T02:24:46.708842+0000","last_clean":"2024-08-17T02:24:46.708842+0000","last_became_active":"2024-08-17T02:24:45.686911+0000","last_became_peered":"2024-08-17T02:24:45.686911+0000","last_unstale":"2024-08-17T02:24:46.708842+0000","last_undegraded":"2024-08-17T02:24:46.708842+0000","last_fullsized":"2024-08-17T02:24:46.708842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:44.644829+0000","last_clean_scrub_stamp":"2024-08-17T02:24:44.644829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:43:11.383693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":241664,"data_stored":80755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":233472,"data_stored":80631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297612,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074228,"statfs":{"total":96636764160,"available":96332009472,"internally_reserved":0,"allocated":253952,"data_stored":82843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":81201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":245760,"data_stored":82183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298168,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073672,"statfs":{"total":96636764160,"available":96331440128,"internally_reserved":0,"allocated":831488,"data_stored":671069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297596,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074244,"statfs":{"total":96636764160,"available":96332025856,"internally_reserved":0,"allocated":241664,"data_stored":80687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":835584,"data_stored":671091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:24:58.513 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:24:58.513 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:24:58.513 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:24:58.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:24:58.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 Processor -- start 2024-08-17T02:24:58.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 -- start start 2024-08-17T02:24:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f96e0069580 0x7f96e015d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f96e015d8b0 0x7f96e01422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e0141e40 con 0x7f96e00691b0 2024-08-17T02:24:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e015dd00 con 0x7f96e015d8b0 2024-08-17T02:24:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e0141230 con 0x7f96e0069580 2024-08-17T02:24:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e5514700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f96e0069580 0x7f96e015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e5514700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f96e0069580 0x7f96e015d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:58272/0 (socket says 172.21.15.31:58272) 2024-08-17T02:24:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e5514700 1 -- 172.21.15.31:0/2628235408 learned_addr learned my addr 172.21.15.31:0/2628235408 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6516700 1 --2- 172.21.15.31:0/2628235408 >> v2:172.21.15.31:3300/0 conn(0x7f96e015d8b0 0x7f96e01422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e5514700 1 -- 172.21.15.31:0/2628235408 >> v2:172.21.15.31:3300/0 conn(0x7f96e015d8b0 msgr2=0x7f96e01422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e4d13700 1 -- 172.21.15.31:0/2628235408 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113470909 0 0) 0x7f96e0141e40 con 0x7f96e00691b0 2024-08-17T02:24:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e5514700 1 --2- 172.21.15.31:0/2628235408 >> v2:172.21.15.31:3300/0 conn(0x7f96e015d8b0 0x7f96e01422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e5514700 1 -- 172.21.15.31:0/2628235408 >> v1:172.21.15.92:6789/0 conn(0x7f96e00691b0 legacy=0x7f96e0161e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e5514700 1 -- 172.21.15.31:0/2628235408 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0141510 con 0x7f96e0069580 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e5514700 1 --2- 172.21.15.31:0/2628235408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e0069580 0x7f96e015d370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96e0063b80 tx=0x7f96d4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8ec5947660536a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e4d13700 1 -- 172.21.15.31:0/2628235408 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4009e70 con 0x7f96e0069580 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e4d13700 1 -- 172.21.15.31:0/2628235408 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d400b860 con 0x7f96e0069580 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e4d13700 1 -- 172.21.15.31:0/2628235408 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400bc00 con 0x7f96e0069580 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 -- 172.21.15.31:0/2628235408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e0069580 msgr2=0x7f96e015d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 --2- 172.21.15.31:0/2628235408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e0069580 0x7f96e015d370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96e0063b80 tx=0x7f96d4009250 comp rx=0 tx=0).stop 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 -- 172.21.15.31:0/2628235408 shutdown_connections 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 --2- 172.21.15.31:0/2628235408 >> v2:172.21.15.31:3300/0 conn(0x7f96e015d8b0 0x7f96e01422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 --2- 172.21.15.31:0/2628235408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e0069580 0x7f96e015d370 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 -- 172.21.15.31:0/2628235408 >> 172.21.15.31:0/2628235408 conn(0x7f96e0067400 msgr2=0x7f96e0067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 -- 172.21.15.31:0/2628235408 shutdown_connections 2024-08-17T02:24:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.610+0000 7f96e6d17700 1 -- 172.21.15.31:0/2628235408 wait complete. 2024-08-17T02:24:58.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6d17700 1 Processor -- start 2024-08-17T02:24:58.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6d17700 1 -- start start 2024-08-17T02:24:58.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6d17700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e00691b0 0x7f96e00add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6d17700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e0069580 0x7f96e00ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6d17700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e015d8b0 0x7f96e0144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6d17700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00accb0 con 0x7f96e00691b0 2024-08-17T02:24:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6d17700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00acf90 con 0x7f96e0069580 2024-08-17T02:24:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6d17700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00ad270 con 0x7f96e015d8b0 2024-08-17T02:24:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e5d15700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e00691b0 0x7f96e00add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e5d15700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e00691b0 0x7f96e00add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49012/0 (socket says 172.21.15.31:49012) 2024-08-17T02:24:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e5d15700 1 -- 172.21.15.31:0/2001787149 learned_addr learned my addr 172.21.15.31:0/2001787149 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6516700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e015d8b0 0x7f96e0144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e5514700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e0069580 0x7f96e00ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e5d15700 1 -- 172.21.15.31:0/2001787149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e015d8b0 msgr2=0x7f96e0144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e5d15700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e015d8b0 0x7f96e0144bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e5d15700 1 -- 172.21.15.31:0/2001787149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e0069580 msgr2=0x7f96e00ac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e5d15700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e0069580 0x7f96e00ac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e5d15700 1 -- 172.21.15.31:0/2001787149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d40094f0 con 0x7f96e00691b0 2024-08-17T02:24:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e5d15700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e00691b0 0x7f96e00add50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c7e0 tx=0x7f96dc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96d1ffb700 1 -- 172.21.15.31:0/2001787149 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0105c0 con 0x7f96e00691b0 2024-08-17T02:24:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96d1ffb700 1 -- 172.21.15.31:0/2001787149 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc010740 con 0x7f96e00691b0 2024-08-17T02:24:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6d17700 1 -- 172.21.15.31:0/2001787149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e00ad550 con 0x7f96e00691b0 2024-08-17T02:24:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96d1ffb700 1 -- 172.21.15.31:0/2001787149 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc010b00 con 0x7f96e00691b0 2024-08-17T02:24:58.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.614+0000 7f96e6d17700 1 -- 172.21.15.31:0/2001787149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e00ae290 con 0x7f96e00691b0 2024-08-17T02:24:58.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.618+0000 7f96d1ffb700 1 -- 172.21.15.31:0/2001787149 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f96dc01b3b0 con 0x7f96e00691b0 2024-08-17T02:24:58.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.618+0000 7f96e6d17700 1 -- 172.21.15.31:0/2001787149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e00712b0 con 0x7f96e00691b0 2024-08-17T02:24:58.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.618+0000 7f96d1ffb700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f96c4060860 0x7f96c4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.618+0000 7f96e5514700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f96c4060860 0x7f96c4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.618+0000 7f96d1ffb700 1 -- 172.21.15.31:0/2001787149 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96dc07c210 con 0x7f96e00691b0 2024-08-17T02:24:58.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.618+0000 7f96e5514700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f96c4060860 0x7f96c4062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f96e0063b80 tx=0x7f96d4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.626+0000 7f96d1ffb700 1 -- 172.21.15.31:0/2001787149 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f96dc04c5c0 con 0x7f96e00691b0 2024-08-17T02:24:58.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96e6d17700 1 -- 172.21.15.31:0/2001787149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f96e006a0b0 con 0x7f96e00691b0 2024-08-17T02:24:58.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96d1ffb700 1 -- 172.21.15.31:0/2001787149 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f96dc04fbe0 con 0x7f96e00691b0 2024-08-17T02:24:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:58.828 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:24:58.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96e6d17700 1 -- 172.21.15.31:0/2001787149 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f96c4060860 msgr2=0x7f96c4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96e6d17700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f96c4060860 0x7f96c4062d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f96e0063b80 tx=0x7f96d4017000 comp rx=0 tx=0).stop 2024-08-17T02:24:58.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96e6d17700 1 -- 172.21.15.31:0/2001787149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e00691b0 msgr2=0x7f96e00add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96e6d17700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e00691b0 0x7f96e00add50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c7e0 tx=0x7f96dc007df0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96e6d17700 1 -- 172.21.15.31:0/2001787149 shutdown_connections 2024-08-17T02:24:58.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96e6d17700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f96c4060860 0x7f96c4062d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96e6d17700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96e015d8b0 0x7f96e0144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96e6d17700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e0069580 0x7f96e00ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.822+0000 7f96e6d17700 1 --2- 172.21.15.31:0/2001787149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e00691b0 0x7f96e00add50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.826+0000 7f96e6d17700 1 -- 172.21.15.31:0/2001787149 >> 172.21.15.31:0/2001787149 conn(0x7f96e0067400 msgr2=0x7f96e0161430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.826+0000 7f96e6d17700 1 -- 172.21.15.31:0/2001787149 shutdown_connections 2024-08-17T02:24:58.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.826+0000 7f96e6d17700 1 -- 172.21.15.31:0/2001787149 wait complete. 2024-08-17T02:24:58.841 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:24:58.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:58.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.938+0000 7f990ffff700 1 Processor -- start 2024-08-17T02:24:58.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.938+0000 7f990ffff700 1 -- start start 2024-08-17T02:24:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.938+0000 7f990ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9910155fe0 0x7f9910159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.938+0000 7f990ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99101563b0 0x7f9910068f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.938+0000 7f990ffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99100cbb30 con 0x7f99100adb00 2024-08-17T02:24:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.938+0000 7f990ffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991015ad30 con 0x7f99101563b0 2024-08-17T02:24:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.938+0000 7f990ffff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991015a490 con 0x7f9910155fe0 2024-08-17T02:24:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99101563b0 0x7f9910068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f99101563b0 0x7f9910068f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49020/0 (socket says 172.21.15.31:49020) 2024-08-17T02:24:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990e7fc700 1 -- 172.21.15.31:0/1732364544 learned_addr learned my addr 172.21.15.31:0/1732364544 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990effd700 1 --2- 172.21.15.31:0/1732364544 >> v2:172.21.15.92:3300/0 conn(0x7f9910155fe0 0x7f9910159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990e7fc700 1 -- 172.21.15.31:0/1732364544 >> v2:172.21.15.92:3300/0 conn(0x7f9910155fe0 msgr2=0x7f9910159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990e7fc700 1 --2- 172.21.15.31:0/1732364544 >> v2:172.21.15.92:3300/0 conn(0x7f9910155fe0 0x7f9910159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990e7fc700 1 -- 172.21.15.31:0/1732364544 >> v1:172.21.15.31:6789/0 conn(0x7f99100adb00 legacy=0x7f99100aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990dffb700 1 -- 172.21.15.31:0/1732364544 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998695031 0 0) 0x7f99100cbb30 con 0x7f99100adb00 2024-08-17T02:24:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990e7fc700 1 -- 172.21.15.31:0/1732364544 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991015a770 con 0x7f99101563b0 2024-08-17T02:24:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990effd700 1 --2- 172.21.15.31:0/1732364544 >> v2:172.21.15.92:3300/0 conn(0x7f9910155fe0 0x7f9910159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990e7fc700 1 --2- 172.21.15.31:0/1732364544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 0x7f9910068f80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9910063bb0 tx=0x7f98f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51708fd02489f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990dffb700 1 -- 172.21.15.31:0/1732364544 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f800b860 con 0x7f99101563b0 2024-08-17T02:24:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990dffb700 1 -- 172.21.15.31:0/1732364544 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f800b9c0 con 0x7f99101563b0 2024-08-17T02:24:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990dffb700 1 -- 172.21.15.31:0/1732364544 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f800bd80 con 0x7f99101563b0 2024-08-17T02:24:58.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990ffff700 1 -- 172.21.15.31:0/1732364544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 msgr2=0x7f9910068f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990ffff700 1 --2- 172.21.15.31:0/1732364544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 0x7f9910068f80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9910063bb0 tx=0x7f98f8009250 comp rx=0 tx=0).stop 2024-08-17T02:24:58.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990ffff700 1 -- 172.21.15.31:0/1732364544 shutdown_connections 2024-08-17T02:24:58.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990ffff700 1 --2- 172.21.15.31:0/1732364544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 0x7f9910068f80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990ffff700 1 --2- 172.21.15.31:0/1732364544 >> v2:172.21.15.92:3300/0 conn(0x7f9910155fe0 0x7f9910159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990ffff700 1 -- 172.21.15.31:0/1732364544 >> 172.21.15.31:0/1732364544 conn(0x7f9910067400 msgr2=0x7f9910067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:58.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990ffff700 1 -- 172.21.15.31:0/1732364544 shutdown_connections 2024-08-17T02:24:58.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990ffff700 1 -- 172.21.15.31:0/1732364544 wait complete. 2024-08-17T02:24:58.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990ffff700 1 Processor -- start 2024-08-17T02:24:58.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.942+0000 7f990ffff700 1 -- start start 2024-08-17T02:24:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99100adb00 0x7f9910165950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9910155fe0 0x7f9910166000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 0x7f9910162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910166540 con 0x7f99101563b0 2024-08-17T02:24:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990ffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910166770 con 0x7f9910155fe0 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990ffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9910166a50 con 0x7f99100adb00 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 0x7f9910162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 0x7f9910162a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49032/0 (socket says 172.21.15.31:49032) 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990f7fe700 1 -- 172.21.15.31:0/2398123491 learned_addr learned my addr 172.21.15.31:0/2398123491 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990e7fc700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9910155fe0 0x7f9910166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990effd700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99100adb00 0x7f9910165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990f7fe700 1 -- 172.21.15.31:0/2398123491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99100adb00 msgr2=0x7f9910165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990f7fe700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99100adb00 0x7f9910165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990f7fe700 1 -- 172.21.15.31:0/2398123491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9910155fe0 msgr2=0x7f9910166000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990f7fe700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9910155fe0 0x7f9910166000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990f7fe700 1 -- 172.21.15.31:0/2398123491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f80094f0 con 0x7f99101563b0 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990e7fc700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9910155fe0 0x7f9910166000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990f7fe700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 0x7f9910162a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f990800c890 tx=0x7f9908001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f9906ffd700 1 -- 172.21.15.31:0/2398123491 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908017070 con 0x7f99101563b0 2024-08-17T02:24:58.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f9906ffd700 1 -- 172.21.15.31:0/2398123491 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9908006ba0 con 0x7f99101563b0 2024-08-17T02:24:58.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990ffff700 1 -- 172.21.15.31:0/2398123491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9910166d30 con 0x7f99101563b0 2024-08-17T02:24:58.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f9906ffd700 1 -- 172.21.15.31:0/2398123491 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908012630 con 0x7f99101563b0 2024-08-17T02:24:58.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990ffff700 1 -- 172.21.15.31:0/2398123491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99101672f0 con 0x7f99101563b0 2024-08-17T02:24:58.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.946+0000 7f990ffff700 1 -- 172.21.15.31:0/2398123491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99100712b0 con 0x7f99101563b0 2024-08-17T02:24:58.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.950+0000 7f9906ffd700 1 -- 172.21.15.31:0/2398123491 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9908012a20 con 0x7f99101563b0 2024-08-17T02:24:58.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.950+0000 7f9906ffd700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f98f0060860 0x7f98f0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:58.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.950+0000 7f9906ffd700 1 -- 172.21.15.31:0/2398123491 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f990807ca60 con 0x7f99101563b0 2024-08-17T02:24:58.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.950+0000 7f990effd700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f98f0060860 0x7f98f0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:58.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.950+0000 7f990effd700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f98f0060860 0x7f98f0062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9900006fd0 tx=0x7f9900008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:58.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:58.954+0000 7f9906ffd700 1 -- 172.21.15.31:0/2398123491 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f990804ceb0 con 0x7f99101563b0 2024-08-17T02:24:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.114+0000 7f990ffff700 1 -- 172.21.15.31:0/2398123491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99101674e0 con 0x7f99101563b0 2024-08-17T02:24:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.114+0000 7f9906ffd700 1 -- 172.21.15.31:0/2398123491 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f99080504d0 con 0x7f99101563b0 2024-08-17T02:24:59.122 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:24:59.122 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:59.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 -- 172.21.15.31:0/2398123491 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f98f0060860 msgr2=0x7f98f0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f98f0060860 0x7f98f0062d10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9900006fd0 tx=0x7f9900008040 comp rx=0 tx=0).stop 2024-08-17T02:24:59.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 -- 172.21.15.31:0/2398123491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 msgr2=0x7f9910162a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 0x7f9910162a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f990800c890 tx=0x7f9908001670 comp rx=0 tx=0).stop 2024-08-17T02:24:59.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 -- 172.21.15.31:0/2398123491 shutdown_connections 2024-08-17T02:24:59.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f98f0060860 0x7f98f0062d10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99101563b0 0x7f9910162a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9910155fe0 0x7f9910166000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 --2- 172.21.15.31:0/2398123491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99100adb00 0x7f9910165950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 -- 172.21.15.31:0/2398123491 >> 172.21.15.31:0/2398123491 conn(0x7f9910067400 msgr2=0x7f99100abdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 -- 172.21.15.31:0/2398123491 shutdown_connections 2024-08-17T02:24:59.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.118+0000 7f990ffff700 1 -- 172.21.15.31:0/2398123491 wait complete. 2024-08-17T02:24:59.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:43.691230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:45.035480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:24:59.136 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:24:59.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.242+0000 7ff844bfb700 1 Processor -- start 2024-08-17T02:24:59.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.242+0000 7ff844bfb700 1 -- start start 2024-08-17T02:24:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.242+0000 7ff844bfb700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff8401596c0 0x7ff8400cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.242+0000 7ff844bfb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff8400cce80 0x7ff8400ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.242+0000 7ff844bfb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84015a780 con 0x7ff8401592f0 2024-08-17T02:24:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.242+0000 7ff844bfb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84015ac10 con 0x7ff8400cce80 2024-08-17T02:24:59.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.242+0000 7ff844bfb700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8400cb870 con 0x7ff8401596c0 2024-08-17T02:24:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff8400cce80 0x7ff8400ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff8400cce80 0x7ff8400ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49038/0 (socket says 172.21.15.31:49038) 2024-08-17T02:24:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83ffff700 1 -- 172.21.15.31:0/1298017497 learned_addr learned my addr 172.21.15.31:0/1298017497 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff8401592f0 0x7ff8400cb160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58544/0 (socket says 172.21.15.31:58544) 2024-08-17T02:24:59.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83effd700 1 --2- 172.21.15.31:0/1298017497 >> v2:172.21.15.92:3300/0 conn(0x7ff8401596c0 0x7ff8400cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83ffff700 1 -- 172.21.15.31:0/1298017497 >> v2:172.21.15.92:3300/0 conn(0x7ff8401596c0 msgr2=0x7ff8400cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83ffff700 1 --2- 172.21.15.31:0/1298017497 >> v2:172.21.15.92:3300/0 conn(0x7ff8401596c0 0x7ff8400cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83ffff700 1 -- 172.21.15.31:0/1298017497 >> v1:172.21.15.31:6789/0 conn(0x7ff8401592f0 legacy=0x7ff8400cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83ffff700 1 -- 172.21.15.31:0/1298017497 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840159b70 con 0x7ff8400cce80 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83e7fc700 1 -- 172.21.15.31:0/1298017497 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979599284 0 0) 0x7ff84015a780 con 0x7ff8401592f0 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83ffff700 1 --2- 172.21.15.31:0/1298017497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8400cce80 0x7ff8400ce240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff8400cd970 tx=0x7ff838009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb8e402ca208584 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83e7fc700 1 -- 172.21.15.31:0/1298017497 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83800e070 con 0x7ff8400cce80 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83e7fc700 1 -- 172.21.15.31:0/1298017497 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83800ba20 con 0x7ff8400cce80 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff83e7fc700 1 -- 172.21.15.31:0/1298017497 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8380092e0 con 0x7ff8400cce80 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff844bfb700 1 -- 172.21.15.31:0/1298017497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8400cce80 msgr2=0x7ff8400ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff844bfb700 1 --2- 172.21.15.31:0/1298017497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8400cce80 0x7ff8400ce240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff8400cd970 tx=0x7ff838009840 comp rx=0 tx=0).stop 2024-08-17T02:24:59.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff844bfb700 1 -- 172.21.15.31:0/1298017497 shutdown_connections 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff844bfb700 1 --2- 172.21.15.31:0/1298017497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8400cce80 0x7ff8400ce240 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff844bfb700 1 --2- 172.21.15.31:0/1298017497 >> v2:172.21.15.92:3300/0 conn(0x7ff8401596c0 0x7ff8400cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff844bfb700 1 -- 172.21.15.31:0/1298017497 >> 172.21.15.31:0/1298017497 conn(0x7ff840067400 msgr2=0x7ff840067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff844bfb700 1 -- 172.21.15.31:0/1298017497 shutdown_connections 2024-08-17T02:24:59.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff844bfb700 1 -- 172.21.15.31:0/1298017497 wait complete. 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff844bfb700 1 Processor -- start 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.246+0000 7ff844bfb700 1 -- start start 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff844bfb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8400cce80 0x7ff8400b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff844bfb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401592f0 0x7ff840152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff844bfb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8401596c0 0x7ff8401563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff844bfb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84016a6d0 con 0x7ff8401596c0 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff844bfb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840152d90 con 0x7ff8401592f0 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff844bfb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff840169ac0 con 0x7ff8400cce80 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8401596c0 0x7ff8401563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8401596c0 0x7ff8401563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49040/0 (socket says 172.21.15.31:49040) 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83ffff700 1 -- 172.21.15.31:0/3225184666 learned_addr learned my addr 172.21.15.31:0/3225184666 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83effd700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401592f0 0x7ff840152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83f7fe700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8400cce80 0x7ff8400b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83effd700 1 -- 172.21.15.31:0/3225184666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8400cce80 msgr2=0x7ff8400b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83effd700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8400cce80 0x7ff8400b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83effd700 1 -- 172.21.15.31:0/3225184666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8401596c0 msgr2=0x7ff8401563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83effd700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8401596c0 0x7ff8401563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83effd700 1 -- 172.21.15.31:0/3225184666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff838009ae0 con 0x7ff8401592f0 2024-08-17T02:24:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff83effd700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401592f0 0x7ff840152850 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e850 tx=0x7ff8340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff8277fe700 1 -- 172.21.15.31:0/3225184666 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834013680 con 0x7ff8401592f0 2024-08-17T02:24:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff8277fe700 1 -- 172.21.15.31:0/3225184666 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340137e0 con 0x7ff8401592f0 2024-08-17T02:24:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff8277fe700 1 -- 172.21.15.31:0/3225184666 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834013ba0 con 0x7ff8401592f0 2024-08-17T02:24:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff844bfb700 1 -- 172.21.15.31:0/3225184666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff840169da0 con 0x7ff8401592f0 2024-08-17T02:24:59.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff844bfb700 1 -- 172.21.15.31:0/3225184666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84016a360 con 0x7ff8401592f0 2024-08-17T02:24:59.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.250+0000 7ff844bfb700 1 -- 172.21.15.31:0/3225184666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8400712b0 con 0x7ff8401592f0 2024-08-17T02:24:59.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.254+0000 7ff8277fe700 1 -- 172.21.15.31:0/3225184666 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff8340123d0 con 0x7ff8401592f0 2024-08-17T02:24:59.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.254+0000 7ff8277fe700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff82c060860 0x7ff82c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.254+0000 7ff8277fe700 1 -- 172.21.15.31:0/3225184666 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff83407ce70 con 0x7ff8401592f0 2024-08-17T02:24:59.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.254+0000 7ff83f7fe700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff82c060860 0x7ff82c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.254+0000 7ff83f7fe700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff82c060860 0x7ff82c062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff830007fd0 tx=0x7ff830007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.262+0000 7ff8277fe700 1 -- 172.21.15.31:0/3225184666 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff83404d220 con 0x7ff8401592f0 2024-08-17T02:24:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.422+0000 7ff844bfb700 1 -- 172.21.15.31:0/3225184666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8400cfe40 con 0x7ff8401592f0 2024-08-17T02:24:59.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff8277fe700 1 -- 172.21.15.31:0/3225184666 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff834050840 con 0x7ff8401592f0 2024-08-17T02:24:59.431 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:24:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 -- 172.21.15.31:0/3225184666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff82c060860 msgr2=0x7ff82c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff82c060860 0x7ff82c062d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff830007fd0 tx=0x7ff830007d50 comp rx=0 tx=0).stop 2024-08-17T02:24:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 -- 172.21.15.31:0/3225184666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401592f0 msgr2=0x7ff840152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401592f0 0x7ff840152850 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e850 tx=0x7ff8340091a0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 -- 172.21.15.31:0/3225184666 shutdown_connections 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff82c060860 0x7ff82c062d10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8401596c0 0x7ff8401563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401592f0 0x7ff840152850 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 --2- 172.21.15.31:0/3225184666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff8400cce80 0x7ff8400b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 -- 172.21.15.31:0/3225184666 >> 172.21.15.31:0/3225184666 conn(0x7ff840067400 msgr2=0x7ff8401547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 -- 172.21.15.31:0/3225184666 shutdown_connections 2024-08-17T02:24:59.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.426+0000 7ff844bfb700 1 -- 172.21.15.31:0/3225184666 wait complete. 2024-08-17T02:24:59.444 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:24:59.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef7fff700 1 Processor -- start 2024-08-17T02:24:59.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef7fff700 1 -- start start 2024-08-17T02:24:59.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef7fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 0x7f2ef806a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2ef80cc3c0 0x7f2ef8155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef7fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef80ab6e0 con 0x7f2ef806a0f0 2024-08-17T02:24:59.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef7fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef80abf80 con 0x7f2ef80cc3c0 2024-08-17T02:24:59.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef7fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef815a7f0 con 0x7f2ef80b0f80 2024-08-17T02:24:59.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2ef80cc3c0 0x7f2ef8155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef6ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2ef806a0f0 0x7f2ef81557d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58548/0 (socket says 172.21.15.31:58548) 2024-08-17T02:24:59.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef6ffd700 1 -- 172.21.15.31:0/4202786296 learned_addr learned my addr 172.21.15.31:0/4202786296 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:24:59.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef67fc700 1 --2- 172.21.15.31:0/4202786296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 0x7f2ef806a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef5ffb700 1 -- 172.21.15.31:0/4202786296 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334400997 0 0) 0x7f2ef80ab6e0 con 0x7f2ef806a0f0 2024-08-17T02:24:59.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef5ffb700 1 -- 172.21.15.31:0/4202786296 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed8003570 con 0x7f2ef806a0f0 2024-08-17T02:24:59.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef77fe700 1 -- 172.21.15.31:0/4202786296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 msgr2=0x7f2ef806a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:59.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef77fe700 1 --2- 172.21.15.31:0/4202786296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 0x7f2ef806a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef77fe700 1 -- 172.21.15.31:0/4202786296 >> v1:172.21.15.31:6789/0 conn(0x7f2ef806a0f0 legacy=0x7f2ef81557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef77fe700 1 -- 172.21.15.31:0/4202786296 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef80ab930 con 0x7f2ef80cc3c0 2024-08-17T02:24:59.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef67fc700 1 --2- 172.21.15.31:0/4202786296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 0x7f2ef806a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:59.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.546+0000 7f2ef77fe700 1 --2- 172.21.15.31:0/4202786296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef80cc3c0 0x7f2ef8155ee0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009e60 tx=0x7f2ef0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d043e0b36f9e3481 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef5ffb700 1 -- 172.21.15.31:0/4202786296 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000e070 con 0x7f2ef80cc3c0 2024-08-17T02:24:59.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef5ffb700 1 -- 172.21.15.31:0/4202786296 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef000bab0 con 0x7f2ef80cc3c0 2024-08-17T02:24:59.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef5ffb700 1 -- 172.21.15.31:0/4202786296 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000be70 con 0x7f2ef80cc3c0 2024-08-17T02:24:59.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef7fff700 1 -- 172.21.15.31:0/4202786296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef80cc3c0 msgr2=0x7f2ef8155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef7fff700 1 --2- 172.21.15.31:0/4202786296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef80cc3c0 0x7f2ef8155ee0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009e60 tx=0x7f2ef0009780 comp rx=0 tx=0).stop 2024-08-17T02:24:59.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef7fff700 1 -- 172.21.15.31:0/4202786296 shutdown_connections 2024-08-17T02:24:59.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef7fff700 1 --2- 172.21.15.31:0/4202786296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef80cc3c0 0x7f2ef8155ee0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef7fff700 1 --2- 172.21.15.31:0/4202786296 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 0x7f2ef806a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef7fff700 1 -- 172.21.15.31:0/4202786296 >> 172.21.15.31:0/4202786296 conn(0x7f2ef8067e90 msgr2=0x7f2ef80cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef7fff700 1 -- 172.21.15.31:0/4202786296 shutdown_connections 2024-08-17T02:24:59.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.550+0000 7f2ef7fff700 1 -- 172.21.15.31:0/4202786296 wait complete. 2024-08-17T02:24:59.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef7fff700 1 Processor -- start 2024-08-17T02:24:59.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef7fff700 1 -- start start 2024-08-17T02:24:59.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef806a0f0 0x7f2ef813aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef7fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 0x7f2ef80acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef80cc3c0 0x7f2ef80ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef7fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80c8d20 con 0x7f2ef806a0f0 2024-08-17T02:24:59.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef7fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef8156450 con 0x7f2ef80cc3c0 2024-08-17T02:24:59.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef7fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef8156a10 con 0x7f2ef80b0f80 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef806a0f0 0x7f2ef813aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef806a0f0 0x7f2ef813aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49050/0 (socket says 172.21.15.31:49050) 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef6ffd700 1 -- 172.21.15.31:0/2231523974 learned_addr learned my addr 172.21.15.31:0/2231523974 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef77fe700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef80cc3c0 0x7f2ef80ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef6ffd700 1 -- 172.21.15.31:0/2231523974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 msgr2=0x7f2ef80acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef67fc700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 0x7f2ef80acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef6ffd700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 0x7f2ef80acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef6ffd700 1 -- 172.21.15.31:0/2231523974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef80cc3c0 msgr2=0x7f2ef80ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef6ffd700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef80cc3c0 0x7f2ef80ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef6ffd700 1 -- 172.21.15.31:0/2231523974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee0009420 con 0x7f2ef806a0f0 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef77fe700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef80cc3c0 0x7f2ef80ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef67fc700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 0x7f2ef80acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:59.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef6ffd700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef806a0f0 0x7f2ef813aa40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c790 tx=0x7f2ee8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2eeeffd700 1 -- 172.21.15.31:0/2231523974 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8005b30 con 0x7f2ef806a0f0 2024-08-17T02:24:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2eeeffd700 1 -- 172.21.15.31:0/2231523974 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee8005c90 con 0x7f2ef806a0f0 2024-08-17T02:24:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2eeeffd700 1 -- 172.21.15.31:0/2231523974 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8007300 con 0x7f2ef806a0f0 2024-08-17T02:24:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.554+0000 7f2ef7fff700 1 -- 172.21.15.31:0/2231523974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef0009a20 con 0x7f2ef806a0f0 2024-08-17T02:24:59.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.558+0000 7f2ef7fff700 1 -- 172.21.15.31:0/2231523974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef80cbc10 con 0x7f2ef806a0f0 2024-08-17T02:24:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.558+0000 7f2ef7fff700 1 -- 172.21.15.31:0/2231523974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef80712b0 con 0x7f2ef806a0f0 2024-08-17T02:24:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.558+0000 7f2eeeffd700 1 -- 172.21.15.31:0/2231523974 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2ee8007670 con 0x7f2ef806a0f0 2024-08-17T02:24:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.558+0000 7f2eeeffd700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2edc060860 0x7f2edc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.558+0000 7f2ef67fc700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2edc060860 0x7f2edc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.558+0000 7f2eeeffd700 1 -- 172.21.15.31:0/2231523974 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ee807c1c0 con 0x7f2ef806a0f0 2024-08-17T02:24:59.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.558+0000 7f2ef67fc700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2edc060860 0x7f2edc062d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00093f0 tx=0x7f2ee0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.566+0000 7f2eeeffd700 1 -- 172.21.15.31:0/2231523974 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2ee804c570 con 0x7f2ef806a0f0 2024-08-17T02:24:59.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.730+0000 7f2ef7fff700 1 -- 172.21.15.31:0/2231523974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ef806f3c0 con 0x7f2ef806a0f0 2024-08-17T02:24:59.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.730+0000 7f2eeeffd700 1 -- 172.21.15.31:0/2231523974 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ee804fb90 con 0x7f2ef806a0f0 2024-08-17T02:24:59.737 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:24:59.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 -- 172.21.15.31:0/2231523974 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2edc060860 msgr2=0x7f2edc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2edc060860 0x7f2edc062d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00093f0 tx=0x7f2ee0008040 comp rx=0 tx=0).stop 2024-08-17T02:24:59.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 -- 172.21.15.31:0/2231523974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef806a0f0 msgr2=0x7f2ef813aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef806a0f0 0x7f2ef813aa40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c790 tx=0x7f2ee8007df0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 -- 172.21.15.31:0/2231523974 shutdown_connections 2024-08-17T02:24:59.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2edc060860 0x7f2edc062d10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef80cc3c0 0x7f2ef80ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ef80b0f80 0x7f2ef80acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 --2- 172.21.15.31:0/2231523974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ef806a0f0 0x7f2ef813aa40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 -- 172.21.15.31:0/2231523974 >> 172.21.15.31:0/2231523974 conn(0x7f2ef8067e90 msgr2=0x7f2ef81597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 -- 172.21.15.31:0/2231523974 shutdown_connections 2024-08-17T02:24:59.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.734+0000 7f2ef7fff700 1 -- 172.21.15.31:0/2231523974 wait complete. 2024-08-17T02:24:59.751 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:24:59.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.858+0000 7fde92127700 1 Processor -- start 2024-08-17T02:24:59.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.858+0000 7fde92127700 1 -- start start 2024-08-17T02:24:59.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde8c156300 0x7fde8c069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde8c159d00 0x7fde8c15a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8c15a680 con 0x7fde8c155f30 2024-08-17T02:24:59.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c0aef60 con 0x7fde8c156300 2024-08-17T02:24:59.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c0af240 con 0x7fde8c159d00 2024-08-17T02:24:59.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde83fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde8c156300 0x7fde8c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde83fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde8c156300 0x7fde8c069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49058/0 (socket says 172.21.15.31:49058) 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde83fff700 1 -- 172.21.15.31:0/946753099 learned_addr learned my addr 172.21.15.31:0/946753099 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde8bfff700 1 --2- 172.21.15.31:0/946753099 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde8c159d00 0x7fde8c15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde83fff700 1 -- 172.21.15.31:0/946753099 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde8c159d00 msgr2=0x7fde8c15a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde83fff700 1 --2- 172.21.15.31:0/946753099 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde8c159d00 0x7fde8c15a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde83fff700 1 -- 172.21.15.31:0/946753099 >> v1:172.21.15.92:6789/0 conn(0x7fde8c155f30 legacy=0x7fde8c0c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde83fff700 1 -- 172.21.15.31:0/946753099 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c0af520 con 0x7fde8c156300 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde8affd700 1 -- 172.21.15.31:0/946753099 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230907145 0 0) 0x7fde8c15a680 con 0x7fde8c155f30 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde83fff700 1 --2- 172.21.15.31:0/946753099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c156300 0x7fde8c069690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fde740099b0 tx=0x7fde74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acab83062da2b00a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde8affd700 1 -- 172.21.15.31:0/946753099 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74009ea0 con 0x7fde8c156300 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde8affd700 1 -- 172.21.15.31:0/946753099 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7400b860 con 0x7fde8c156300 2024-08-17T02:24:59.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde8affd700 1 -- 172.21.15.31:0/946753099 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7400bc00 con 0x7fde8c156300 2024-08-17T02:24:59.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 -- 172.21.15.31:0/946753099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c156300 msgr2=0x7fde8c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 --2- 172.21.15.31:0/946753099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c156300 0x7fde8c069690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fde740099b0 tx=0x7fde74009250 comp rx=0 tx=0).stop 2024-08-17T02:24:59.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 -- 172.21.15.31:0/946753099 shutdown_connections 2024-08-17T02:24:59.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 --2- 172.21.15.31:0/946753099 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde8c159d00 0x7fde8c15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 --2- 172.21.15.31:0/946753099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c156300 0x7fde8c069690 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 -- 172.21.15.31:0/946753099 >> 172.21.15.31:0/946753099 conn(0x7fde8c067e40 msgr2=0x7fde8c068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:59.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 -- 172.21.15.31:0/946753099 shutdown_connections 2024-08-17T02:24:59.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.862+0000 7fde92127700 1 -- 172.21.15.31:0/946753099 wait complete. 2024-08-17T02:24:59.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde92127700 1 Processor -- start 2024-08-17T02:24:59.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde92127700 1 -- start start 2024-08-17T02:24:59.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde92127700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde8c155f30 0x7fde8c13dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde92127700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde8c156300 0x7fde8c152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde92127700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c159d00 0x7fde8c152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde92127700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c0c9dc0 con 0x7fde8c159d00 2024-08-17T02:24:59.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde92127700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c13e520 con 0x7fde8c156300 2024-08-17T02:24:59.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde92127700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c13b570 con 0x7fde8c155f30 2024-08-17T02:24:59.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde8bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c159d00 0x7fde8c152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde8bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c159d00 0x7fde8c152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49068/0 (socket says 172.21.15.31:49068) 2024-08-17T02:24:59.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde8bfff700 1 -- 172.21.15.31:0/160978291 learned_addr learned my addr 172.21.15.31:0/160978291 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:24:59.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde83fff700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde8c156300 0x7fde8c152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.866+0000 7fde8b7fe700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde8c155f30 0x7fde8c13dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde8bfff700 1 -- 172.21.15.31:0/160978291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde8c155f30 msgr2=0x7fde8c13dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde8bfff700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde8c155f30 0x7fde8c13dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde8bfff700 1 -- 172.21.15.31:0/160978291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde8c156300 msgr2=0x7fde8c152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:59.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde8bfff700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde8c156300 0x7fde8c152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:59.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde8bfff700 1 -- 172.21.15.31:0/160978291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde740094f0 con 0x7fde8c159d00 2024-08-17T02:24:59.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde8bfff700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c159d00 0x7fde8c152da0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde84009df0 tx=0x7fde8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde837fe700 1 -- 172.21.15.31:0/160978291 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8400cb50 con 0x7fde8c159d00 2024-08-17T02:24:59.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde837fe700 1 -- 172.21.15.31:0/160978291 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8400f040 con 0x7fde8c159d00 2024-08-17T02:24:59.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde92127700 1 -- 172.21.15.31:0/160978291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c0c91b0 con 0x7fde8c159d00 2024-08-17T02:24:59.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde837fe700 1 -- 172.21.15.31:0/160978291 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84012430 con 0x7fde8c159d00 2024-08-17T02:24:59.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde92127700 1 -- 172.21.15.31:0/160978291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c0c9770 con 0x7fde8c159d00 2024-08-17T02:24:59.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde837fe700 1 -- 172.21.15.31:0/160978291 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fde840127e0 con 0x7fde8c159d00 2024-08-17T02:24:59.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde92127700 1 -- 172.21.15.31:0/160978291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8c0c9f30 con 0x7fde8c159d00 2024-08-17T02:24:59.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde837fe700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fde70060890 0x7fde70062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:59.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde837fe700 1 -- 172.21.15.31:0/160978291 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde84016070 con 0x7fde8c159d00 2024-08-17T02:24:59.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.870+0000 7fde8b7fe700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fde70060890 0x7fde70062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:59.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.874+0000 7fde8b7fe700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fde70060890 0x7fde70062d40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fde8c169590 tx=0x7fde7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:59.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:24:59.882+0000 7fde837fe700 1 -- 172.21.15.31:0/160978291 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fde8404f9f0 con 0x7fde8c159d00 2024-08-17T02:25:00.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.042+0000 7fde92127700 1 -- 172.21.15.31:0/160978291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde8c0712b0 con 0x7fde8c159d00 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.042+0000 7fde837fe700 1 -- 172.21.15.31:0/160978291 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde84053010 con 0x7fde8c159d00 2024-08-17T02:25:00.049 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 -- 172.21.15.31:0/160978291 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fde70060890 msgr2=0x7fde70062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fde70060890 0x7fde70062d40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fde8c169590 tx=0x7fde7c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 -- 172.21.15.31:0/160978291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c159d00 msgr2=0x7fde8c152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c159d00 0x7fde8c152da0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde84009df0 tx=0x7fde8400b040 comp rx=0 tx=0).stop 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 -- 172.21.15.31:0/160978291 shutdown_connections 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fde70060890 0x7fde70062d40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde8c159d00 0x7fde8c152da0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde8c156300 0x7fde8c152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 --2- 172.21.15.31:0/160978291 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde8c155f30 0x7fde8c13dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 -- 172.21.15.31:0/160978291 >> 172.21.15.31:0/160978291 conn(0x7fde8c067e40 msgr2=0x7fde8c0cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 -- 172.21.15.31:0/160978291 shutdown_connections 2024-08-17T02:25:00.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.046+0000 7fde92127700 1 -- 172.21.15.31:0/160978291 wait complete. 2024-08-17T02:25:00.066 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:00.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.166+0000 7f4ff708e700 1 Processor -- start 2024-08-17T02:25:00.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.166+0000 7f4ff708e700 1 -- start start 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ff00b16f0 0x7f4ff0140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ff00c9c30 0x7f4ff00ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff00ab690 con 0x7f4ff0140780 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff00caa00 con 0x7f4ff00b16f0 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff00cace0 con 0x7f4ff00c9c30 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff608c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4ff0140780 0x7f4ff00b0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58556/0 (socket says 172.21.15.31:58556) 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff588b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ff00b16f0 0x7f4ff0140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff608c700 1 -- 172.21.15.31:0/4166222207 learned_addr learned my addr 172.21.15.31:0/4166222207 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff688d700 1 --2- 172.21.15.31:0/4166222207 >> v2:172.21.15.92:3300/0 conn(0x7f4ff00c9c30 0x7f4ff00ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff588b700 1 -- 172.21.15.31:0/4166222207 >> v2:172.21.15.92:3300/0 conn(0x7f4ff00c9c30 msgr2=0x7f4ff00ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:00.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff588b700 1 --2- 172.21.15.31:0/4166222207 >> v2:172.21.15.92:3300/0 conn(0x7f4ff00c9c30 0x7f4ff00ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff588b700 1 -- 172.21.15.31:0/4166222207 >> v1:172.21.15.31:6789/0 conn(0x7f4ff0140780 legacy=0x7f4ff00b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff588b700 1 -- 172.21.15.31:0/4166222207 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00cafc0 con 0x7f4ff00b16f0 2024-08-17T02:25:00.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff588b700 1 --2- 172.21.15.31:0/4166222207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 0x7f4ff0140b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0068380 tx=0x7f4fe0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e426ba3fc4841104 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff508a700 1 -- 172.21.15.31:0/4166222207 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000e070 con 0x7f4ff00b16f0 2024-08-17T02:25:00.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff508a700 1 -- 172.21.15.31:0/4166222207 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe000bc30 con 0x7f4ff00b16f0 2024-08-17T02:25:00.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff508a700 1 -- 172.21.15.31:0/4166222207 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0012430 con 0x7f4ff00b16f0 2024-08-17T02:25:00.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 -- 172.21.15.31:0/4166222207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 msgr2=0x7f4ff0140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 --2- 172.21.15.31:0/4166222207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 0x7f4ff0140b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0068380 tx=0x7f4fe0009780 comp rx=0 tx=0).stop 2024-08-17T02:25:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 -- 172.21.15.31:0/4166222207 shutdown_connections 2024-08-17T02:25:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 --2- 172.21.15.31:0/4166222207 >> v2:172.21.15.92:3300/0 conn(0x7f4ff00c9c30 0x7f4ff00ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 --2- 172.21.15.31:0/4166222207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 0x7f4ff0140b50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 -- 172.21.15.31:0/4166222207 >> 172.21.15.31:0/4166222207 conn(0x7f4ff0067400 msgr2=0x7f4ff0067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 -- 172.21.15.31:0/4166222207 shutdown_connections 2024-08-17T02:25:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.170+0000 7f4ff708e700 1 -- 172.21.15.31:0/4166222207 wait complete. 2024-08-17T02:25:00.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.174+0000 7f4ff708e700 1 Processor -- start 2024-08-17T02:25:00.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.174+0000 7f4ff708e700 1 -- start start 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff708e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 0x7f4ff01382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff708e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ff00c9c30 0x7f4ff013a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff708e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ff0140780 0x7f4ff013ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff708e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff01396d0 con 0x7f4ff00b16f0 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff708e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff0138820 con 0x7f4ff00c9c30 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff708e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff0138ac0 con 0x7f4ff0140780 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff608c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 0x7f4ff01382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff608c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 0x7f4ff01382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49088/0 (socket says 172.21.15.31:49088) 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff608c700 1 -- 172.21.15.31:0/893841639 learned_addr learned my addr 172.21.15.31:0/893841639 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff588b700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ff00c9c30 0x7f4ff013a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff688d700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ff0140780 0x7f4ff013ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff608c700 1 -- 172.21.15.31:0/893841639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ff0140780 msgr2=0x7f4ff013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff608c700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ff0140780 0x7f4ff013ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff608c700 1 -- 172.21.15.31:0/893841639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ff00c9c30 msgr2=0x7f4ff013a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff608c700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ff00c9c30 0x7f4ff013a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff608c700 1 -- 172.21.15.31:0/893841639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0009a20 con 0x7f4ff00b16f0 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff688d700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ff0140780 0x7f4ff013ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff608c700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 0x7f4ff01382e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c590 tx=0x7f4fe8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4fe67fc700 1 -- 172.21.15.31:0/893841639 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8005b30 con 0x7f4ff00b16f0 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4fe67fc700 1 -- 172.21.15.31:0/893841639 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe8005cb0 con 0x7f4ff00b16f0 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4fe67fc700 1 -- 172.21.15.31:0/893841639 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8007320 con 0x7f4ff00b16f0 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff708e700 1 -- 172.21.15.31:0/893841639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff0138da0 con 0x7f4ff00b16f0 2024-08-17T02:25:00.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff708e700 1 -- 172.21.15.31:0/893841639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff0139360 con 0x7f4ff00b16f0 2024-08-17T02:25:00.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.178+0000 7f4ff708e700 1 -- 172.21.15.31:0/893841639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff00712b0 con 0x7f4ff00b16f0 2024-08-17T02:25:00.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.182+0000 7f4fe67fc700 1 -- 172.21.15.31:0/893841639 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4fe801b3b0 con 0x7f4ff00b16f0 2024-08-17T02:25:00.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.182+0000 7f4fe67fc700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4fdc060860 0x7f4fdc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.182+0000 7f4fe67fc700 1 -- 172.21.15.31:0/893841639 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4fe807bff0 con 0x7f4ff00b16f0 2024-08-17T02:25:00.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.182+0000 7f4ff588b700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4fdc060860 0x7f4fdc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.182+0000 7f4ff588b700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4fdc060860 0x7f4fdc062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0068380 tx=0x7f4fe0019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.194+0000 7f4fe67fc700 1 -- 172.21.15.31:0/893841639 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4fe804c3a0 con 0x7f4ff00b16f0 2024-08-17T02:25:00.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.390+0000 7f4ff708e700 1 -- 172.21.15.31:0/893841639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ff00ae5b0 con 0x7f4ff00b16f0 2024-08-17T02:25:00.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4fe67fc700 1 -- 172.21.15.31:0/893841639 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f4fe8017090 con 0x7f4ff00b16f0 2024-08-17T02:25:00.398 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:00.398 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2641277078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2641277078},{"type":"v1","addr":"172.21.15.92:6835","nonce":2641277078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2478493982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2478493982},{"type":"v1","addr":"172.21.15.92:6833","nonce":2478493982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/3915393252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3915393252},{"type":"v1","addr":"172.21.15.31:6836","nonce":3915393252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:46.040941+0000","modified":"2024-08-17T02:24:48.689838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6837/2360104768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":2360104768},{"type":"v1","addr":"172.21.15.31:6837","nonce":2360104768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 -- 172.21.15.31:0/893841639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4fdc060860 msgr2=0x7f4fdc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4fdc060860 0x7f4fdc062d10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0068380 tx=0x7f4fe0019000 comp rx=0 tx=0).stop 2024-08-17T02:25:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 -- 172.21.15.31:0/893841639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 msgr2=0x7f4ff01382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 0x7f4ff01382e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c590 tx=0x7f4fe8007f90 comp rx=0 tx=0).stop 2024-08-17T02:25:00.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 -- 172.21.15.31:0/893841639 shutdown_connections 2024-08-17T02:25:00.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4fdc060860 0x7f4fdc062d10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ff0140780 0x7f4ff013ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ff00c9c30 0x7f4ff013a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 --2- 172.21.15.31:0/893841639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ff00b16f0 0x7f4ff01382e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 -- 172.21.15.31:0/893841639 >> 172.21.15.31:0/893841639 conn(0x7f4ff0067400 msgr2=0x7f4ff013ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 -- 172.21.15.31:0/893841639 shutdown_connections 2024-08-17T02:25:00.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.394+0000 7f4ff708e700 1 -- 172.21.15.31:0/893841639 wait complete. 2024-08-17T02:25:00.402 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-08-17T02:25:00.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:00.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 Processor -- start 2024-08-17T02:25:00.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 -- start start 2024-08-17T02:25:00.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 0x7f41ac06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41ac0ade80 0x7f41ac06a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac0ad9f0 con 0x7f41ac0af010 2024-08-17T02:25:00.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac0acde0 con 0x7f41ac0ade80 2024-08-17T02:25:00.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0ad0c0 con 0x7f41ac15d530 2024-08-17T02:25:00.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b16b6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41ac0ade80 0x7f41ac06a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b16b6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41ac0ade80 0x7f41ac06a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49100/0 (socket says 172.21.15.31:49100) 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b16b6700 1 -- 172.21.15.31:0/989344904 learned_addr learned my addr 172.21.15.31:0/989344904 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b1eb7700 1 --2- 172.21.15.31:0/989344904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 0x7f41ac06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b16b6700 1 -- 172.21.15.31:0/989344904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 msgr2=0x7f41ac06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b16b6700 1 --2- 172.21.15.31:0/989344904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 0x7f41ac06a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b16b6700 1 -- 172.21.15.31:0/989344904 >> v1:172.21.15.92:6789/0 conn(0x7f41ac0af010 legacy=0x7f41ac0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b16b6700 1 -- 172.21.15.31:0/989344904 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac0ad3a0 con 0x7f41ac0ade80 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b1eb7700 1 --2- 172.21.15.31:0/989344904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 0x7f41ac06a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b16b6700 1 --2- 172.21.15.31:0/989344904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac0ade80 0x7f41ac06a6e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41a80099b0 tx=0x7f41a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54425070ca5670b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b0eb5700 1 -- 172.21.15.31:0/989344904 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a800b860 con 0x7f41ac0ade80 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b0eb5700 1 -- 172.21.15.31:0/989344904 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a800b9c0 con 0x7f41ac0ade80 2024-08-17T02:25:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b0eb5700 1 -- 172.21.15.31:0/989344904 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a800bd60 con 0x7f41ac0ade80 2024-08-17T02:25:00.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 -- 172.21.15.31:0/989344904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac0ade80 msgr2=0x7f41ac06a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 --2- 172.21.15.31:0/989344904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac0ade80 0x7f41ac06a6e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41a80099b0 tx=0x7f41a8009250 comp rx=0 tx=0).stop 2024-08-17T02:25:00.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 -- 172.21.15.31:0/989344904 shutdown_connections 2024-08-17T02:25:00.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 --2- 172.21.15.31:0/989344904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac0ade80 0x7f41ac06a6e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 --2- 172.21.15.31:0/989344904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 0x7f41ac06a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 -- 172.21.15.31:0/989344904 >> 172.21.15.31:0/989344904 conn(0x7f41ac0cbe50 msgr2=0x7f41ac0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 -- 172.21.15.31:0/989344904 shutdown_connections 2024-08-17T02:25:00.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.518+0000 7f41b411b700 1 -- 172.21.15.31:0/989344904 wait complete. 2024-08-17T02:25:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.522+0000 7f41b411b700 1 Processor -- start 2024-08-17T02:25:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.522+0000 7f41b411b700 1 -- start start 2024-08-17T02:25:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b411b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41ac0ade80 0x7f41ac16d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b411b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac0af010 0x7f41ac0c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b411b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 0x7f41ac1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b411b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac15d900 con 0x7f41ac0af010 2024-08-17T02:25:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b411b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0c8960 con 0x7f41ac0ade80 2024-08-17T02:25:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b411b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac15db50 con 0x7f41ac15d530 2024-08-17T02:25:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b16b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac0af010 0x7f41ac0c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b16b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac0af010 0x7f41ac0c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49112/0 (socket says 172.21.15.31:49112) 2024-08-17T02:25:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b16b6700 1 -- 172.21.15.31:0/3087487877 learned_addr learned my addr 172.21.15.31:0/3087487877 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b1eb7700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41ac0ade80 0x7f41ac16d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b26b8700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 0x7f41ac1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b1eb7700 1 -- 172.21.15.31:0/3087487877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 msgr2=0x7f41ac1558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b1eb7700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 0x7f41ac1558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b1eb7700 1 -- 172.21.15.31:0/3087487877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac0af010 msgr2=0x7f41ac0c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b1eb7700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac0af010 0x7f41ac0c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b1eb7700 1 -- 172.21.15.31:0/3087487877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80094f0 con 0x7f41ac0ade80 2024-08-17T02:25:00.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b1eb7700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41ac0ade80 0x7f41ac16d8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f419c00c880 tx=0x7f419c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41a1ffb700 1 -- 172.21.15.31:0/3087487877 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c011600 con 0x7f41ac0ade80 2024-08-17T02:25:00.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41a1ffb700 1 -- 172.21.15.31:0/3087487877 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c011760 con 0x7f41ac0ade80 2024-08-17T02:25:00.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b411b700 1 -- 172.21.15.31:0/3087487877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac15de30 con 0x7f41ac0ade80 2024-08-17T02:25:00.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41a1ffb700 1 -- 172.21.15.31:0/3087487877 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c011b20 con 0x7f41ac0ade80 2024-08-17T02:25:00.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b411b700 1 -- 172.21.15.31:0/3087487877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ac15e3f0 con 0x7f41ac0ade80 2024-08-17T02:25:00.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41b411b700 1 -- 172.21.15.31:0/3087487877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ac15e5e0 con 0x7f41ac0ade80 2024-08-17T02:25:00.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.526+0000 7f41a1ffb700 1 -- 172.21.15.31:0/3087487877 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f419c0193b0 con 0x7f41ac0ade80 2024-08-17T02:25:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.530+0000 7f41a1ffb700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4190060860 0x7f4190062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.530+0000 7f41a1ffb700 1 -- 172.21.15.31:0/3087487877 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f419c07ce10 con 0x7f41ac0ade80 2024-08-17T02:25:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.530+0000 7f41b16b6700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4190060860 0x7f4190062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.530+0000 7f41b16b6700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4190060860 0x7f4190062d10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0c8660 tx=0x7f41a8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.538+0000 7f41a1ffb700 1 -- 172.21.15.31:0/3087487877 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f419c080030 con 0x7f41ac0ade80 2024-08-17T02:25:00.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.706+0000 7f41b411b700 1 -- 172.21.15.31:0/3087487877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41ac0712b0 con 0x7f41ac0ade80 2024-08-17T02:25:00.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.706+0000 7f41a1ffb700 1 -- 172.21.15.31:0/3087487877 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f419c050c50 con 0x7f41ac0ade80 2024-08-17T02:25:00.714 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:00.714 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:00.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 -- 172.21.15.31:0/3087487877 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4190060860 msgr2=0x7f4190062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4190060860 0x7f4190062d10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0c8660 tx=0x7f41a8017000 comp rx=0 tx=0).stop 2024-08-17T02:25:00.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 -- 172.21.15.31:0/3087487877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41ac0ade80 msgr2=0x7f41ac16d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41ac0ade80 0x7f41ac16d8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f419c00c880 tx=0x7f419c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:00.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 -- 172.21.15.31:0/3087487877 shutdown_connections 2024-08-17T02:25:00.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4190060860 0x7f4190062d10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41ac15d530 0x7f41ac1558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac0af010 0x7f41ac0c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 --2- 172.21.15.31:0/3087487877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41ac0ade80 0x7f41ac16d8c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 -- 172.21.15.31:0/3087487877 >> 172.21.15.31:0/3087487877 conn(0x7f41ac0cbe50 msgr2=0x7f41ac0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 -- 172.21.15.31:0/3087487877 shutdown_connections 2024-08-17T02:25:00.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.710+0000 7f41b411b700 1 -- 172.21.15.31:0/3087487877 wait complete. 2024-08-17T02:25:00.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:43.691230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:45.035480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:00.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:00.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.842+0000 7f8dbead5700 1 Processor -- start 2024-08-17T02:25:00.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.842+0000 7f8dbead5700 1 -- start start 2024-08-17T02:25:00.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8db8156fd0 0x7f8db806e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8db81573a0 0x7f8db8157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db815ac90 con 0x7f8db80b2250 2024-08-17T02:25:00.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db815b530 con 0x7f8db81573a0 2024-08-17T02:25:00.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db80ac9a0 con 0x7f8db8156fd0 2024-08-17T02:25:00.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbd072700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8db81573a0 0x7f8db8157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbd072700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8db81573a0 0x7f8db8157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34562/0 (socket says 172.21.15.31:34562) 2024-08-17T02:25:00.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbd072700 1 -- 172.21.15.31:0/252582431 learned_addr learned my addr 172.21.15.31:0/252582431 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:00.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbc871700 1 --2- 172.21.15.31:0/252582431 >> v2:172.21.15.92:3300/0 conn(0x7f8db8156fd0 0x7f8db806e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbd072700 1 -- 172.21.15.31:0/252582431 >> v2:172.21.15.92:3300/0 conn(0x7f8db8156fd0 msgr2=0x7f8db806e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:00.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbd072700 1 --2- 172.21.15.31:0/252582431 >> v2:172.21.15.92:3300/0 conn(0x7f8db8156fd0 0x7f8db806e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbd072700 1 -- 172.21.15.31:0/252582431 >> v1:172.21.15.92:6789/0 conn(0x7f8db80b2250 legacy=0x7f8db80b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbd072700 1 -- 172.21.15.31:0/252582431 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db80af9b0 con 0x7f8db81573a0 2024-08-17T02:25:00.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbd072700 1 --2- 172.21.15.31:0/252582431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db81573a0 0x7f8db8157800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8db806dd00 tx=0x7f8db0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcf2ffd8f743e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8daf7fe700 1 -- 172.21.15.31:0/252582431 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000e070 con 0x7f8db81573a0 2024-08-17T02:25:00.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8daf7fe700 1 -- 172.21.15.31:0/252582431 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db000ba20 con 0x7f8db81573a0 2024-08-17T02:25:00.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8daf7fe700 1 -- 172.21.15.31:0/252582431 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db00092e0 con 0x7f8db81573a0 2024-08-17T02:25:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 -- 172.21.15.31:0/252582431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db81573a0 msgr2=0x7f8db8157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 --2- 172.21.15.31:0/252582431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db81573a0 0x7f8db8157800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8db806dd00 tx=0x7f8db0009840 comp rx=0 tx=0).stop 2024-08-17T02:25:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 -- 172.21.15.31:0/252582431 shutdown_connections 2024-08-17T02:25:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 --2- 172.21.15.31:0/252582431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db81573a0 0x7f8db8157800 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 --2- 172.21.15.31:0/252582431 >> v2:172.21.15.92:3300/0 conn(0x7f8db8156fd0 0x7f8db806e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 -- 172.21.15.31:0/252582431 >> 172.21.15.31:0/252582431 conn(0x7f8db806b120 msgr2=0x7f8db806b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:00.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.846+0000 7f8dbead5700 1 -- 172.21.15.31:0/252582431 shutdown_connections 2024-08-17T02:25:00.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.850+0000 7f8dbead5700 1 -- 172.21.15.31:0/252582431 wait complete. 2024-08-17T02:25:00.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.850+0000 7f8dbead5700 1 Processor -- start 2024-08-17T02:25:00.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.850+0000 7f8dbead5700 1 -- start start 2024-08-17T02:25:00.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.850+0000 7f8dbead5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db80b2250 0x7f8db81599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbead5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8db8156fd0 0x7f8db816aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbead5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8db81573a0 0x7f8db816b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbead5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db814f7e0 con 0x7f8db80b2250 2024-08-17T02:25:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbead5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db814fa80 con 0x7f8db8156fd0 2024-08-17T02:25:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbead5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db814fd60 con 0x7f8db81573a0 2024-08-17T02:25:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbc871700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db80b2250 0x7f8db81599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbc871700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db80b2250 0x7f8db81599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34576/0 (socket says 172.21.15.31:34576) 2024-08-17T02:25:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbc871700 1 -- 172.21.15.31:0/2269344254 learned_addr learned my addr 172.21.15.31:0/2269344254 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8daffff700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8db8156fd0 0x7f8db816aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbd072700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8db81573a0 0x7f8db816b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbc871700 1 -- 172.21.15.31:0/2269344254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8db81573a0 msgr2=0x7f8db816b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbc871700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8db81573a0 0x7f8db816b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbc871700 1 -- 172.21.15.31:0/2269344254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8db8156fd0 msgr2=0x7f8db816aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbc871700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8db8156fd0 0x7f8db816aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbc871700 1 -- 172.21.15.31:0/2269344254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db0009ae0 con 0x7f8db80b2250 2024-08-17T02:25:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbc871700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db80b2250 0x7f8db81599f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8db400ec80 tx=0x7f8db40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dacff9700 1 -- 172.21.15.31:0/2269344254 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400c850 con 0x7f8db80b2250 2024-08-17T02:25:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dacff9700 1 -- 172.21.15.31:0/2269344254 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db400c9b0 con 0x7f8db80b2250 2024-08-17T02:25:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbead5700 1 -- 172.21.15.31:0/2269344254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db8150040 con 0x7f8db80b2250 2024-08-17T02:25:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dacff9700 1 -- 172.21.15.31:0/2269344254 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400cd50 con 0x7f8db80b2250 2024-08-17T02:25:00.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbead5700 1 -- 172.21.15.31:0/2269344254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db8146f30 con 0x7f8db80b2250 2024-08-17T02:25:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dacff9700 1 -- 172.21.15.31:0/2269344254 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8db4013680 con 0x7f8db80b2250 2024-08-17T02:25:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dbead5700 1 -- 172.21.15.31:0/2269344254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db80712b0 con 0x7f8db80b2250 2024-08-17T02:25:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.854+0000 7f8dacff9700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8da4060860 0x7f8da4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.858+0000 7f8daffff700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8da4060860 0x7f8da4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.858+0000 7f8dacff9700 1 -- 172.21.15.31:0/2269344254 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8db407d140 con 0x7f8db80b2250 2024-08-17T02:25:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.858+0000 7f8daffff700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8da4060860 0x7f8da4062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8db80ac6b0 tx=0x7f8da8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:00.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:00.862+0000 7f8dacff9700 1 -- 172.21.15.31:0/2269344254 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8db404d590 con 0x7f8db80b2250 2024-08-17T02:25:01.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.026+0000 7f8dbead5700 1 -- 172.21.15.31:0/2269344254 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8db80aedd0 con 0x7f8db80b2250 2024-08-17T02:25:01.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.026+0000 7f8dacff9700 1 -- 172.21.15.31:0/2269344254 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8db4050bb0 con 0x7f8db80b2250 2024-08-17T02:25:01.033 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:25:01.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 -- 172.21.15.31:0/2269344254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8da4060860 msgr2=0x7f8da4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8da4060860 0x7f8da4062d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8db80ac6b0 tx=0x7f8da8009040 comp rx=0 tx=0).stop 2024-08-17T02:25:01.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 -- 172.21.15.31:0/2269344254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db80b2250 msgr2=0x7f8db81599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db80b2250 0x7f8db81599f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8db400ec80 tx=0x7f8db40091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 -- 172.21.15.31:0/2269344254 shutdown_connections 2024-08-17T02:25:01.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8da4060860 0x7f8da4062d10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8db81573a0 0x7f8db816b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8db8156fd0 0x7f8db816aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 --2- 172.21.15.31:0/2269344254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8db80b2250 0x7f8db81599f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 -- 172.21.15.31:0/2269344254 >> 172.21.15.31:0/2269344254 conn(0x7f8db806b120 msgr2=0x7f8db80cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:01.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 -- 172.21.15.31:0/2269344254 shutdown_connections 2024-08-17T02:25:01.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.030+0000 7f8dbead5700 1 -- 172.21.15.31:0/2269344254 wait complete. 2024-08-17T02:25:01.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:01.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.154+0000 7f7e6e8c3700 1 Processor -- start 2024-08-17T02:25:01.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.154+0000 7f7e6e8c3700 1 -- start start 2024-08-17T02:25:01.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6e8c3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e68156d60 0x7f7e68067b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6e8c3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7e68068850 0x7f7e680c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6e8c3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e68067400 con 0x7f7e680c8bf0 2024-08-17T02:25:01.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6e8c3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6806ea10 con 0x7f7e68156d60 2024-08-17T02:25:01.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6e8c3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6806ecf0 con 0x7f7e68068850 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6d8c1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e68156d60 0x7f7e68067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6e0c2700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7e680c8bf0 0x7f7e68157130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55586/0 (socket says 172.21.15.31:55586) 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6e0c2700 1 -- 172.21.15.31:0/2057804958 learned_addr learned my addr 172.21.15.31:0/2057804958 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:01.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6d0c0700 1 --2- 172.21.15.31:0/2057804958 >> v2:172.21.15.92:3300/0 conn(0x7f7e68068850 0x7f7e680c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6d8c1700 1 -- 172.21.15.31:0/2057804958 >> v2:172.21.15.92:3300/0 conn(0x7f7e68068850 msgr2=0x7f7e680c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6d8c1700 1 --2- 172.21.15.31:0/2057804958 >> v2:172.21.15.92:3300/0 conn(0x7f7e68068850 0x7f7e680c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6d8c1700 1 -- 172.21.15.31:0/2057804958 >> v1:172.21.15.31:6789/0 conn(0x7f7e680c8bf0 legacy=0x7f7e68157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6d8c1700 1 -- 172.21.15.31:0/2057804958 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6806efd0 con 0x7f7e68156d60 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6c8bf700 1 -- 172.21.15.31:0/2057804958 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334743529 0 0) 0x7f7e68067400 con 0x7f7e680c8bf0 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6d8c1700 1 --2- 172.21.15.31:0/2057804958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e68156d60 0x7f7e68067b70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e680af7b0 tx=0x7f7e640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3b8ebc4f427705 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6c8bf700 1 -- 172.21.15.31:0/2057804958 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64011630 con 0x7f7e68156d60 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6c8bf700 1 -- 172.21.15.31:0/2057804958 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64011790 con 0x7f7e68156d60 2024-08-17T02:25:01.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.158+0000 7f7e6c8bf700 1 -- 172.21.15.31:0/2057804958 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64011b30 con 0x7f7e68156d60 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.162+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/2057804958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e68156d60 msgr2=0x7f7e68067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.162+0000 7f7e6e8c3700 1 --2- 172.21.15.31:0/2057804958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e68156d60 0x7f7e68067b70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e680af7b0 tx=0x7f7e640091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.162+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/2057804958 shutdown_connections 2024-08-17T02:25:01.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.162+0000 7f7e6e8c3700 1 --2- 172.21.15.31:0/2057804958 >> v2:172.21.15.92:3300/0 conn(0x7f7e68068850 0x7f7e680c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.162+0000 7f7e6e8c3700 1 --2- 172.21.15.31:0/2057804958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e68156d60 0x7f7e68067b70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.162+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/2057804958 >> 172.21.15.31:0/2057804958 conn(0x7f7e6806bbb0 msgr2=0x7f7e680b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.162+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/2057804958 shutdown_connections 2024-08-17T02:25:01.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.162+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/2057804958 wait complete. 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e8c3700 1 Processor -- start 2024-08-17T02:25:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e8c3700 1 -- start start 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e8c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e68068850 0x7f7e6815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e8c3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e680c8bf0 0x7f7e68151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e8c3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e68156d60 0x7f7e680ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e8c3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6815a700 con 0x7f7e680c8bf0 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e8c3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681690e0 con 0x7f7e68068850 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e8c3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681693c0 con 0x7f7e68156d60 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6d0c0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e680c8bf0 0x7f7e68151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6d0c0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e680c8bf0 0x7f7e68151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34580/0 (socket says 172.21.15.31:34580) 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6d0c0700 1 -- 172.21.15.31:0/1606475828 learned_addr learned my addr 172.21.15.31:0/1606475828 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6d8c1700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e68068850 0x7f7e6815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e0c2700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e68156d60 0x7f7e680ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6d0c0700 1 -- 172.21.15.31:0/1606475828 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e68156d60 msgr2=0x7f7e680ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6d0c0700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e68156d60 0x7f7e680ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6d0c0700 1 -- 172.21.15.31:0/1606475828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e68068850 msgr2=0x7f7e6815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6d0c0700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e68068850 0x7f7e6815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6d0c0700 1 -- 172.21.15.31:0/1606475828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e64009420 con 0x7f7e680c8bf0 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e0c2700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e68156d60 0x7f7e680ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6d0c0700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e680c8bf0 0x7f7e68151ea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00ec50 tx=0x7f7e5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e59ffb700 1 -- 172.21.15.31:0/1606475828 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00c850 con 0x7f7e680c8bf0 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/1606475828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e681696a0 con 0x7f7e680c8bf0 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e59ffb700 1 -- 172.21.15.31:0/1606475828 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c00c9b0 con 0x7f7e680c8bf0 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e59ffb700 1 -- 172.21.15.31:0/1606475828 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00cd70 con 0x7f7e680c8bf0 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/1606475828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e68168cb0 con 0x7f7e680c8bf0 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.166+0000 7f7e59ffb700 1 -- 172.21.15.31:0/1606475828 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7e5c013680 con 0x7f7e680c8bf0 2024-08-17T02:25:01.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.170+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/1606475828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e68169b20 con 0x7f7e680c8bf0 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.170+0000 7f7e59ffb700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7e4c060860 0x7f7e4c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.170+0000 7f7e59ffb700 1 -- 172.21.15.31:0/1606475828 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e5c07cf10 con 0x7f7e680c8bf0 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.170+0000 7f7e6d8c1700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7e4c060860 0x7f7e4c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.170+0000 7f7e6d8c1700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7e4c060860 0x7f7e4c062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e640091e0 tx=0x7f7e64017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.178+0000 7f7e59ffb700 1 -- 172.21.15.31:0/1606475828 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7e5c04d2c0 con 0x7f7e680c8bf0 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.338+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/1606475828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e680712b0 con 0x7f7e680c8bf0 2024-08-17T02:25:01.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e59ffb700 1 -- 172.21.15.31:0/1606475828 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e5c0508e0 con 0x7f7e680c8bf0 2024-08-17T02:25:01.347 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/1606475828 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7e4c060860 msgr2=0x7f7e4c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7e4c060860 0x7f7e4c062d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e640091e0 tx=0x7f7e64017000 comp rx=0 tx=0).stop 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/1606475828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e680c8bf0 msgr2=0x7f7e68151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e680c8bf0 0x7f7e68151ea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00ec50 tx=0x7f7e5c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/1606475828 shutdown_connections 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7e4c060860 0x7f7e4c062d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e68156d60 0x7f7e680ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e680c8bf0 0x7f7e68151ea0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 --2- 172.21.15.31:0/1606475828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e68068850 0x7f7e6815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/1606475828 >> 172.21.15.31:0/1606475828 conn(0x7f7e6806bbb0 msgr2=0x7f7e68155630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/1606475828 shutdown_connections 2024-08-17T02:25:01.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.342+0000 7f7e6e8c3700 1 -- 172.21.15.31:0/1606475828 wait complete. 2024-08-17T02:25:01.361 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827f2bb700 1 Processor -- start 2024-08-17T02:25:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827f2bb700 1 -- start start 2024-08-17T02:25:01.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827f2bb700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f82781591e0 0x7f8278156440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827f2bb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8278068c20 0x7f82780cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827f2bb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82780cadf0 con 0x7f827806ed10 2024-08-17T02:25:01.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827f2bb700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82780cb0d0 con 0x7f82781591e0 2024-08-17T02:25:01.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827f2bb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780cb3b0 con 0x7f8278068c20 2024-08-17T02:25:01.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827dab8700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f827806ed10 0x7f8278068510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55592/0 (socket says 172.21.15.31:55592) 2024-08-17T02:25:01.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827dab8700 1 -- 172.21.15.31:0/1000560191 learned_addr learned my addr 172.21.15.31:0/1000560191 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:01.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827e2b9700 1 --2- 172.21.15.31:0/1000560191 >> v2:172.21.15.92:3300/0 conn(0x7f82781591e0 0x7f8278156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827eaba700 1 --2- 172.21.15.31:0/1000560191 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8278068c20 0x7f82780cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827d2b7700 1 -- 172.21.15.31:0/1000560191 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610766112 0 0) 0x7f82780cadf0 con 0x7f827806ed10 2024-08-17T02:25:01.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.474+0000 7f827d2b7700 1 -- 172.21.15.31:0/1000560191 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8264003570 con 0x7f827806ed10 2024-08-17T02:25:01.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827e2b9700 1 -- 172.21.15.31:0/1000560191 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8278068c20 msgr2=0x7f82780cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:01.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827e2b9700 1 --2- 172.21.15.31:0/1000560191 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8278068c20 0x7f82780cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827e2b9700 1 -- 172.21.15.31:0/1000560191 >> v1:172.21.15.31:6789/0 conn(0x7f827806ed10 legacy=0x7f8278068510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827e2b9700 1 -- 172.21.15.31:0/1000560191 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780cb690 con 0x7f82781591e0 2024-08-17T02:25:01.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827e2b9700 1 --2- 172.21.15.31:0/1000560191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82781591e0 0x7f8278156440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f82740098e0 tx=0x7f82740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fc98b85b2aa041f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827d2b7700 1 -- 172.21.15.31:0/1000560191 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274011630 con 0x7f82781591e0 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827d2b7700 1 -- 172.21.15.31:0/1000560191 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8274011790 con 0x7f82781591e0 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827d2b7700 1 -- 172.21.15.31:0/1000560191 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274011b30 con 0x7f82781591e0 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827f2bb700 1 -- 172.21.15.31:0/1000560191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82781591e0 msgr2=0x7f8278156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827f2bb700 1 --2- 172.21.15.31:0/1000560191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82781591e0 0x7f8278156440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f82740098e0 tx=0x7f82740091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827f2bb700 1 -- 172.21.15.31:0/1000560191 shutdown_connections 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827f2bb700 1 --2- 172.21.15.31:0/1000560191 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8278068c20 0x7f82780cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827f2bb700 1 --2- 172.21.15.31:0/1000560191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82781591e0 0x7f8278156440 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827f2bb700 1 -- 172.21.15.31:0/1000560191 >> 172.21.15.31:0/1000560191 conn(0x7f827806a0c0 msgr2=0x7f827806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827f2bb700 1 -- 172.21.15.31:0/1000560191 shutdown_connections 2024-08-17T02:25:01.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.478+0000 7f827f2bb700 1 -- 172.21.15.31:0/1000560191 wait complete. 2024-08-17T02:25:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827f2bb700 1 Processor -- start 2024-08-17T02:25:01.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827f2bb700 1 -- start start 2024-08-17T02:25:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827f2bb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8278068c20 0x7f82781439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827f2bb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f827806ed10 0x7f82780c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827f2bb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82781591e0 0x7f8278144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827f2bb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780c67e0 con 0x7f82781591e0 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827f2bb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780c5bd0 con 0x7f8278068c20 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827f2bb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82780c5eb0 con 0x7f827806ed10 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827eaba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82781591e0 0x7f8278144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827eaba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82781591e0 0x7f8278144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34590/0 (socket says 172.21.15.31:34590) 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827eaba700 1 -- 172.21.15.31:0/4214322959 learned_addr learned my addr 172.21.15.31:0/4214322959 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827e2b9700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8278068c20 0x7f82781439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.482+0000 7f827dab8700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f827806ed10 0x7f82780c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f827eaba700 1 -- 172.21.15.31:0/4214322959 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f827806ed10 msgr2=0x7f82780c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f827eaba700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f827806ed10 0x7f82780c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f827eaba700 1 -- 172.21.15.31:0/4214322959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8278068c20 msgr2=0x7f82781439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f827eaba700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8278068c20 0x7f82781439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f827eaba700 1 -- 172.21.15.31:0/4214322959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274009420 con 0x7f82781591e0 2024-08-17T02:25:01.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f827eaba700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82781591e0 0x7f8278144390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f827000e650 tx=0x7f827000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f826e7fc700 1 -- 172.21.15.31:0/4214322959 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270012430 con 0x7f82781591e0 2024-08-17T02:25:01.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f826e7fc700 1 -- 172.21.15.31:0/4214322959 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82700125b0 con 0x7f82781591e0 2024-08-17T02:25:01.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f827f2bb700 1 -- 172.21.15.31:0/4214322959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82780c6190 con 0x7f82781591e0 2024-08-17T02:25:01.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f826e7fc700 1 -- 172.21.15.31:0/4214322959 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270012970 con 0x7f82781591e0 2024-08-17T02:25:01.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f827f2bb700 1 -- 172.21.15.31:0/4214322959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8278154740 con 0x7f82781591e0 2024-08-17T02:25:01.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f826e7fc700 1 -- 172.21.15.31:0/4214322959 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8270012d20 con 0x7f82781591e0 2024-08-17T02:25:01.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.486+0000 7f827f2bb700 1 -- 172.21.15.31:0/4214322959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82780c6990 con 0x7f82781591e0 2024-08-17T02:25:01.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.490+0000 7f826e7fc700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f825c060860 0x7f825c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.490+0000 7f826e7fc700 1 -- 172.21.15.31:0/4214322959 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8270016070 con 0x7f82781591e0 2024-08-17T02:25:01.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.490+0000 7f827e2b9700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f825c060860 0x7f825c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.490+0000 7f827e2b9700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f825c060860 0x7f825c062d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f82740091e0 tx=0x7f8274017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.494+0000 7f826e7fc700 1 -- 172.21.15.31:0/4214322959 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f82780c6990 con 0x7f82781591e0 2024-08-17T02:25:01.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.662+0000 7f827f2bb700 1 -- 172.21.15.31:0/4214322959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82780712b0 con 0x7f82781591e0 2024-08-17T02:25:01.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.662+0000 7f826e7fc700 1 -- 172.21.15.31:0/4214322959 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8270050030 con 0x7f82781591e0 2024-08-17T02:25:01.669 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-08-17T02:25:01.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 -- 172.21.15.31:0/4214322959 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f825c060860 msgr2=0x7f825c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f825c060860 0x7f825c062d10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f82740091e0 tx=0x7f8274017000 comp rx=0 tx=0).stop 2024-08-17T02:25:01.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 -- 172.21.15.31:0/4214322959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82781591e0 msgr2=0x7f8278144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82781591e0 0x7f8278144390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f827000e650 tx=0x7f827000b040 comp rx=0 tx=0).stop 2024-08-17T02:25:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 -- 172.21.15.31:0/4214322959 shutdown_connections 2024-08-17T02:25:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f825c060860 0x7f825c062d10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82781591e0 0x7f8278144390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f827806ed10 0x7f82780c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 --2- 172.21.15.31:0/4214322959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8278068c20 0x7f82781439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 -- 172.21.15.31:0/4214322959 >> 172.21.15.31:0/4214322959 conn(0x7f827806a0c0 msgr2=0x7f82781576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 -- 172.21.15.31:0/4214322959 shutdown_connections 2024-08-17T02:25:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.666+0000 7f827f2bb700 1 -- 172.21.15.31:0/4214322959 wait complete. 2024-08-17T02:25:01.683 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:01.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e7342700 1 Processor -- start 2024-08-17T02:25:01.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e7342700 1 -- start start 2024-08-17T02:25:01.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e7342700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e0156cd0 0x7f36e01570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e7342700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f36e006e580 0x7f36e00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e7342700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e015b060 con 0x7f36e0067760 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e7342700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e0068390 con 0x7f36e006e580 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e7342700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e0067bb0 con 0x7f36e0156cd0 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e6b41700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f36e006e580 0x7f36e00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e6b41700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f36e006e580 0x7f36e00b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34596/0 (socket says 172.21.15.31:34596) 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e6b41700 1 -- 172.21.15.31:0/3783548667 learned_addr learned my addr 172.21.15.31:0/3783548667 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e6340700 1 --2- 172.21.15.31:0/3783548667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e0156cd0 0x7f36e01570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e6b41700 1 -- 172.21.15.31:0/3783548667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e0156cd0 msgr2=0x7f36e01570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e6b41700 1 --2- 172.21.15.31:0/3783548667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e0156cd0 0x7f36e01570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e6b41700 1 -- 172.21.15.31:0/3783548667 >> v1:172.21.15.92:6789/0 conn(0x7f36e0067760 legacy=0x7f36e015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e6b41700 1 -- 172.21.15.31:0/3783548667 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e015ad30 con 0x7f36e006e580 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e6b41700 1 --2- 172.21.15.31:0/3783548667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e006e580 0x7f36e00b2170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009f50 tx=0x7f36d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153eb33bb9d7daca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e533e700 1 -- 172.21.15.31:0/3783548667 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800e070 con 0x7f36e006e580 2024-08-17T02:25:01.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e533e700 1 -- 172.21.15.31:0/3783548667 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d800ba70 con 0x7f36e006e580 2024-08-17T02:25:01.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.778+0000 7f36e533e700 1 -- 172.21.15.31:0/3783548667 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d80092e0 con 0x7f36e006e580 2024-08-17T02:25:01.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.782+0000 7f36e7342700 1 -- 172.21.15.31:0/3783548667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e006e580 msgr2=0x7f36e00b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.782+0000 7f36e7342700 1 --2- 172.21.15.31:0/3783548667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e006e580 0x7f36e00b2170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f36d8009f50 tx=0x7f36d8009840 comp rx=0 tx=0).stop 2024-08-17T02:25:01.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.782+0000 7f36e7342700 1 -- 172.21.15.31:0/3783548667 shutdown_connections 2024-08-17T02:25:01.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.782+0000 7f36e7342700 1 --2- 172.21.15.31:0/3783548667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e006e580 0x7f36e00b2170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.782+0000 7f36e7342700 1 --2- 172.21.15.31:0/3783548667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e0156cd0 0x7f36e01570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.782+0000 7f36e7342700 1 -- 172.21.15.31:0/3783548667 >> 172.21.15.31:0/3783548667 conn(0x7f36e0063b20 msgr2=0x7f36e006b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:01.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.782+0000 7f36e7342700 1 -- 172.21.15.31:0/3783548667 shutdown_connections 2024-08-17T02:25:01.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.782+0000 7f36e7342700 1 -- 172.21.15.31:0/3783548667 wait complete. 2024-08-17T02:25:01.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.782+0000 7f36e7342700 1 Processor -- start 2024-08-17T02:25:01.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e7342700 1 -- start start 2024-08-17T02:25:01.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e7342700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e0067760 0x7f36e0169df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e7342700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e006e580 0x7f36e00aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e7342700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e0156cd0 0x7f36e00af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e7342700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e00a6080 con 0x7f36e0067760 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e7342700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e016a330 con 0x7f36e0156cd0 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e7342700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e00a5470 con 0x7f36e006e580 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e6340700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e0067760 0x7f36e0169df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e6340700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e0067760 0x7f36e0169df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34610/0 (socket says 172.21.15.31:34610) 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e6340700 1 -- 172.21.15.31:0/3177069626 learned_addr learned my addr 172.21.15.31:0/3177069626 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e5b3f700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e006e580 0x7f36e00aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e6b41700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e0156cd0 0x7f36e00af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e6340700 1 -- 172.21.15.31:0/3177069626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e006e580 msgr2=0x7f36e00aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e6340700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e006e580 0x7f36e00aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e6340700 1 -- 172.21.15.31:0/3177069626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e0156cd0 msgr2=0x7f36e00af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e6340700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e0156cd0 0x7f36e00af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e6340700 1 -- 172.21.15.31:0/3177069626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8009ae0 con 0x7f36e0067760 2024-08-17T02:25:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e6340700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e0067760 0x7f36e0169df0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00d8c0 tx=0x7f36dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36d67fc700 1 -- 172.21.15.31:0/3177069626 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc0125f0 con 0x7f36e0067760 2024-08-17T02:25:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36d67fc700 1 -- 172.21.15.31:0/3177069626 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc012770 con 0x7f36e0067760 2024-08-17T02:25:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36d67fc700 1 -- 172.21.15.31:0/3177069626 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc012b30 con 0x7f36e0067760 2024-08-17T02:25:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e7342700 1 -- 172.21.15.31:0/3177069626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e00a5750 con 0x7f36e0067760 2024-08-17T02:25:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.786+0000 7f36e7342700 1 -- 172.21.15.31:0/3177069626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e00a5d10 con 0x7f36e0067760 2024-08-17T02:25:01.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.790+0000 7f36e7342700 1 -- 172.21.15.31:0/3177069626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e00712b0 con 0x7f36e0067760 2024-08-17T02:25:01.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.790+0000 7f36d67fc700 1 -- 172.21.15.31:0/3177069626 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f36dc01e460 con 0x7f36e0067760 2024-08-17T02:25:01.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.790+0000 7f36d67fc700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f36c4060860 0x7f36c4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:01.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.790+0000 7f36d67fc700 1 -- 172.21.15.31:0/3177069626 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36dc07d240 con 0x7f36e0067760 2024-08-17T02:25:01.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.790+0000 7f36e5b3f700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f36c4060860 0x7f36c4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:01.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.790+0000 7f36e5b3f700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f36c4060860 0x7f36c4062d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f36e00cba80 tx=0x7f36d0007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:01.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:01.798+0000 7f36d67fc700 1 -- 172.21.15.31:0/3177069626 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f36dc051080 con 0x7f36e0067760 2024-08-17T02:25:02.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.002+0000 7f36e7342700 1 -- 172.21.15.31:0/3177069626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36e0067540 con 0x7f36e0067760 2024-08-17T02:25:02.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.002+0000 7f36d67fc700 1 -- 172.21.15.31:0/3177069626 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f36dc050c10 con 0x7f36e0067760 2024-08-17T02:25:02.008 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:02.008 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2641277078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2641277078},{"type":"v1","addr":"172.21.15.92:6835","nonce":2641277078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2478493982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2478493982},{"type":"v1","addr":"172.21.15.92:6833","nonce":2478493982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/3915393252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3915393252},{"type":"v1","addr":"172.21.15.31:6836","nonce":3915393252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:46.040941+0000","modified":"2024-08-17T02:24:48.689838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6837/2360104768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":2360104768},{"type":"v1","addr":"172.21.15.31:6837","nonce":2360104768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 -- 172.21.15.31:0/3177069626 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f36c4060860 msgr2=0x7f36c4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f36c4060860 0x7f36c4062d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f36e00cba80 tx=0x7f36d0007ec0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 -- 172.21.15.31:0/3177069626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e0067760 msgr2=0x7f36e0169df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e0067760 0x7f36e0169df0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00d8c0 tx=0x7f36dc008040 comp rx=0 tx=0).stop 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 -- 172.21.15.31:0/3177069626 shutdown_connections 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f36c4060860 0x7f36c4062d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e0156cd0 0x7f36e00af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e006e580 0x7f36e00aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 --2- 172.21.15.31:0/3177069626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36e0067760 0x7f36e0169df0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 -- 172.21.15.31:0/3177069626 >> 172.21.15.31:0/3177069626 conn(0x7f36e0063b20 msgr2=0x7f36e006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 -- 172.21.15.31:0/3177069626 shutdown_connections 2024-08-17T02:25:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.006+0000 7f36e7342700 1 -- 172.21.15.31:0/3177069626 wait complete. 2024-08-17T02:25:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-08-17T02:25:02.023 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb89703700 1 Processor -- start 2024-08-17T02:25:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb89703700 1 -- start start 2024-08-17T02:25:02.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb89703700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7feb840cc0f0 0x7feb8415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb89703700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8415d4f0 0x7feb840aa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb89703700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8415b480 con 0x7feb840aa880 2024-08-17T02:25:02.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb89703700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb840cc4c0 con 0x7feb840cc0f0 2024-08-17T02:25:02.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb89703700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8415d920 con 0x7feb8415d4f0 2024-08-17T02:25:02.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb88f02700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feb840aa880 0x7feb841599c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55594/0 (socket says 172.21.15.31:55594) 2024-08-17T02:25:02.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb88f02700 1 -- 172.21.15.31:0/3135503079 learned_addr learned my addr 172.21.15.31:0/3135503079 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:02.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb837fe700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8415d4f0 0x7feb840aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb83fff700 1 --2- 172.21.15.31:0/3135503079 >> v2:172.21.15.92:3300/0 conn(0x7feb840cc0f0 0x7feb8415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551609173 0 0) 0x7feb8415b480 con 0x7feb840aa880 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb70003570 con 0x7feb840aa880 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3879672705 0 0) 0x7feb70003570 con 0x7feb840aa880 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8415d4f0 msgr2=0x7feb840aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8415d4f0 0x7feb840aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 >> v2:172.21.15.92:3300/0 conn(0x7feb840cc0f0 msgr2=0x7feb8415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 --2- 172.21.15.31:0/3135503079 >> v2:172.21.15.92:3300/0 conn(0x7feb840cc0f0 0x7feb8415cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840ab0e0 con 0x7feb840aa880 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7feb7c0017f0 con 0x7feb840aa880 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 >> v1:172.21.15.31:6789/0 conn(0x7feb840aa880 legacy=0x7feb841599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 0x7feb70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb70004810 0x7feb70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8415d4f0 0x7feb700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8415d920 con 0x7feb70003a60 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7000ba60 con 0x7feb70004810 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7000bba0 con 0x7feb8415d4f0 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb83fff700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 0x7feb70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb837fe700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb70004810 0x7feb70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb88f02700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8415d4f0 0x7feb700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb83fff700 1 -- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8415d4f0 msgr2=0x7feb700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb83fff700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8415d4f0 0x7feb700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb83fff700 1 -- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb70004810 msgr2=0x7feb70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb83fff700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb70004810 0x7feb70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb83fff700 1 -- 172.21.15.31:0/3135503079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70003570 con 0x7feb70003a60 2024-08-17T02:25:02.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb837fe700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb70004810 0x7feb70004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:02.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.126+0000 7feb88f02700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8415d4f0 0x7feb700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:02.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb83fff700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 0x7feb70003e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009c30 tx=0x7feb6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20aa47e6944127a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00e710 con 0x7feb70003a60 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c00e870 con 0x7feb70003a60 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb82ffd700 1 -- 172.21.15.31:0/3135503079 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00ec30 con 0x7feb70003a60 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 -- 172.21.15.31:0/3135503079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 msgr2=0x7feb70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 --2- 172.21.15.31:0/3135503079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 0x7feb70003e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009c30 tx=0x7feb6c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb88f02700 1 -- 172.21.15.31:0/3135503079 reap_dead start 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 -- 172.21.15.31:0/3135503079 shutdown_connections 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 -- 172.21.15.31:0/3135503079 >> 172.21.15.31:0/3135503079 conn(0x7feb8406a450 msgr2=0x7feb84067400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 -- 172.21.15.31:0/3135503079 shutdown_connections 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 -- 172.21.15.31:0/3135503079 wait complete. 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 Processor -- start 2024-08-17T02:25:02.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 -- start start 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 0x7feb8406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8406e700 0x7feb8414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8414bbe0 0x7feb8416cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8416db60 con 0x7feb70003a60 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b00e0 con 0x7feb8406e700 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.130+0000 7feb89703700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8414c030 con 0x7feb8414bbe0 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb83fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 0x7feb8406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb83fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 0x7feb8406e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34628/0 (socket says 172.21.15.31:34628) 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb83fff700 1 -- 172.21.15.31:0/2066043494 learned_addr learned my addr 172.21.15.31:0/2066043494 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb837fe700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8406e700 0x7feb8414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb88f02700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8414bbe0 0x7feb8416cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb83fff700 1 -- 172.21.15.31:0/2066043494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8414bbe0 msgr2=0x7feb8416cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb83fff700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8414bbe0 0x7feb8416cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb83fff700 1 -- 172.21.15.31:0/2066043494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8406e700 msgr2=0x7feb8414b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb83fff700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8406e700 0x7feb8414b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb83fff700 1 -- 172.21.15.31:0/2066043494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840af7b0 con 0x7feb70003a60 2024-08-17T02:25:02.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb837fe700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8406e700 0x7feb8414b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:02.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb83fff700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 0x7feb8406e1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00e4b0 tx=0x7feb6c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb7bfff700 1 -- 172.21.15.31:0/2066043494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c023070 con 0x7feb70003a60 2024-08-17T02:25:02.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb7bfff700 1 -- 172.21.15.31:0/2066043494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c00ec10 con 0x7feb70003a60 2024-08-17T02:25:02.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb89703700 1 -- 172.21.15.31:0/2066043494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb840afa90 con 0x7feb70003a60 2024-08-17T02:25:02.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb7bfff700 1 -- 172.21.15.31:0/2066043494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00e710 con 0x7feb70003a60 2024-08-17T02:25:02.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb89703700 1 -- 172.21.15.31:0/2066043494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb840b0570 con 0x7feb70003a60 2024-08-17T02:25:02.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.134+0000 7feb89703700 1 -- 172.21.15.31:0/2066043494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb680052b0 con 0x7feb70003a60 2024-08-17T02:25:02.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.138+0000 7feb7bfff700 1 -- 172.21.15.31:0/2066043494 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7feb6c013680 con 0x7feb70003a60 2024-08-17T02:25:02.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.138+0000 7feb7bfff700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7feb64060860 0x7feb64062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.138+0000 7feb7bfff700 1 -- 172.21.15.31:0/2066043494 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb6c07e250 con 0x7feb70003a60 2024-08-17T02:25:02.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.138+0000 7feb837fe700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7feb64060860 0x7feb64062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.138+0000 7feb837fe700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7feb64060860 0x7feb64062d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feb840b17a0 tx=0x7feb740091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.142+0000 7feb7bfff700 1 -- 172.21.15.31:0/2066043494 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7feb6c052150 con 0x7feb70003a60 2024-08-17T02:25:02.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.310+0000 7feb89703700 1 -- 172.21.15.31:0/2066043494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb68005560 con 0x7feb70003a60 2024-08-17T02:25:02.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.310+0000 7feb7bfff700 1 -- 172.21.15.31:0/2066043494 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7feb6c051ce0 con 0x7feb70003a60 2024-08-17T02:25:02.318 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:02.318 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:02.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 -- 172.21.15.31:0/2066043494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7feb64060860 msgr2=0x7feb64062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7feb64060860 0x7feb64062d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feb840b17a0 tx=0x7feb740091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 -- 172.21.15.31:0/2066043494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 msgr2=0x7feb8406e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 0x7feb8406e1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00e4b0 tx=0x7feb6c01a000 comp rx=0 tx=0).stop 2024-08-17T02:25:02.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 -- 172.21.15.31:0/2066043494 shutdown_connections 2024-08-17T02:25:02.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7feb64060860 0x7feb64062d10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb8414bbe0 0x7feb8416cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8406e700 0x7feb8414b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 --2- 172.21.15.31:0/2066043494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb70003a60 0x7feb8406e1c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 -- 172.21.15.31:0/2066043494 >> 172.21.15.31:0/2066043494 conn(0x7feb8406a450 msgr2=0x7feb841598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:02.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.314+0000 7feb89703700 1 -- 172.21.15.31:0/2066043494 shutdown_connections 2024-08-17T02:25:02.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.318+0000 7feb89703700 1 -- 172.21.15.31:0/2066043494 wait complete. 2024-08-17T02:25:02.337 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.434+0000 7fcedf59e700 1 Processor -- start 2024-08-17T02:25:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.434+0000 7fcedf59e700 1 -- start start 2024-08-17T02:25:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcee0155fe0 0x7fcee0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcee01563b0 0x7fcee0068f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee00cbb30 con 0x7fcee00adb00 2024-08-17T02:25:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee015ad30 con 0x7fcee0155fe0 2024-08-17T02:25:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee015a490 con 0x7fcee01563b0 2024-08-17T02:25:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcede59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcee0155fe0 0x7fcee0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fceded9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcee00adb00 0x7fcee00aca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55604/0 (socket says 172.21.15.31:55604) 2024-08-17T02:25:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fceded9d700 1 -- 172.21.15.31:0/2441840679 learned_addr learned my addr 172.21.15.31:0/2441840679 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:02.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fceddd9b700 1 --2- 172.21.15.31:0/2441840679 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcee01563b0 0x7fcee0068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcede59c700 1 -- 172.21.15.31:0/2441840679 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcee01563b0 msgr2=0x7fcee0068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedd59a700 1 -- 172.21.15.31:0/2441840679 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040997597 0 0) 0x7fcee00cbb30 con 0x7fcee00adb00 2024-08-17T02:25:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcede59c700 1 --2- 172.21.15.31:0/2441840679 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcee01563b0 0x7fcee0068f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcede59c700 1 -- 172.21.15.31:0/2441840679 >> v1:172.21.15.31:6789/0 conn(0x7fcee00adb00 legacy=0x7fcee00aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcede59c700 1 -- 172.21.15.31:0/2441840679 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee015a770 con 0x7fcee0155fe0 2024-08-17T02:25:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcede59c700 1 --2- 172.21.15.31:0/2441840679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 0x7fcee0159d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fced00098e0 tx=0x7fced00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6314c23c475ecc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedd59a700 1 -- 172.21.15.31:0/2441840679 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000b640 con 0x7fcee0155fe0 2024-08-17T02:25:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedd59a700 1 -- 172.21.15.31:0/2441840679 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced000b7a0 con 0x7fcee0155fe0 2024-08-17T02:25:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedd59a700 1 -- 172.21.15.31:0/2441840679 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000bb40 con 0x7fcee0155fe0 2024-08-17T02:25:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 -- 172.21.15.31:0/2441840679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 msgr2=0x7fcee0159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 --2- 172.21.15.31:0/2441840679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 0x7fcee0159d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fced00098e0 tx=0x7fced00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 -- 172.21.15.31:0/2441840679 shutdown_connections 2024-08-17T02:25:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 --2- 172.21.15.31:0/2441840679 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcee01563b0 0x7fcee0068f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 --2- 172.21.15.31:0/2441840679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 0x7fcee0159d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 -- 172.21.15.31:0/2441840679 >> 172.21.15.31:0/2441840679 conn(0x7fcee0067400 msgr2=0x7fcee0067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 -- 172.21.15.31:0/2441840679 shutdown_connections 2024-08-17T02:25:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.438+0000 7fcedf59e700 1 -- 172.21.15.31:0/2441840679 wait complete. 2024-08-17T02:25:02.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcedf59e700 1 Processor -- start 2024-08-17T02:25:02.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcedf59e700 1 -- start start 2024-08-17T02:25:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcedf59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee00adb00 0x7fcee01653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcedf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 0x7fcee00ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcedf59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcee01563b0 0x7fcee014da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcedf59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee0152420 con 0x7fcee0155fe0 2024-08-17T02:25:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcedf59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee0168ec0 con 0x7fcee00adb00 2024-08-17T02:25:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcedf59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01691a0 con 0x7fcee01563b0 2024-08-17T02:25:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fceddd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 0x7fcee00ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fceddd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 0x7fcee00ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34638/0 (socket says 172.21.15.31:34638) 2024-08-17T02:25:02.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fceddd9b700 1 -- 172.21.15.31:0/1488367581 learned_addr learned my addr 172.21.15.31:0/1488367581 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:02.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcede59c700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee00adb00 0x7fcee01653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fceded9d700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcee01563b0 0x7fcee014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fceddd9b700 1 -- 172.21.15.31:0/1488367581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcee01563b0 msgr2=0x7fcee014da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fceddd9b700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcee01563b0 0x7fcee014da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fceddd9b700 1 -- 172.21.15.31:0/1488367581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee00adb00 msgr2=0x7fcee01653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fceddd9b700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee00adb00 0x7fcee01653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fceddd9b700 1 -- 172.21.15.31:0/1488367581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0009420 con 0x7fcee0155fe0 2024-08-17T02:25:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fceddd9b700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 0x7fcee00ca370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009eb0 tx=0x7fcec800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fced67fc700 1 -- 172.21.15.31:0/1488367581 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec800cb70 con 0x7fcee0155fe0 2024-08-17T02:25:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcedf59e700 1 -- 172.21.15.31:0/1488367581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee0169480 con 0x7fcee0155fe0 2024-08-17T02:25:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fced67fc700 1 -- 172.21.15.31:0/1488367581 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec800f040 con 0x7fcee0155fe0 2024-08-17T02:25:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fced67fc700 1 -- 172.21.15.31:0/1488367581 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8014480 con 0x7fcee0155fe0 2024-08-17T02:25:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.442+0000 7fcedf59e700 1 -- 172.21.15.31:0/1488367581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee0165910 con 0x7fcee0155fe0 2024-08-17T02:25:02.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.446+0000 7fcedf59e700 1 -- 172.21.15.31:0/1488367581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee0152590 con 0x7fcee0155fe0 2024-08-17T02:25:02.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.446+0000 7fced67fc700 1 -- 172.21.15.31:0/1488367581 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcec80147f0 con 0x7fcee0155fe0 2024-08-17T02:25:02.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.446+0000 7fced67fc700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcec0060860 0x7fcec0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.446+0000 7fced67fc700 1 -- 172.21.15.31:0/1488367581 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcec807d7c0 con 0x7fcee0155fe0 2024-08-17T02:25:02.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.446+0000 7fcede59c700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcec0060860 0x7fcec0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.446+0000 7fcede59c700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcec0060860 0x7fcec0062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fced00093f0 tx=0x7fced0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.458+0000 7fced67fc700 1 -- 172.21.15.31:0/1488367581 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcec804dc10 con 0x7fcee0155fe0 2024-08-17T02:25:02.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.658+0000 7fcedf59e700 1 -- 172.21.15.31:0/1488367581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcee00712b0 con 0x7fcee0155fe0 2024-08-17T02:25:02.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fced67fc700 1 -- 172.21.15.31:0/1488367581 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fcec8051230 con 0x7fcee0155fe0 2024-08-17T02:25:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:02.667 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2641277078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2641277078},{"type":"v1","addr":"172.21.15.92:6835","nonce":2641277078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2478493982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2478493982},{"type":"v1","addr":"172.21.15.92:6833","nonce":2478493982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/3915393252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3915393252},{"type":"v1","addr":"172.21.15.31:6836","nonce":3915393252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:46.040941+0000","modified":"2024-08-17T02:24:48.689838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6837/2360104768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":2360104768},{"type":"v1","addr":"172.21.15.31:6837","nonce":2360104768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:02.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 -- 172.21.15.31:0/1488367581 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcec0060860 msgr2=0x7fcec0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcec0060860 0x7fcec0062d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fced00093f0 tx=0x7fced0017000 comp rx=0 tx=0).stop 2024-08-17T02:25:02.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 -- 172.21.15.31:0/1488367581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 msgr2=0x7fcee00ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 0x7fcee00ca370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcec8009eb0 tx=0x7fcec800b040 comp rx=0 tx=0).stop 2024-08-17T02:25:02.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 -- 172.21.15.31:0/1488367581 shutdown_connections 2024-08-17T02:25:02.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcec0060860 0x7fcec0062d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcee01563b0 0x7fcee014da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee0155fe0 0x7fcee00ca370 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 --2- 172.21.15.31:0/1488367581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcee00adb00 0x7fcee01653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 -- 172.21.15.31:0/1488367581 >> 172.21.15.31:0/1488367581 conn(0x7fcee0067400 msgr2=0x7fcee00677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 -- 172.21.15.31:0/1488367581 shutdown_connections 2024-08-17T02:25:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:02.662+0000 7fcedf59e700 1 -- 172.21.15.31:0/1488367581 wait complete. 2024-08-17T02:25:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-08-17T02:25:03.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:24:46.040941+0000', 'modified': '2024-08-17T02:24:48.689838+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6837/2360104768', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6835', 'nonce': 2360104768}, {'type': 'v1', 'addr': '172.21.15.31:6837', 'nonce': 2360104768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:25:03.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:25:03.084 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-17T02:25:03.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.198+0000 7fe7d874f700 1 Processor -- start 2024-08-17T02:25:03.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.198+0000 7fe7d874f700 1 -- start start 2024-08-17T02:25:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7d0159120 0x7fe7d00aa770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 0x7fe7d00acf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d00abee0 con 0x7fe7d00ad4c0 2024-08-17T02:25:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d00ac1c0 con 0x7fe7d0159120 2024-08-17T02:25:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d00ac4a0 con 0x7fe7d00ab9e0 2024-08-17T02:25:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d64eb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7d0159120 0x7fe7d00aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d5cea700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 0x7fe7d00acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d64eb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe7d0159120 0x7fe7d00aa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34644/0 (socket says 172.21.15.31:34644) 2024-08-17T02:25:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d64eb700 1 -- 172.21.15.31:0/3274048533 learned_addr learned my addr 172.21.15.31:0/3274048533 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d6cec700 1 --1- 172.21.15.31:0/3274048533 >> v1:172.21.15.92:6789/0 conn(0x7fe7d00ad4c0 0x7fe7d006a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:59028/0 (socket says 172.21.15.31:59028) 2024-08-17T02:25:03.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d5cea700 1 -- 172.21.15.31:0/3274048533 >> v2:172.21.15.31:3300/0 conn(0x7fe7d0159120 msgr2=0x7fe7d00aa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:03.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d54e9700 1 -- 172.21.15.31:0/3274048533 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725760159 0 0) 0x7fe7d00abee0 con 0x7fe7d00ad4c0 2024-08-17T02:25:03.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/3274048533 >> v2:172.21.15.31:3300/0 conn(0x7fe7d0159120 0x7fe7d00aa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d5cea700 1 -- 172.21.15.31:0/3274048533 >> v1:172.21.15.92:6789/0 conn(0x7fe7d00ad4c0 legacy=0x7fe7d006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d5cea700 1 -- 172.21.15.31:0/3274048533 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d00ac780 con 0x7fe7d00ab9e0 2024-08-17T02:25:03.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/3274048533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 0x7fe7d00acf80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009e60 tx=0x7fe7c4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2228e4444ca16dfe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d54e9700 1 -- 172.21.15.31:0/3274048533 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400e070 con 0x7fe7d00ab9e0 2024-08-17T02:25:03.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d54e9700 1 -- 172.21.15.31:0/3274048533 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c400bb60 con 0x7fe7d00ab9e0 2024-08-17T02:25:03.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d54e9700 1 -- 172.21.15.31:0/3274048533 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4012430 con 0x7fe7d00ab9e0 2024-08-17T02:25:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 -- 172.21.15.31:0/3274048533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 msgr2=0x7fe7d00acf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 --2- 172.21.15.31:0/3274048533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 0x7fe7d00acf80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009e60 tx=0x7fe7c4009780 comp rx=0 tx=0).stop 2024-08-17T02:25:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 -- 172.21.15.31:0/3274048533 shutdown_connections 2024-08-17T02:25:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 --2- 172.21.15.31:0/3274048533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 0x7fe7d00acf80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 --2- 172.21.15.31:0/3274048533 >> v2:172.21.15.31:3300/0 conn(0x7fe7d0159120 0x7fe7d00aa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 -- 172.21.15.31:0/3274048533 >> 172.21.15.31:0/3274048533 conn(0x7fe7d00cbe50 msgr2=0x7fe7d00cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 -- 172.21.15.31:0/3274048533 shutdown_connections 2024-08-17T02:25:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.202+0000 7fe7d874f700 1 -- 172.21.15.31:0/3274048533 wait complete. 2024-08-17T02:25:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d874f700 1 Processor -- start 2024-08-17T02:25:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d874f700 1 -- start start 2024-08-17T02:25:03.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d874f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 0x7fe7d0151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d874f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7d00ad4c0 0x7fe7d0150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d874f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7d0159120 0x7fe7d015b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d874f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d015ade0 con 0x7fe7d0159120 2024-08-17T02:25:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d874f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d015a530 con 0x7fe7d00ad4c0 2024-08-17T02:25:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d874f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d006f430 con 0x7fe7d00ab9e0 2024-08-17T02:25:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d6cec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7d0159120 0x7fe7d015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d6cec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7d0159120 0x7fe7d015b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34646/0 (socket says 172.21.15.31:34646) 2024-08-17T02:25:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d6cec700 1 -- 172.21.15.31:0/2942919384 learned_addr learned my addr 172.21.15.31:0/2942919384 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d64eb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 0x7fe7d0151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7d00ad4c0 0x7fe7d0150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d6cec700 1 -- 172.21.15.31:0/2942919384 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 msgr2=0x7fe7d0151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 0x7fe7d0151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d6cec700 1 -- 172.21.15.31:0/2942919384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7d00ad4c0 msgr2=0x7fe7d0150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7d00ad4c0 0x7fe7d0150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d6cec700 1 -- 172.21.15.31:0/2942919384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c4009a20 con 0x7fe7d0159120 2024-08-17T02:25:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.206+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7d00ad4c0 0x7fe7d0150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.210+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7d0159120 0x7fe7d015b270 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00011e0 tx=0x7fe7c0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.210+0000 7fe7ce7fc700 1 -- 172.21.15.31:0/2942919384 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0005a70 con 0x7fe7d0159120 2024-08-17T02:25:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.210+0000 7fe7ce7fc700 1 -- 172.21.15.31:0/2942919384 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c0005bd0 con 0x7fe7d0159120 2024-08-17T02:25:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.210+0000 7fe7d874f700 1 -- 172.21.15.31:0/2942919384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d015a790 con 0x7fe7d0159120 2024-08-17T02:25:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.210+0000 7fe7ce7fc700 1 -- 172.21.15.31:0/2942919384 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00070d0 con 0x7fe7d0159120 2024-08-17T02:25:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.210+0000 7fe7d874f700 1 -- 172.21.15.31:0/2942919384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d0151090 con 0x7fe7d0159120 2024-08-17T02:25:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.210+0000 7fe7ce7fc700 1 -- 172.21.15.31:0/2942919384 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe7c00074c0 con 0x7fe7d0159120 2024-08-17T02:25:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.210+0000 7fe7ce7fc700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe7bc060860 0x7fe7bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.210+0000 7fe7ce7fc700 1 -- 172.21.15.31:0/2942919384 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7c007c090 con 0x7fe7d0159120 2024-08-17T02:25:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.210+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe7bc060860 0x7fe7bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.214+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe7bc060860 0x7fe7bc062d10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8006fd0 tx=0x7fe7c8009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.214+0000 7fe7da9fe740 1 Processor -- start 2024-08-17T02:25:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.214+0000 7fe7da9fe740 1 -- start start 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 0x28b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682710 0x28b6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x26cd790 0x28b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x282eba0 con 0x2682710 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x282ab40 con 0x26cd790 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x27f00a0 con 0x2682ae0 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d5cea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682710 0x28b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d5cea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682710 0x28b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34650/0 (socket says 172.21.15.31:34650) 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d5cea700 1 -- 172.21.15.31:0/3812474854 learned_addr learned my addr 172.21.15.31:0/3812474854 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/3812474854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x26cd790 0x28b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/3812474854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 0x28b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d5cea700 1 -- 172.21.15.31:0/3812474854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 msgr2=0x28b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/3812474854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 0x28b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d5cea700 1 -- 172.21.15.31:0/3812474854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x26cd790 msgr2=0x28b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/3812474854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x26cd790 0x28b9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d5cea700 1 -- 172.21.15.31:0/3812474854 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x26ce9e0 con 0x2682710 2024-08-17T02:25:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/3812474854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 0x28b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/3812474854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682710 0x28b6710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4013000 tx=0x7fe7c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6dde1d6e6f14c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7b77fe700 1 -- 172.21.15.31:0/3812474854 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400bcd0 con 0x2682710 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7b77fe700 1 -- 172.21.15.31:0/3812474854 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c400be30 con 0x2682710 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7b77fe700 1 -- 172.21.15.31:0/3812474854 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40129b0 con 0x2682710 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 -- 172.21.15.31:0/3812474854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682710 msgr2=0x28b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/3812474854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682710 0x28b6710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4013000 tx=0x7fe7c4019000 comp rx=0 tx=0).stop 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 -- 172.21.15.31:0/3812474854 shutdown_connections 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/3812474854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x26cd790 0x28b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/3812474854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682710 0x28b6710 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/3812474854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 0x28b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 -- 172.21.15.31:0/3812474854 >> 172.21.15.31:0/3812474854 conn(0x2682eb0 msgr2=0x28bc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 -- 172.21.15.31:0/3812474854 shutdown_connections 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.218+0000 7fe7da9fe740 1 -- 172.21.15.31:0/3812474854 wait complete. 2024-08-17T02:25:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7da9fe740 1 -- start start 2024-08-17T02:25:03.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7da9fe740 1 Processor -- start 2024-08-17T02:25:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 0x2903aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682ae0 0x2903fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x26cd790 0x28bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x27efd40 con 0x2682ae0 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x27c8970 con 0x2682710 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x282a350 con 0x26cd790 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7da9fe740 10 client.0 _ll_register_callbacks cb 0x27ccf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d5cea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682ae0 0x2903fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d5cea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682ae0 0x2903fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34654/0 (socket says 172.21.15.31:34654) 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d5cea700 1 -- 172.21.15.31:0/751336665 learned_addr learned my addr 172.21.15.31:0/751336665 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x26cd790 0x28bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 0x2903aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d5cea700 1 -- 172.21.15.31:0/751336665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x26cd790 msgr2=0x28bdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:03.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x26cd790 0x28bdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d5cea700 1 -- 172.21.15.31:0/751336665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 msgr2=0x2903aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:03.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 0x2903aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d5cea700 1 -- 172.21.15.31:0/751336665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d00ac780 con 0x2682ae0 2024-08-17T02:25:03.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682ae0 0x2903fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400bdd0 tx=0x7fe7c4020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3e344ceac1f59c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.222+0000 7fe7b4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-08-17T02:25:03.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/751336665 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4026640 con 0x2682ae0 2024-08-17T02:25:03.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/751336665 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7c4033b10 con 0x2682ae0 2024-08-17T02:25:03.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 -- 172.21.15.31:0/751336665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2690260 con 0x2682ae0 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/751336665 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7c40267a0 con 0x2682ae0 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 10 client.4722 fetch_fsmap learned FSMap version 6 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 -- 172.21.15.31:0/751336665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x27f8370 con 0x2682ae0 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/751336665 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2690260 con 0x2682ae0 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/751336665 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe7c4026900 con 0x2682ae0 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 10 client.4722 fetch_fsmap finished waiting for FSMap version 6 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 10 client.4722 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 20 client.4722 populate_metadata read hostname 'smithi031' 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.31:6835/2360104768,v1:172.21.15.31:6837/2360104768] conn(0x290cc30 0x290f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 4 client.4722 mds_command: new command op to 4293 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 -- 172.21.15.31:0/751336665 --> [v2:172.21.15.31:6835/2360104768,v1:172.21.15.31:6837/2360104768] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x26da4e0 con 0x290cc30 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.31:6835/2360104768,v1:172.21.15.31:6837/2360104768] conn(0x290cc30 0x290f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7b4ff9700 10 client.4722 ms_handle_connect on v2:172.21.15.31:6835/2360104768 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.31:6835/2360104768,v1:172.21.15.31:6837/2360104768] conn(0x290cc30 0x290f010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0f3c947c67a7774 server_cookie=95b3ffa861dd854f in_seq=0 out_seq=0 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/751336665 <== mds.0 v2:172.21.15.31:6835/2360104768 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x26da4e0 con 0x290cc30 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7b4ff9700 10 client.4722 handle_command_reply: tid=0 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 client.4722 shutdown 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 -- 172.21.15.31:0/751336665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682ae0 msgr2=0x2903fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682ae0 0x2903fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400bdd0 tx=0x7fe7c4020040 comp rx=0 tx=0).stop 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 -- 172.21.15.31:0/751336665 shutdown_connections 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.31:6835/2360104768,v1:172.21.15.31:6837/2360104768] conn(0x290cc30 0x290f010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x26cd790 0x28bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x2682ae0 0x2903fe0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/751336665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 0x2903aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7b4ff9700 0 client.4722 ms_handle_reset on v2:172.21.15.31:6835/2360104768 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 -- 172.21.15.31:0/751336665 >> 172.21.15.31:0/751336665 conn(0x2682eb0 msgr2=0x28bbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:03.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 -- 172.21.15.31:0/751336665 shutdown_connections 2024-08-17T02:25:03.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 1 -- 172.21.15.31:0/751336665 wait complete. 2024-08-17T02:25:03.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.226+0000 7fe7da9fe740 20 client.4722 trim_cache size 0 max 16384 2024-08-17T02:25:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7da9fe740 1 Processor -- start 2024-08-17T02:25:03.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7da9fe740 1 -- start start 2024-08-17T02:25:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682710 0x2957b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682ae0 0x2958070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x29585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x2860bb0 con 0x26cd790 2024-08-17T02:25:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x26fb7c0 con 0x2682ae0 2024-08-17T02:25:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x27d9140 con 0x2682710 2024-08-17T02:25:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7d6cec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x29585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7d6cec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x29585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34660/0 (socket says 172.21.15.31:34660) 2024-08-17T02:25:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7d6cec700 1 -- 172.21.15.31:0/645608355 learned_addr learned my addr 172.21.15.31:0/645608355 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/645608355 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682710 0x2957b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.250+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/645608355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682ae0 0x2958070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7d6cec700 1 -- 172.21.15.31:0/645608355 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682710 msgr2=0x2957b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/645608355 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682710 0x2957b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7d6cec700 1 -- 172.21.15.31:0/645608355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682ae0 msgr2=0x2958070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/645608355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682ae0 0x2958070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7d6cec700 1 -- 172.21.15.31:0/645608355 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d006e150 con 0x26cd790 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/645608355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x29585b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0050130 tx=0x7fe7c001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702dfcf075bbea55 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7b7fff700 1 -- 172.21.15.31:0/645608355 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00508e0 con 0x26cd790 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7b7fff700 1 -- 172.21.15.31:0/645608355 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c0053430 con 0x26cd790 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7b7fff700 1 -- 172.21.15.31:0/645608355 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0057180 con 0x26cd790 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 -- 172.21.15.31:0/645608355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 msgr2=0x29585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/645608355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x29585b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0050130 tx=0x7fe7c001e040 comp rx=0 tx=0).stop 2024-08-17T02:25:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 -- 172.21.15.31:0/645608355 shutdown_connections 2024-08-17T02:25:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/645608355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x29585b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/645608355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682ae0 0x2958070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/645608355 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682710 0x2957b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 -- 172.21.15.31:0/645608355 >> 172.21.15.31:0/645608355 conn(0x2682eb0 msgr2=0x28bc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 -- 172.21.15.31:0/645608355 shutdown_connections 2024-08-17T02:25:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 -- 172.21.15.31:0/645608355 wait complete. 2024-08-17T02:25:03.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 -- start start 2024-08-17T02:25:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.254+0000 7fe7da9fe740 1 Processor -- start 2024-08-17T02:25:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 0x293b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 0x290d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x290d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x282e640 con 0x26cd790 2024-08-17T02:25:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x2802570 con 0x2682710 2024-08-17T02:25:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x2825080 con 0x2682ae0 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 10 client.0 _ll_register_callbacks cb 0x264e9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d6cec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x290d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d6cec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x290d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34662/0 (socket says 172.21.15.31:34662) 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d6cec700 1 -- 172.21.15.31:0/2759137904 learned_addr learned my addr 172.21.15.31:0/2759137904 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 0x293b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d5cea700 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 0x290d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d6cec700 1 -- 172.21.15.31:0/2759137904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 msgr2=0x290d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 0x290d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d6cec700 1 -- 172.21.15.31:0/2759137904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 msgr2=0x293b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 0x293b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d6cec700 1 -- 172.21.15.31:0/2759137904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d0151090 con 0x26cd790 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 0x293b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d6cec700 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x290d540 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe7c007c060 tx=0x7fe7c0067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0c2513307d1a3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7b4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-08-17T02:25:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/2759137904 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0057200 con 0x26cd790 2024-08-17T02:25:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/2759137904 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7c0050440 con 0x26cd790 2024-08-17T02:25:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 1 -- 172.21.15.31:0/2759137904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7c400be30 con 0x26cd790 2024-08-17T02:25:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/2759137904 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7c007a100 con 0x26cd790 2024-08-17T02:25:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 10 client.4728 fetch_fsmap learned FSMap version 6 2024-08-17T02:25:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 1 -- 172.21.15.31:0/2759137904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x27ded80 con 0x26cd790 2024-08-17T02:25:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/2759137904 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c006e020 con 0x26cd790 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/2759137904 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe7c004f690 con 0x26cd790 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 10 client.4728 fetch_fsmap finished waiting for FSMap version 6 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 10 client.4728 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 20 client.4728 populate_metadata read hostname 'smithi031' 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.31:6835/2360104768,v1:172.21.15.31:6837/2360104768] conn(0x290da80 0x295b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 4 client.4728 mds_command: new command op to 4293 tid=0[{"prefix": "status"}] 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7da9fe740 1 -- 172.21.15.31:0/2759137904 --> [v2:172.21.15.31:6835/2360104768,v1:172.21.15.31:6837/2360104768] -- command(tid 0: {"prefix": "status"}) v1 -- 0x26ff260 con 0x290da80 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.258+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.31:6835/2360104768,v1:172.21.15.31:6837/2360104768] conn(0x290da80 0x295b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7b4ff9700 10 client.4728 ms_handle_connect on v2:172.21.15.31:6835/2360104768 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d64eb700 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.31:6835/2360104768,v1:172.21.15.31:6837/2360104768] conn(0x290da80 0x295b540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4e280853141446b server_cookie=a6d1a0c57de3976 in_seq=0 out_seq=0 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7b4ff9700 1 -- 172.21.15.31:0/2759137904 <== mds.0 v2:172.21.15.31:6835/2360104768 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x26ff260 con 0x290da80 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7b4ff9700 10 client.4728 handle_command_reply: tid=0 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 client.4728 shutdown 2024-08-17T02:25:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 -- 172.21.15.31:0/2759137904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 msgr2=0x290d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x290d540 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe7c007c060 tx=0x7fe7c0067000 comp rx=0 tx=0).stop 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 -- 172.21.15.31:0/2759137904 shutdown_connections 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.31:6835/2360104768,v1:172.21.15.31:6837/2360104768] conn(0x290da80 0x295b540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x26cd790 0x290d540 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x2682ae0 0x290d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7b4ff9700 0 client.4728 ms_handle_reset on v2:172.21.15.31:6835/2360104768 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 --2- 172.21.15.31:0/2759137904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x2682710 0x293b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 -- 172.21.15.31:0/2759137904 >> 172.21.15.31:0/2759137904 conn(0x2682eb0 msgr2=0x2902570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 -- 172.21.15.31:0/2759137904 shutdown_connections 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 1 -- 172.21.15.31:0/2759137904 wait complete. 2024-08-17T02:25:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7da9fe740 20 client.4728 trim_cache size 0 max 16384 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "bf850b64-aabe-4059-850b-2b80766a6162", 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4293, 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 16.598855722, 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 6, 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 23, 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 23, 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 24.097054439000001 2024-08-17T02:25:03.271 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:25:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 -- 172.21.15.31:0/2942919384 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe7bc060860 msgr2=0x7fe7bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe7bc060860 0x7fe7bc062d10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8006fd0 tx=0x7fe7c8009250 comp rx=0 tx=0).stop 2024-08-17T02:25:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 -- 172.21.15.31:0/2942919384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7d0159120 msgr2=0x7fe7d015b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7d0159120 0x7fe7d015b270 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00011e0 tx=0x7fe7c0007d30 comp rx=0 tx=0).stop 2024-08-17T02:25:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 -- 172.21.15.31:0/2942919384 shutdown_connections 2024-08-17T02:25:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe7bc060860 0x7fe7bc062d10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7d0159120 0x7fe7d015b270 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7d00ad4c0 0x7fe7d0150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 --2- 172.21.15.31:0/2942919384 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7d00ab9e0 0x7fe7d0151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 -- 172.21.15.31:0/2942919384 >> 172.21.15.31:0/2942919384 conn(0x7fe7d00cbe50 msgr2=0x7fe7d00aaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 -- 172.21.15.31:0/2942919384 shutdown_connections 2024-08-17T02:25:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.262+0000 7fe7d874f700 1 -- 172.21.15.31:0/2942919384 wait complete. 2024-08-17T02:25:03.284 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-17T02:25:03.308 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-17T02:25:03.308 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:25:03.308 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-17T02:25:03.308 INFO:tasks.ceph_fuse:client.2 config is {} 2024-08-17T02:25:03.309 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-17T02:25:03.309 INFO:tasks.ceph_fuse:client.3 config is {} 2024-08-17T02:25:03.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.309 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-08-17T02:25:03.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.317 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-08-17T02:25:03.378 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2024-08-17T02:25:03.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:03.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.380 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-08-17T02:25:03.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-08-17T02:25:03.408 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2024-08-17T02:25:03.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:03.409 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-17T02:25:03.409 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:03.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7c0343700 1 Processor -- start 2024-08-17T02:25:03.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7c0343700 1 -- start start 2024-08-17T02:25:03.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7c0343700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7b815d530 0x7fb7b806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7c0343700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7b806a6e0 0x7fb7b80af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7c0343700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b80ad9f0 con 0x7fb7b80ade80 2024-08-17T02:25:03.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7c0343700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b80afc60 con 0x7fb7b806a6e0 2024-08-17T02:25:03.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7c0343700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b806ab20 con 0x7fb7b815d530 2024-08-17T02:25:03.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7be8e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7b806a6e0 0x7fb7b80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7be8e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7b806a6e0 0x7fb7b80af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34676/0 (socket says 172.21.15.31:34676) 2024-08-17T02:25:03.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7be8e0700 1 -- 172.21.15.31:0/3489913199 learned_addr learned my addr 172.21.15.31:0/3489913199 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:03.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7be0df700 1 --2- 172.21.15.31:0/3489913199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7b815d530 0x7fb7b806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7be8e0700 1 -- 172.21.15.31:0/3489913199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7b815d530 msgr2=0x7fb7b806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:03.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7be8e0700 1 --2- 172.21.15.31:0/3489913199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7b815d530 0x7fb7b806a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7be8e0700 1 -- 172.21.15.31:0/3489913199 >> v1:172.21.15.31:6789/0 conn(0x7fb7b80ade80 legacy=0x7fb7b80af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7be8e0700 1 -- 172.21.15.31:0/3489913199 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b80acde0 con 0x7fb7b806a6e0 2024-08-17T02:25:03.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7be8e0700 1 --2- 172.21.15.31:0/3489913199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b806a6e0 0x7fb7b80af720 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009f20 tx=0x7fb7b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c9a545a9e25e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7bd0dd700 1 -- 172.21.15.31:0/3489913199 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b000e070 con 0x7fb7b806a6e0 2024-08-17T02:25:03.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7bd0dd700 1 -- 172.21.15.31:0/3489913199 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b000ba80 con 0x7fb7b806a6e0 2024-08-17T02:25:03.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.518+0000 7fb7bd0dd700 1 -- 172.21.15.31:0/3489913199 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b00092e0 con 0x7fb7b806a6e0 2024-08-17T02:25:03.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.522+0000 7fb7c0343700 1 -- 172.21.15.31:0/3489913199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b806a6e0 msgr2=0x7fb7b80af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.522+0000 7fb7c0343700 1 --2- 172.21.15.31:0/3489913199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b806a6e0 0x7fb7b80af720 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009f20 tx=0x7fb7b0009840 comp rx=0 tx=0).stop 2024-08-17T02:25:03.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.522+0000 7fb7c0343700 1 -- 172.21.15.31:0/3489913199 shutdown_connections 2024-08-17T02:25:03.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.522+0000 7fb7c0343700 1 --2- 172.21.15.31:0/3489913199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b806a6e0 0x7fb7b80af720 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.522+0000 7fb7c0343700 1 --2- 172.21.15.31:0/3489913199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7b815d530 0x7fb7b806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.522+0000 7fb7c0343700 1 -- 172.21.15.31:0/3489913199 >> 172.21.15.31:0/3489913199 conn(0x7fb7b80cbe50 msgr2=0x7fb7b80cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:03.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.522+0000 7fb7c0343700 1 -- 172.21.15.31:0/3489913199 shutdown_connections 2024-08-17T02:25:03.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.522+0000 7fb7c0343700 1 -- 172.21.15.31:0/3489913199 wait complete. 2024-08-17T02:25:03.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.522+0000 7fb7c0343700 1 Processor -- start 2024-08-17T02:25:03.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.522+0000 7fb7c0343700 1 -- start start 2024-08-17T02:25:03.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7c0343700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7b806a6e0 0x7fb7b81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7c0343700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7b80ade80 0x7fb7b80ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7c0343700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b815d530 0x7fb7b815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7c0343700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b80c8fd0 con 0x7fb7b815d530 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7c0343700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b80c92b0 con 0x7fb7b806a6e0 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7c0343700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b80c9590 con 0x7fb7b80ade80 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7be8e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b815d530 0x7fb7b815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7be8e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b815d530 0x7fb7b815a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34692/0 (socket says 172.21.15.31:34692) 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7be8e0700 1 -- 172.21.15.31:0/205793887 learned_addr learned my addr 172.21.15.31:0/205793887 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7be0df700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7b806a6e0 0x7fb7b81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7bd8de700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7b80ade80 0x7fb7b80ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7be8e0700 1 -- 172.21.15.31:0/205793887 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7b80ade80 msgr2=0x7fb7b80ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7be8e0700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7b80ade80 0x7fb7b80ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7be8e0700 1 -- 172.21.15.31:0/205793887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7b806a6e0 msgr2=0x7fb7b81581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7be8e0700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7b806a6e0 0x7fb7b81581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7be8e0700 1 -- 172.21.15.31:0/205793887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b0009ae0 con 0x7fb7b815d530 2024-08-17T02:25:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7be8e0700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b815d530 0x7fb7b815a7a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000b6c0 tx=0x7fb7b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7ae7fc700 1 -- 172.21.15.31:0/205793887 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b00032f0 con 0x7fb7b815d530 2024-08-17T02:25:03.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7ae7fc700 1 -- 172.21.15.31:0/205793887 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b0008d20 con 0x7fb7b815d530 2024-08-17T02:25:03.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7c0343700 1 -- 172.21.15.31:0/205793887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b80c9870 con 0x7fb7b815d530 2024-08-17T02:25:03.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7ae7fc700 1 -- 172.21.15.31:0/205793887 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0026670 con 0x7fb7b815d530 2024-08-17T02:25:03.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.526+0000 7fb7c0343700 1 -- 172.21.15.31:0/205793887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b81586e0 con 0x7fb7b815d530 2024-08-17T02:25:03.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.530+0000 7fb7c0343700 1 -- 172.21.15.31:0/205793887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b80712b0 con 0x7fb7b815d530 2024-08-17T02:25:03.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.530+0000 7fb7ae7fc700 1 -- 172.21.15.31:0/205793887 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb7b0003040 con 0x7fb7b815d530 2024-08-17T02:25:03.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.530+0000 7fb7ae7fc700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb79c060890 0x7fb79c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:03.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.530+0000 7fb7be0df700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb79c060890 0x7fb79c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:03.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.530+0000 7fb7ae7fc700 1 -- 172.21.15.31:0/205793887 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7b007ea90 con 0x7fb7b815d530 2024-08-17T02:25:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.530+0000 7fb7be0df700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb79c060890 0x7fb79c062d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8006fd0 tx=0x7fb7a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:03.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.538+0000 7fb7ae7fc700 1 -- 172.21.15.31:0/205793887 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb7b004eee0 con 0x7fb7b815d530 2024-08-17T02:25:03.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.742+0000 7fb7c0343700 1 -- 172.21.15.31:0/205793887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb7b8069310 con 0x7fb7b815d530 2024-08-17T02:25:03.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.742+0000 7fb7ae7fc700 1 -- 172.21.15.31:0/205793887 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb7b0052500 con 0x7fb7b815d530 2024-08-17T02:25:03.748 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:03.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.742+0000 7fb7c0343700 1 -- 172.21.15.31:0/205793887 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb79c060890 msgr2=0x7fb79c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb79c060890 0x7fb79c062d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8006fd0 tx=0x7fb7a8008040 comp rx=0 tx=0).stop 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 -- 172.21.15.31:0/205793887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b815d530 msgr2=0x7fb7b815a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b815d530 0x7fb7b815a7a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000b6c0 tx=0x7fb7b0018000 comp rx=0 tx=0).stop 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 -- 172.21.15.31:0/205793887 shutdown_connections 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb79c060890 0x7fb79c062d40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7b815d530 0x7fb7b815a7a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7b80ade80 0x7fb7b80ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 --2- 172.21.15.31:0/205793887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7b806a6e0 0x7fb7b81581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 -- 172.21.15.31:0/205793887 >> 172.21.15.31:0/205793887 conn(0x7fb7b80cbe50 msgr2=0x7fb7b815dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 -- 172.21.15.31:0/205793887 shutdown_connections 2024-08-17T02:25:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:03.746+0000 7fb7c0343700 1 -- 172.21.15.31:0/205793887 wait complete. 2024-08-17T02:25:03.762 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:25:03.762 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:03.762 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-08-17T02:25:03.762 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:25:03.762 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:03.762 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:25:03.763 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:25:03.763 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:03.763 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:25:03.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.763 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-08-17T02:25:03.768 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:03.768 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:03.768 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:03.768 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:03.768 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:03.768 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42580sec preferred_lft 42580sec 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:03.769 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:03.770 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:03.770 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:25:03.770 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:67:ac:62:cf brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:03.770 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:25:03.770 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:03.770 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:25:03.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.771 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2024-08-17T02:25:03.771 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-08-17T02:25:03.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:25:03.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2024-08-17T02:25:03.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2024-08-17T02:25:03.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:25:03.771 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-08-17T02:25:03.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.858 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:03.870 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-08-17T02:25:03.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:03.871 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-08-17T02:25:04.044 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-08-17T02:25:04.045 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:04.045 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-17T02:25:04.045 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:25:04.045 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-17T02:25:04.045 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:04.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:04.046 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2024-08-17T02:25:04.046 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-08-17T02:25:04.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:25:04.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:25:04.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:25:04.046 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-08-17T02:25:04.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:04.086 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-08-17T02:25:04.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:04.094 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-08-17T02:25:04.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:04.145 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2024-08-17T02:25:04.145 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-08-17T02:25:04.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:25:04.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:25:04.145 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-08-17T02:25:04.176 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:25:04.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:04.176 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2024-08-17T02:25:04.177 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-08-17T02:25:04.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:25:04.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:25:04.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:25:04.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:25:04.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:25:04.177 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-08-17T02:25:04.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:04.236 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2024-08-17T02:25:04.236 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-08-17T02:25:04.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-08-17T02:25:04.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:25:04.236 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-08-17T02:25:04.262 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:25:04.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:04.263 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:04.269 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:25:04.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:04.269 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:04.275 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-08-17T02:25:04.292 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:04.292 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:04.305 INFO:teuthology.orchestra.run.smithi031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:04.305 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:04.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:04.306 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-08-17T02:25:04.311 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:25:04.311 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:25:04.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-08-17T02:25:04.327 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:04.327 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:04.390 INFO:teuthology.orchestra.run.smithi031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:04.391 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:04.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:04.391 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-08-17T02:25:04.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:2024-08-17T02:25:04.386+0000 7f7d5a1a1380 -1 init, newargv = 0x55a4c4c88b20 newargc=15 2024-08-17T02:25:04.392 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[31870]: starting ceph client 2024-08-17T02:25:04.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[31870]: starting fuse 2024-08-17T02:25:05.500 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-08-17T02:25:05.519 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:05.519 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:05.582 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:05.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:05.583 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-08-17T02:25:05.590 INFO:teuthology.orchestra.run.smithi031.stdout:52 2024-08-17T02:25:05.590 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:25:05.590 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> import re 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2024-08-17T02:25:05.591 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> return f 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.0")) 2024-08-17T02:25:05.592 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-08-17T02:25:05.673 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.0.31870.asok 2024-08-17T02:25:05.857 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.31870.asok 2024-08-17T02:25:05.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:05.857 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.31870.asok status 2024-08-17T02:25:05.958 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:25:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2024-08-17T02:25:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:25:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:25:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "0", 2024-08-17T02:25:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2024-08-17T02:25:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:25:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "31870", 2024-08-17T02:25:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2024-08-17T02:25:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4746, 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 4746 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1944878046 2024-08-17T02:25:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1944878046 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.4746 192.168.0.1:0/1944878046", 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/1944878046", 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 6, 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 23, 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2024-08-17T02:25:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2024-08-17T02:25:05.961 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:25:05.968 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:06.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 Processor -- start 2024-08-17T02:25:06.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 -- start start 2024-08-17T02:25:06.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f78a80b16f0 0x7f78a8140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78a80c9c30 0x7f78a80ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80ab690 con 0x7f78a8140780 2024-08-17T02:25:06.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a80caa00 con 0x7f78a80c9c30 2024-08-17T02:25:06.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a80cace0 con 0x7f78a80b16f0 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78a80c9c30 0x7f78a80ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a6ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f78a8140780 0x7f78a80b0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55608/0 (socket says 172.21.15.31:55608) 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a6ffd700 1 -- 172.21.15.31:0/783331844 learned_addr learned my addr 172.21.15.31:0/783331844 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78a80c9c30 0x7f78a80ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34702/0 (socket says 172.21.15.31:34702) 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a67fc700 1 --2- 172.21.15.31:0/783331844 >> v2:172.21.15.92:3300/0 conn(0x7f78a80b16f0 0x7f78a8140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a77fe700 1 -- 172.21.15.31:0/783331844 >> v2:172.21.15.92:3300/0 conn(0x7f78a80b16f0 msgr2=0x7f78a8140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a77fe700 1 --2- 172.21.15.31:0/783331844 >> v2:172.21.15.92:3300/0 conn(0x7f78a80b16f0 0x7f78a8140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a77fe700 1 -- 172.21.15.31:0/783331844 >> v1:172.21.15.31:6789/0 conn(0x7f78a8140780 legacy=0x7f78a80b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a5ffb700 1 -- 172.21.15.31:0/783331844 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601593657 0 0) 0x7f78a80ab690 con 0x7f78a8140780 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a77fe700 1 -- 172.21.15.31:0/783331844 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80cafc0 con 0x7f78a80c9c30 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a77fe700 1 --2- 172.21.15.31:0/783331844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a80c9c30 0x7f78a80ca0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f78a806aed0 tx=0x7f78a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c361d9548c8268d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a5ffb700 1 -- 172.21.15.31:0/783331844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a000e070 con 0x7f78a80c9c30 2024-08-17T02:25:06.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a5ffb700 1 -- 172.21.15.31:0/783331844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a000bc30 con 0x7f78a80c9c30 2024-08-17T02:25:06.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a5ffb700 1 -- 172.21.15.31:0/783331844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0012430 con 0x7f78a80c9c30 2024-08-17T02:25:06.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 -- 172.21.15.31:0/783331844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a80c9c30 msgr2=0x7f78a80ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 --2- 172.21.15.31:0/783331844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a80c9c30 0x7f78a80ca0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f78a806aed0 tx=0x7f78a0009780 comp rx=0 tx=0).stop 2024-08-17T02:25:06.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 -- 172.21.15.31:0/783331844 shutdown_connections 2024-08-17T02:25:06.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 --2- 172.21.15.31:0/783331844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a80c9c30 0x7f78a80ca0d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 --2- 172.21.15.31:0/783331844 >> v2:172.21.15.92:3300/0 conn(0x7f78a80b16f0 0x7f78a8140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 -- 172.21.15.31:0/783331844 >> 172.21.15.31:0/783331844 conn(0x7f78a8067400 msgr2=0x7f78a8067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:06.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 -- 172.21.15.31:0/783331844 shutdown_connections 2024-08-17T02:25:06.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.070+0000 7f78a7fff700 1 -- 172.21.15.31:0/783331844 wait complete. 2024-08-17T02:25:06.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a7fff700 1 Processor -- start 2024-08-17T02:25:06.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a7fff700 1 -- start start 2024-08-17T02:25:06.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a7fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78a80b16f0 0x7f78a81581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78a80c9c30 0x7f78a8137d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a8140780 0x7f78a8166910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a7fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8138280 con 0x7f78a8140780 2024-08-17T02:25:06.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a7fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8166e50 con 0x7f78a80c9c30 2024-08-17T02:25:06.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a7fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81588c0 con 0x7f78a80b16f0 2024-08-17T02:25:06.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a8140780 0x7f78a8166910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a8140780 0x7f78a8166910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34706/0 (socket says 172.21.15.31:34706) 2024-08-17T02:25:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a77fe700 1 -- 172.21.15.31:0/224269319 learned_addr learned my addr 172.21.15.31:0/224269319 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a6ffd700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78a80b16f0 0x7f78a81581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a67fc700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78a80c9c30 0x7f78a8137d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a77fe700 1 -- 172.21.15.31:0/224269319 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78a80b16f0 msgr2=0x7f78a81581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a77fe700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78a80b16f0 0x7f78a81581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a77fe700 1 -- 172.21.15.31:0/224269319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78a80c9c30 msgr2=0x7f78a8137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.074+0000 7f78a77fe700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78a80c9c30 0x7f78a8137d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f78a77fe700 1 -- 172.21.15.31:0/224269319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a0009a20 con 0x7f78a8140780 2024-08-17T02:25:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f78a77fe700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a8140780 0x7f78a8166910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f78a8063be0 tx=0x7f78a0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:06.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f788effd700 1 -- 172.21.15.31:0/224269319 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0027470 con 0x7f78a8140780 2024-08-17T02:25:06.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f788effd700 1 -- 172.21.15.31:0/224269319 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a00275d0 con 0x7f78a8140780 2024-08-17T02:25:06.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f78a7fff700 1 -- 172.21.15.31:0/224269319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a8158ba0 con 0x7f78a8140780 2024-08-17T02:25:06.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f788effd700 1 -- 172.21.15.31:0/224269319 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0027990 con 0x7f78a8140780 2024-08-17T02:25:06.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f78a7fff700 1 -- 172.21.15.31:0/224269319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a8159160 con 0x7f78a8140780 2024-08-17T02:25:06.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f78a7fff700 1 -- 172.21.15.31:0/224269319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a8167040 con 0x7f78a8140780 2024-08-17T02:25:06.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f788effd700 1 -- 172.21.15.31:0/224269319 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f78a0024070 con 0x7f78a8140780 2024-08-17T02:25:06.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f788effd700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7894060860 0x7f7894062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:06.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f788effd700 1 -- 172.21.15.31:0/224269319 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78a007f350 con 0x7f78a8140780 2024-08-17T02:25:06.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.078+0000 7f78a6ffd700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7894060860 0x7f7894062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:06.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.082+0000 7f78a6ffd700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7894060860 0x7f7894062d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7898007160 tx=0x7f7898007f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:06.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.086+0000 7f788effd700 1 -- 172.21.15.31:0/224269319 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f78a8167040 con 0x7f78a8140780 2024-08-17T02:25:06.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.290+0000 7f78a7fff700 1 -- 172.21.15.31:0/224269319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f78a8167040 con 0x7f78a8140780 2024-08-17T02:25:06.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.290+0000 7f788effd700 1 -- 172.21.15.31:0/224269319 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f78a002c060 con 0x7f78a8140780 2024-08-17T02:25:06.296 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.290+0000 7f78a7fff700 1 -- 172.21.15.31:0/224269319 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7894060860 msgr2=0x7f7894062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.290+0000 7f78a7fff700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7894060860 0x7f7894062d10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7898007160 tx=0x7f7898007f50 comp rx=0 tx=0).stop 2024-08-17T02:25:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.290+0000 7f78a7fff700 1 -- 172.21.15.31:0/224269319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a8140780 msgr2=0x7f78a8166910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.290+0000 7f78a7fff700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a8140780 0x7f78a8166910 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f78a8063be0 tx=0x7f78a0019000 comp rx=0 tx=0).stop 2024-08-17T02:25:06.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.290+0000 7f78a7fff700 1 -- 172.21.15.31:0/224269319 shutdown_connections 2024-08-17T02:25:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.290+0000 7f78a7fff700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7894060860 0x7f7894062d10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.290+0000 7f78a7fff700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78a8140780 0x7f78a8166910 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.290+0000 7f78a7fff700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78a80c9c30 0x7f78a8137d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.294+0000 7f78a7fff700 1 --2- 172.21.15.31:0/224269319 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78a80b16f0 0x7f78a81581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.294+0000 7f78a7fff700 1 -- 172.21.15.31:0/224269319 >> 172.21.15.31:0/224269319 conn(0x7f78a8067400 msgr2=0x7f78a813ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.294+0000 7f78a7fff700 1 -- 172.21.15.31:0/224269319 shutdown_connections 2024-08-17T02:25:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:06.294+0000 7f78a7fff700 1 -- 172.21.15.31:0/224269319 wait complete. 2024-08-17T02:25:06.310 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:25:06.310 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:06.310 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-08-17T02:25:06.310 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:25:06.310 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:06.310 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:25:06.310 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:25:06.310 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:06.311 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:25:06.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.311 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:06.319 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42577sec preferred_lft 42577sec 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:67:ac:62:cf brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:06.320 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether de:09:5f:e3:10:8f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:06.321 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:25:06.321 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.321 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::20c5:b8ff:fe41:bbbe/64 scope link 2024-08-17T02:25:06.321 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.321 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:06.321 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether de:09:5f:e3:10:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:25:06.321 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::dc09:5fff:fee3:108f/64 scope link 2024-08-17T02:25:06.321 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.321 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:06.335 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-08-17T02:25:06.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.336 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-08-17T02:25:06.344 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-08-17T02:25:06.344 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:06.344 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-17T02:25:06.344 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:25:06.344 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-17T02:25:06.344 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:06.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.345 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2024-08-17T02:25:06.345 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-08-17T02:25:06.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:25:06.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:25:06.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:25:06.345 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-08-17T02:25:06.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.384 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-08-17T02:25:06.432 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:25:06.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.433 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-08-17T02:25:06.439 INFO:teuthology.orchestra.run.smithi031.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:25:06.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.440 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2024-08-17T02:25:06.440 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-08-17T02:25:06.440 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:25:06.440 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:25:06.440 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-08-17T02:25:06.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.471 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 72:5d:5a:38:2b:25 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::705d:5aff:fe38:2b25/64 scope link 2024-08-17T02:25:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.537 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:25:06.548 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.549 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 72:5d:5a:38:2b:25 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:25:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:25:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::705d:5aff:fe38:2b25/64 scope link 2024-08-17T02:25:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:06.550 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:25:06.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.550 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2024-08-17T02:25:06.550 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-08-17T02:25:06.550 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:25:06.550 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:25:06.551 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:25:06.551 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:25:06.551 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:25:06.551 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-08-17T02:25:06.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:06.606 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2024-08-17T02:25:06.606 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-08-17T02:25:06.606 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.1 up 2024-08-17T02:25:06.606 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:25:06.606 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-08-17T02:25:06.631 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-08-17T02:25:06.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:06.631 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:06.681 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:25:06.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:06.682 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:06.687 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-08-17T02:25:06.705 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:06.705 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:06.765 INFO:teuthology.orchestra.run.smithi031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:06.766 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:06.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:06.767 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-08-17T02:25:06.772 INFO:teuthology.orchestra.run.smithi031.stdout:52 2024-08-17T02:25:06.772 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:25:06.772 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-08-17T02:25:06.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-08-17T02:25:06.789 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:06.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:06.804 INFO:teuthology.orchestra.run.smithi031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:06.805 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:06.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:06.805 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-08-17T02:25:06.855 INFO:teuthology.orchestra.run.smithi031.stdout:52 2024-08-17T02:25:06.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi031.stderr:2024-08-17T02:25:06.850+0000 7f7127868380 -1 init, newargv = 0x55b056d0dc00 newargc=15 2024-08-17T02:25:06.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi031.stderr:ceph-fuse[32013]: starting ceph client 2024-08-17T02:25:06.865 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi031.stderr:ceph-fuse[32013]: starting fuse 2024-08-17T02:25:07.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-08-17T02:25:07.973 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:07.973 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:07.984 INFO:teuthology.orchestra.run.smithi031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:07.985 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:07.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:07.986 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-08-17T02:25:08.036 INFO:teuthology.orchestra.run.smithi031.stdout:52 2024-08-17T02:25:08.037 INFO:teuthology.orchestra.run.smithi031.stdout:53 2024-08-17T02:25:08.037 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:25:08.037 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:25:08.037 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2024-08-17T02:25:08.037 DEBUG:teuthology.orchestra.run.smithi031:> import re 2024-08-17T02:25:08.037 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-08-17T02:25:08.037 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2024-08-17T02:25:08.037 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:25:08.038 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:25:08.039 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2024-08-17T02:25:08.039 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2024-08-17T02:25:08.039 DEBUG:teuthology.orchestra.run.smithi031:> return f 2024-08-17T02:25:08.039 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:25:08.039 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:08.039 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.2")) 2024-08-17T02:25:08.039 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-08-17T02:25:08.123 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.2.32013.asok 2024-08-17T02:25:08.306 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.32013.asok 2024-08-17T02:25:08.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:08.306 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.32013.asok status 2024-08-17T02:25:08.403 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:25:08.403 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2024-08-17T02:25:08.403 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:25:08.403 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:25:08.403 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "2", 2024-08-17T02:25:08.403 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2024-08-17T02:25:08.403 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-08-17T02:25:08.403 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "32013", 2024-08-17T02:25:08.403 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2024-08-17T02:25:08.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4761, 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 4761 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 2456018729 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 2456018729 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.4761 192.168.0.2:0/2456018729", 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.2:0/2456018729", 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 6, 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 23, 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2024-08-17T02:25:08.405 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:25:08.413 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.518+0000 7f6a5dd8b700 1 Processor -- start 2024-08-17T02:25:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.518+0000 7f6a5dd8b700 1 -- start start 2024-08-17T02:25:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.518+0000 7f6a5dd8b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6a5815ce20 0x7f6a5815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.518+0000 7f6a5dd8b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6a580ad6f0 0x7f6a580adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.518+0000 7f6a5dd8b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5815b2b0 con 0x7f6a58159830 2024-08-17T02:25:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.518+0000 7f6a5dd8b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a580ae410 con 0x7f6a580ad6f0 2024-08-17T02:25:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.518+0000 7f6a5dd8b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5815aca0 con 0x7f6a5815ce20 2024-08-17T02:25:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.518+0000 7f6a57fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6a580ad6f0 0x7f6a580adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.518+0000 7f6a57fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6a580ad6f0 0x7f6a580adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34712/0 (socket says 172.21.15.31:34712) 2024-08-17T02:25:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.518+0000 7f6a57fff700 1 -- 172.21.15.31:0/2982977295 learned_addr learned my addr 172.21.15.31:0/2982977295 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a5cd89700 1 --2- 172.21.15.31:0/2982977295 >> v2:172.21.15.92:3300/0 conn(0x7f6a5815ce20 0x7f6a5815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a57fff700 1 -- 172.21.15.31:0/2982977295 >> v2:172.21.15.92:3300/0 conn(0x7f6a5815ce20 msgr2=0x7f6a5815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a57fff700 1 --2- 172.21.15.31:0/2982977295 >> v2:172.21.15.92:3300/0 conn(0x7f6a5815ce20 0x7f6a5815d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a57fff700 1 -- 172.21.15.31:0/2982977295 >> v1:172.21.15.92:6789/0 conn(0x7f6a58159830 legacy=0x7f6a58159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a57fff700 1 -- 172.21.15.31:0/2982977295 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5815d730 con 0x7f6a580ad6f0 2024-08-17T02:25:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a57fff700 1 --2- 172.21.15.31:0/2982977295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 0x7f6a580adb10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6a580686d0 tx=0x7f6a48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c160b0ec609f8ed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a577fe700 1 -- 172.21.15.31:0/2982977295 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800e070 con 0x7f6a580ad6f0 2024-08-17T02:25:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a577fe700 1 -- 172.21.15.31:0/2982977295 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4800ba10 con 0x7f6a580ad6f0 2024-08-17T02:25:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a577fe700 1 -- 172.21.15.31:0/2982977295 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480092e0 con 0x7f6a580ad6f0 2024-08-17T02:25:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/2982977295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 msgr2=0x7f6a580adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a5dd8b700 1 --2- 172.21.15.31:0/2982977295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 0x7f6a580adb10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6a580686d0 tx=0x7f6a48009840 comp rx=0 tx=0).stop 2024-08-17T02:25:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/2982977295 shutdown_connections 2024-08-17T02:25:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a5dd8b700 1 --2- 172.21.15.31:0/2982977295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 0x7f6a580adb10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a5dd8b700 1 --2- 172.21.15.31:0/2982977295 >> v2:172.21.15.92:3300/0 conn(0x7f6a5815ce20 0x7f6a5815d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/2982977295 >> 172.21.15.31:0/2982977295 conn(0x7f6a58089cb0 msgr2=0x7f6a580995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/2982977295 shutdown_connections 2024-08-17T02:25:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.522+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/2982977295 wait complete. 2024-08-17T02:25:08.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 Processor -- start 2024-08-17T02:25:08.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 -- start start 2024-08-17T02:25:08.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 0x7f6a58150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a58159830 0x7f6a58152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5815ce20 0x7f6a581530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580cd410 con 0x7f6a580ad6f0 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580cd8a0 con 0x7f6a5815ce20 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580ccae0 con 0x7f6a58159830 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5cd89700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 0x7f6a58150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5cd89700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 0x7f6a58150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34722/0 (socket says 172.21.15.31:34722) 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5cd89700 1 -- 172.21.15.31:0/3816690764 learned_addr learned my addr 172.21.15.31:0/3816690764 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a57fff700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a58159830 0x7f6a58152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5d58a700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5815ce20 0x7f6a581530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5cd89700 1 -- 172.21.15.31:0/3816690764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a58159830 msgr2=0x7f6a58152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5cd89700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a58159830 0x7f6a58152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5cd89700 1 -- 172.21.15.31:0/3816690764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5815ce20 msgr2=0x7f6a581530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5cd89700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5815ce20 0x7f6a581530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5cd89700 1 -- 172.21.15.31:0/3816690764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48009ae0 con 0x7f6a580ad6f0 2024-08-17T02:25:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5cd89700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 0x7f6a58150ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00d890 tx=0x7f6a4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a54ff9700 1 -- 172.21.15.31:0/3816690764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0125f0 con 0x7f6a580ad6f0 2024-08-17T02:25:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/3816690764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a580ccdc0 con 0x7f6a580ad6f0 2024-08-17T02:25:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a54ff9700 1 -- 172.21.15.31:0/3816690764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c012750 con 0x7f6a580ad6f0 2024-08-17T02:25:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a54ff9700 1 -- 172.21.15.31:0/3816690764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c012af0 con 0x7f6a580ad6f0 2024-08-17T02:25:08.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/3816690764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a581573f0 con 0x7f6a580ad6f0 2024-08-17T02:25:08.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.526+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/3816690764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a580ccc20 con 0x7f6a580ad6f0 2024-08-17T02:25:08.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.530+0000 7f6a54ff9700 1 -- 172.21.15.31:0/3816690764 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6a4c01e460 con 0x7f6a580ad6f0 2024-08-17T02:25:08.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.530+0000 7f6a54ff9700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6a44060860 0x7f6a44062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:08.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.530+0000 7f6a54ff9700 1 -- 172.21.15.31:0/3816690764 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a4c07d230 con 0x7f6a580ad6f0 2024-08-17T02:25:08.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.530+0000 7f6a57fff700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6a44060860 0x7f6a44062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:08.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.530+0000 7f6a57fff700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6a44060860 0x7f6a44062d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009880 tx=0x7f6a48017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.534+0000 7f6a54ff9700 1 -- 172.21.15.31:0/3816690764 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6a580ccc20 con 0x7f6a580ad6f0 2024-08-17T02:25:08.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.738+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/3816690764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a580ccc20 con 0x7f6a580ad6f0 2024-08-17T02:25:08.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a54ff9700 1 -- 172.21.15.31:0/3816690764 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6a580ccc20 con 0x7f6a580ad6f0 2024-08-17T02:25:08.746 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/3816690764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6a44060860 msgr2=0x7f6a44062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6a44060860 0x7f6a44062d10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009880 tx=0x7f6a48017000 comp rx=0 tx=0).stop 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/3816690764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 msgr2=0x7f6a58150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 0x7f6a58150ff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00d890 tx=0x7f6a4c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/3816690764 shutdown_connections 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6a44060860 0x7f6a44062d10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a5815ce20 0x7f6a581530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a58159830 0x7f6a58152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 --2- 172.21.15.31:0/3816690764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a580ad6f0 0x7f6a58150ff0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/3816690764 >> 172.21.15.31:0/3816690764 conn(0x7f6a58089cb0 msgr2=0x7f6a580d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/3816690764 shutdown_connections 2024-08-17T02:25:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:08.742+0000 7f6a5dd8b700 1 -- 172.21.15.31:0/3816690764 wait complete. 2024-08-17T02:25:08.761 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:25:08.761 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:08.761 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-08-17T02:25:08.761 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:25:08.761 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:08.761 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:25:08.761 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:25:08.761 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:08.761 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:25:08.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:08.762 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-08-17T02:25:08.770 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:08.770 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:08.770 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:25:08.771 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42584sec preferred_lft 42584sec 2024-08-17T02:25:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link 2024-08-17T02:25:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:08.772 INFO:teuthology.orchestra.run.smithi092.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:25:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 02:42:e1:2f:ab:e8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:25:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:08.772 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:25:08.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:08.772 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2024-08-17T02:25:08.772 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-08-17T02:25:08.773 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:25:08.773 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2024-08-17T02:25:08.773 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2024-08-17T02:25:08.773 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:25:08.773 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-08-17T02:25:08.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:08.864 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:08.873 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-08-17T02:25:08.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:08.875 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-08-17T02:25:08.900 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-08-17T02:25:08.901 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:08.901 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:25:08.901 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:25:08.901 INFO:teuthology.orchestra.run.smithi092.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:25:08.901 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:25:08.901 INFO:teuthology.orchestra.run.smithi092.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:25:08.901 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:08.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:08.901 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2024-08-17T02:25:08.902 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-08-17T02:25:08.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:25:08.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:25:08.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:25:08.902 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-08-17T02:25:08.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:08.940 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-08-17T02:25:08.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:08.988 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-08-17T02:25:08.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:08.995 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2024-08-17T02:25:08.995 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-08-17T02:25:08.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:25:08.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:25:08.995 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-08-17T02:25:09.024 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:25:09.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:09.024 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2024-08-17T02:25:09.025 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-08-17T02:25:09.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:25:09.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:25:09.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:25:09.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:25:09.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:25:09.025 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-08-17T02:25:09.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:09.138 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2024-08-17T02:25:09.139 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-08-17T02:25:09.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-08-17T02:25:09.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:25:09.139 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-08-17T02:25:09.166 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:25:09.166 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:09.166 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:09.173 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:25:09.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:09.173 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:09.178 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-08-17T02:25:09.238 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:09.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:09.253 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:09.254 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:09.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:09.255 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-08-17T02:25:09.261 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:25:09.262 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:25:09.264 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-08-17T02:25:09.279 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:09.280 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:09.289 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:09.290 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:09.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:09.291 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-08-17T02:25:09.349 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi092.stderr:2024-08-17T02:25:09.343+0000 7fdabc5c1380 -1 init, newargv = 0x55982d0be6a0 newargc=15 2024-08-17T02:25:09.349 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi092.stderr:ceph-fuse[30083]: starting ceph client 2024-08-17T02:25:09.357 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi092.stderr:ceph-fuse[30083]: starting fuse 2024-08-17T02:25:10.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-08-17T02:25:10.460 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:10.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:10.470 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:10.471 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:10.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:10.472 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-08-17T02:25:10.519 INFO:teuthology.orchestra.run.smithi092.stdout:52 2024-08-17T02:25:10.519 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:25:10.519 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> import re 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> import os 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2024-08-17T02:25:10.520 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> return f 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.1")) 2024-08-17T02:25:10.521 DEBUG:teuthology.orchestra.run.smithi092:> ' 2024-08-17T02:25:10.605 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.1.30083.asok 2024-08-17T02:25:10.790 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.30083.asok 2024-08-17T02:25:10.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:10.791 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.30083.asok status 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:25:10.879 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "1", 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "30083", 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/" 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4690, 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2024-08-17T02:25:10.880 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 4690 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 794561304 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 794561304 2024-08-17T02:25:10.881 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:10.882 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.4690 192.168.0.1:0/794561304", 2024-08-17T02:25:10.882 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "192.168.0.1:0/794561304", 2024-08-17T02:25:10.882 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 1, 2024-08-17T02:25:10.882 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 6, 2024-08-17T02:25:10.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 23, 2024-08-17T02:25:10.882 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:25:10.882 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2024-08-17T02:25:10.882 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2024-08-17T02:25:10.882 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-08-17T02:25:10.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:10.998+0000 7fe33d1ab700 1 Processor -- start 2024-08-17T02:25:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:10.998+0000 7fe33d1ab700 1 -- start start 2024-08-17T02:25:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 0x7fe338140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3380b0fe0 0x7fe3380b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe3380c9c30 0x7fe3380ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3380b1970 con 0x7fe3380b0fe0 2024-08-17T02:25:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3380ab690 con 0x7fe3380c9c30 2024-08-17T02:25:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3380caa00 con 0x7fe338140780 2024-08-17T02:25:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe3377fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3380b0fe0 0x7fe3380b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe3377fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe3380b0fe0 0x7fe3380b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39770/0 (socket says 172.21.15.31:39770) 2024-08-17T02:25:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe3377fe700 1 -- 172.21.15.31:0/1245754593 learned_addr learned my addr 172.21.15.31:0/1245754593 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe337fff700 1 --2- 172.21.15.31:0/1245754593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 0x7fe338140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33c9aa700 1 --2- 172.21.15.31:0/1245754593 >> v2:172.21.15.92:3300/0 conn(0x7fe3380c9c30 0x7fe3380ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe3377fe700 1 -- 172.21.15.31:0/1245754593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 msgr2=0x7fe338140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe3377fe700 1 --2- 172.21.15.31:0/1245754593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 0x7fe338140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe3377fe700 1 -- 172.21.15.31:0/1245754593 >> v2:172.21.15.92:3300/0 conn(0x7fe3380c9c30 msgr2=0x7fe3380ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe3377fe700 1 --2- 172.21.15.31:0/1245754593 >> v2:172.21.15.92:3300/0 conn(0x7fe3380c9c30 0x7fe3380ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe3377fe700 1 -- 172.21.15.31:0/1245754593 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3380cace0 con 0x7fe3380b0fe0 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33c9aa700 1 --2- 172.21.15.31:0/1245754593 >> v2:172.21.15.92:3300/0 conn(0x7fe3380c9c30 0x7fe3380ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe337fff700 1 --2- 172.21.15.31:0/1245754593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 0x7fe338140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe3377fe700 1 --2- 172.21.15.31:0/1245754593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 0x7fe3380b1430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe3381410c0 tx=0x7fe328009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9174c2efcb838a1f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe336ffd700 1 -- 172.21.15.31:0/1245754593 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800b860 con 0x7fe3380b0fe0 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe336ffd700 1 -- 172.21.15.31:0/1245754593 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32800b9c0 con 0x7fe3380b0fe0 2024-08-17T02:25:11.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe336ffd700 1 -- 172.21.15.31:0/1245754593 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800bd60 con 0x7fe3380b0fe0 2024-08-17T02:25:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 -- 172.21.15.31:0/1245754593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 msgr2=0x7fe3380b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 --2- 172.21.15.31:0/1245754593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 0x7fe3380b1430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe3381410c0 tx=0x7fe328009250 comp rx=0 tx=0).stop 2024-08-17T02:25:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 -- 172.21.15.31:0/1245754593 shutdown_connections 2024-08-17T02:25:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 --2- 172.21.15.31:0/1245754593 >> v2:172.21.15.92:3300/0 conn(0x7fe3380c9c30 0x7fe3380ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 --2- 172.21.15.31:0/1245754593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 0x7fe3380b1430 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 --2- 172.21.15.31:0/1245754593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 0x7fe338140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 -- 172.21.15.31:0/1245754593 >> 172.21.15.31:0/1245754593 conn(0x7fe338067400 msgr2=0x7fe338067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 -- 172.21.15.31:0/1245754593 shutdown_connections 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 -- 172.21.15.31:0/1245754593 wait complete. 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 Processor -- start 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.002+0000 7fe33d1ab700 1 -- start start 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe33d1ab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 0x7fe338150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe33d1ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3380c9c30 0x7fe33813d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe33d1ab700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 0x7fe33812e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe33d1ab700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe338137840 con 0x7fe3380b0fe0 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe33d1ab700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe338137b20 con 0x7fe3380c9c30 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe33d1ab700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe338137e00 con 0x7fe338140780 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe337fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 0x7fe338150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe337fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 0x7fe338150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39772/0 (socket says 172.21.15.31:39772) 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe337fff700 1 -- 172.21.15.31:0/136696498 learned_addr learned my addr 172.21.15.31:0/136696498 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe3377fe700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3380c9c30 0x7fe33813d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe33c9aa700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 0x7fe33812e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe337fff700 1 -- 172.21.15.31:0/136696498 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 msgr2=0x7fe33812e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe337fff700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 0x7fe33812e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe337fff700 1 -- 172.21.15.31:0/136696498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3380c9c30 msgr2=0x7fe33813d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe337fff700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3380c9c30 0x7fe33813d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe337fff700 1 -- 172.21.15.31:0/136696498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3280094f0 con 0x7fe3380b0fe0 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe3377fe700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3380c9c30 0x7fe33813d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe337fff700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 0x7fe338150a10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe32000c850 tx=0x7fe320008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe32ffff700 1 -- 172.21.15.31:0/136696498 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320011600 con 0x7fe3380b0fe0 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe32ffff700 1 -- 172.21.15.31:0/136696498 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320011760 con 0x7fe3380b0fe0 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe33d1ab700 1 -- 172.21.15.31:0/136696498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3381380e0 con 0x7fe3380b0fe0 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe32ffff700 1 -- 172.21.15.31:0/136696498 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320011b00 con 0x7fe3380b0fe0 2024-08-17T02:25:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe33d1ab700 1 -- 172.21.15.31:0/136696498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe338150f50 con 0x7fe3380b0fe0 2024-08-17T02:25:11.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe33d1ab700 1 -- 172.21.15.31:0/136696498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3380712b0 con 0x7fe3380b0fe0 2024-08-17T02:25:11.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.006+0000 7fe32ffff700 1 -- 172.21.15.31:0/136696498 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe3200073b0 con 0x7fe3380b0fe0 2024-08-17T02:25:11.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.010+0000 7fe32ffff700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe318060890 0x7fe318062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.010+0000 7fe32ffff700 1 -- 172.21.15.31:0/136696498 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe32007cb70 con 0x7fe3380b0fe0 2024-08-17T02:25:11.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.010+0000 7fe3377fe700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe318060890 0x7fe318062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.010+0000 7fe3377fe700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe318060890 0x7fe318062d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3381410c0 tx=0x7fe328017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.018+0000 7fe32ffff700 1 -- 172.21.15.31:0/136696498 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe320050a50 con 0x7fe3380b0fe0 2024-08-17T02:25:11.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.214+0000 7fe33d1ab700 1 -- 172.21.15.31:0/136696498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe338140e70 con 0x7fe3380b0fe0 2024-08-17T02:25:11.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.214+0000 7fe32ffff700 1 -- 172.21.15.31:0/136696498 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe3200505e0 con 0x7fe3380b0fe0 2024-08-17T02:25:11.221 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:11.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 -- 172.21.15.31:0/136696498 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe318060890 msgr2=0x7fe318062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe318060890 0x7fe318062d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3381410c0 tx=0x7fe328017000 comp rx=0 tx=0).stop 2024-08-17T02:25:11.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 -- 172.21.15.31:0/136696498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 msgr2=0x7fe338150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 0x7fe338150a10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe32000c850 tx=0x7fe320008040 comp rx=0 tx=0).stop 2024-08-17T02:25:11.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 -- 172.21.15.31:0/136696498 shutdown_connections 2024-08-17T02:25:11.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe318060890 0x7fe318062d40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe338140780 0x7fe33812e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3380c9c30 0x7fe33813d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 --2- 172.21.15.31:0/136696498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3380b0fe0 0x7fe338150a10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 -- 172.21.15.31:0/136696498 >> 172.21.15.31:0/136696498 conn(0x7fe338067400 msgr2=0x7fe338069810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:11.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 -- 172.21.15.31:0/136696498 shutdown_connections 2024-08-17T02:25:11.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:11.218+0000 7fe33d1ab700 1 -- 172.21.15.31:0/136696498 wait complete. 2024-08-17T02:25:11.235 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:25:11.235 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:11.235 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-08-17T02:25:11.235 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:25:11.236 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:11.236 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:25:11.236 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:25:11.236 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:11.236 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:25:11.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.236 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-08-17T02:25:11.244 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42581sec preferred_lft 42581sec 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.245 INFO:teuthology.orchestra.run.smithi092.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 02:42:e1:2f:ab:e8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 9e:59:18:0c:b6:de brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::b4c3:daff:fecb:893f/64 scope link 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 9e:59:18:0c:b6:de brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::9c59:18ff:fe0c:b6de/64 scope link 2024-08-17T02:25:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.247 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:11.298 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-08-17T02:25:11.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.300 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-08-17T02:25:11.306 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-08-17T02:25:11.306 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:11.306 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:25:11.306 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:25:11.306 INFO:teuthology.orchestra.run.smithi092.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:25:11.306 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:25:11.306 INFO:teuthology.orchestra.run.smithi092.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:25:11.306 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:11.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.307 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2024-08-17T02:25:11.307 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-08-17T02:25:11.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:25:11.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:25:11.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:25:11.307 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-08-17T02:25:11.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.346 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-08-17T02:25:11.353 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:25:11.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.354 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-08-17T02:25:11.359 INFO:teuthology.orchestra.run.smithi092.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:25:11.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.360 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2024-08-17T02:25:11.360 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-08-17T02:25:11.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:25:11.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:25:11.360 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-08-17T02:25:11.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.391 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 32:d9:f4:2f:5f:35 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::30d9:f4ff:fe2f:5f35/64 scope link 2024-08-17T02:25:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:25:11.419 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.419 INFO:teuthology.orchestra.run.smithi092.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 32:d9:f4:2f:5f:35 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:25:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:25:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::30d9:f4ff:fe2f:5f35/64 scope link 2024-08-17T02:25:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:11.421 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:25:11.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.421 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2024-08-17T02:25:11.421 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-08-17T02:25:11.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:25:11.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:25:11.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:25:11.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:25:11.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:25:11.421 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-08-17T02:25:11.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:11.525 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2024-08-17T02:25:11.525 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-08-17T02:25:11.525 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.1 up 2024-08-17T02:25:11.525 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:25:11.525 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-08-17T02:25:11.552 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-08-17T02:25:11.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:11.552 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:11.559 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:25:11.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:11.559 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:11.607 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-08-17T02:25:11.624 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:11.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:11.639 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:11.640 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:11.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:11.641 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-08-17T02:25:11.645 INFO:teuthology.orchestra.run.smithi092.stdout:52 2024-08-17T02:25:11.645 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-08-17T02:25:11.645 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-08-17T02:25:11.690 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-08-17T02:25:11.707 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:11.707 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:11.715 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:11.717 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:11.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:11.717 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-08-17T02:25:11.722 INFO:teuthology.orchestra.run.smithi092.stdout:52 2024-08-17T02:25:11.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi092.stderr:2024-08-17T02:25:11.775+0000 7f75ec1f4380 -1 init, newargv = 0x5555ac9706e0 newargc=15 2024-08-17T02:25:11.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi092.stderr:ceph-fuse[30198]: starting ceph client 2024-08-17T02:25:11.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi092.stderr:ceph-fuse[30198]: starting fuse 2024-08-17T02:25:12.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-08-17T02:25:12.840 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:12.840 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:12.900 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:12.901 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:12.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:12.902 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-08-17T02:25:12.909 INFO:teuthology.orchestra.run.smithi092.stdout:52 2024-08-17T02:25:12.909 INFO:teuthology.orchestra.run.smithi092.stdout:53 2024-08-17T02:25:12.909 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-08-17T02:25:12.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:25:12.909 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2024-08-17T02:25:12.909 DEBUG:teuthology.orchestra.run.smithi092:> import re 2024-08-17T02:25:12.909 DEBUG:teuthology.orchestra.run.smithi092:> import os 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2024-08-17T02:25:12.910 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> return f 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.3")) 2024-08-17T02:25:12.911 DEBUG:teuthology.orchestra.run.smithi092:> ' 2024-08-17T02:25:12.994 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.3.30198.asok 2024-08-17T02:25:13.181 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.30198.asok 2024-08-17T02:25:13.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:13.181 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.30198.asok status 2024-08-17T02:25:13.323 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "3", 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "30198", 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/" 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2024-08-17T02:25:13.324 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4538, 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 4538 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3476055489 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-08-17T02:25:13.325 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.2:0", 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3476055489 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.4538 192.168.0.2:0/3476055489", 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "192.168.0.2:0/3476055489", 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 1, 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 6, 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 23, 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2024-08-17T02:25:13.326 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-08-17T02:25:13.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:13.333 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2024-08-17T02:25:13.333 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:13.341 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2024-08-17T02:25:13.342 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:13.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:13.342 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:13.403 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:13.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:13.404 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2024-08-17T02:25:13.404 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:13.405 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:13.414 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2024-08-17T02:25:13.414 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:13.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:13.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:13.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:13.433 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2024-08-17T02:25:13.433 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:13.441 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2024-08-17T02:25:13.441 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:13.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:13.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:13.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:13.514 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2024-08-17T02:25:13.514 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:13.522 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2024-08-17T02:25:13.523 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:13.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:13.523 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:13.538 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:25:13.554 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:13.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c0841a700 1 Processor -- start 2024-08-17T02:25:13.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c0841a700 1 -- start start 2024-08-17T02:25:13.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c0841a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5c000ade80 0x7f5c000af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c0841a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c0006a8b0 0x7f5c000af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c0841a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c000ad9f0 con 0x7f5c0015d530 2024-08-17T02:25:13.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c0841a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c000acde0 con 0x7f5c000ade80 2024-08-17T02:25:13.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c0841a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000ad0c0 con 0x7f5c0006a8b0 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c059b5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5c000ade80 0x7f5c000af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c069b7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c0006a8b0 0x7f5c000af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c059b5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5c000ade80 0x7f5c000af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36172/0 (socket says 172.21.15.31:36172) 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c069b7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c0006a8b0 0x7f5c000af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:56180/0 (socket says 172.21.15.31:56180) 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c059b5700 1 -- 172.21.15.31:0/952542536 learned_addr learned my addr 172.21.15.31:0/952542536 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.662+0000 7f5c061b6700 1 --1- 172.21.15.31:0/952542536 >> v1:172.21.15.92:6789/0 conn(0x7f5c0015d530 0x7f5c0006a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:58248/0 (socket says 172.21.15.31:58248) 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c059b5700 1 -- 172.21.15.31:0/952542536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c0006a8b0 msgr2=0x7f5c000af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c059b5700 1 --2- 172.21.15.31:0/952542536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c0006a8b0 0x7f5c000af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c059b5700 1 -- 172.21.15.31:0/952542536 >> v1:172.21.15.92:6789/0 conn(0x7f5c0015d530 legacy=0x7f5c0006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c059b5700 1 -- 172.21.15.31:0/952542536 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c000ad3a0 con 0x7f5c000ade80 2024-08-17T02:25:13.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c069b7700 1 --2- 172.21.15.31:0/952542536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c0006a8b0 0x7f5c000af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c059b5700 1 --2- 172.21.15.31:0/952542536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c000ade80 0x7f5c000af010 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0099b0 tx=0x7f5bfc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fc92c3f21cbab1d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c051b4700 1 -- 172.21.15.31:0/952542536 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc009ea0 con 0x7f5c000ade80 2024-08-17T02:25:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c051b4700 1 -- 172.21.15.31:0/952542536 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc00b860 con 0x7f5c000ade80 2024-08-17T02:25:13.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c051b4700 1 -- 172.21.15.31:0/952542536 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00bc00 con 0x7f5c000ade80 2024-08-17T02:25:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c0841a700 1 -- 172.21.15.31:0/952542536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c000ade80 msgr2=0x7f5c000af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c0841a700 1 --2- 172.21.15.31:0/952542536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c000ade80 0x7f5c000af010 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0099b0 tx=0x7f5bfc009250 comp rx=0 tx=0).stop 2024-08-17T02:25:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c0841a700 1 -- 172.21.15.31:0/952542536 shutdown_connections 2024-08-17T02:25:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c0841a700 1 --2- 172.21.15.31:0/952542536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c0006a8b0 0x7f5c000af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c0841a700 1 --2- 172.21.15.31:0/952542536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c000ade80 0x7f5c000af010 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c0841a700 1 -- 172.21.15.31:0/952542536 >> 172.21.15.31:0/952542536 conn(0x7f5c000cbe50 msgr2=0x7f5c000cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c0841a700 1 -- 172.21.15.31:0/952542536 shutdown_connections 2024-08-17T02:25:13.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c0841a700 1 -- 172.21.15.31:0/952542536 wait complete. 2024-08-17T02:25:13.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c0841a700 1 Processor -- start 2024-08-17T02:25:13.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.666+0000 7f5c0841a700 1 -- start start 2024-08-17T02:25:13.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c0841a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c0006a8b0 0x7f5c00158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c0841a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c000ade80 0x7f5c000c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c0841a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c0015d530 0x7f5c000cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c0841a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000c90c0 con 0x7f5c0006a8b0 2024-08-17T02:25:13.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c0841a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000c8790 con 0x7f5c0015d530 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c0841a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000c8a70 con 0x7f5c000ade80 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c061b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c0006a8b0 0x7f5c00158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c061b6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c0006a8b0 0x7f5c00158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39784/0 (socket says 172.21.15.31:39784) 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c061b6700 1 -- 172.21.15.31:0/1088979284 learned_addr learned my addr 172.21.15.31:0/1088979284 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c059b5700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c000ade80 0x7f5c000c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c069b7700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c0015d530 0x7f5c000cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c061b6700 1 -- 172.21.15.31:0/1088979284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c000ade80 msgr2=0x7f5c000c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c061b6700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c000ade80 0x7f5c000c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c061b6700 1 -- 172.21.15.31:0/1088979284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c0015d530 msgr2=0x7f5c000cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c061b6700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c0015d530 0x7f5c000cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c061b6700 1 -- 172.21.15.31:0/1088979284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf8009a20 con 0x7f5c0006a8b0 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c069b7700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c0015d530 0x7f5c000cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:13.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c061b6700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c0006a8b0 0x7f5c00158600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c7c0 tx=0x7f5bf0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5bf67fc700 1 -- 172.21.15.31:0/1088979284 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0005a70 con 0x7f5c0006a8b0 2024-08-17T02:25:13.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5bf67fc700 1 -- 172.21.15.31:0/1088979284 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf0005bf0 con 0x7f5c0006a8b0 2024-08-17T02:25:13.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c0841a700 1 -- 172.21.15.31:0/1088979284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bfc0094f0 con 0x7f5c0006a8b0 2024-08-17T02:25:13.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5bf67fc700 1 -- 172.21.15.31:0/1088979284 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf00070f0 con 0x7f5c0006a8b0 2024-08-17T02:25:13.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.670+0000 7f5c0841a700 1 -- 172.21.15.31:0/1088979284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c000c8e00 con 0x7f5c0006a8b0 2024-08-17T02:25:13.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.674+0000 7f5c0841a700 1 -- 172.21.15.31:0/1088979284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c000712b0 con 0x7f5c0006a8b0 2024-08-17T02:25:13.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.674+0000 7f5bf67fc700 1 -- 172.21.15.31:0/1088979284 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5bf0007460 con 0x7f5c0006a8b0 2024-08-17T02:25:13.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.674+0000 7f5bf67fc700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5bec060860 0x7f5bec062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.674+0000 7f5bf67fc700 1 -- 172.21.15.31:0/1088979284 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5bf007c620 con 0x7f5c0006a8b0 2024-08-17T02:25:13.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.674+0000 7f5c059b5700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5bec060860 0x7f5bec062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.674+0000 7f5c059b5700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5bec060860 0x7f5bec062d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0099b0 tx=0x7f5bfc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.682+0000 7f5bf67fc700 1 -- 172.21.15.31:0/1088979284 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5bf004caf0 con 0x7f5c0006a8b0 2024-08-17T02:25:13.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.846+0000 7f5c0841a700 1 -- 172.21.15.31:0/1088979284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c000ac8b0 con 0x7f5c0006a8b0 2024-08-17T02:25:13.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5bf67fc700 1 -- 172.21.15.31:0/1088979284 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f5bf0050110 con 0x7f5c0006a8b0 2024-08-17T02:25:13.856 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:13.856 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:13.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 -- 172.21.15.31:0/1088979284 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5bec060860 msgr2=0x7f5bec062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5bec060860 0x7f5bec062d10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0099b0 tx=0x7f5bfc017000 comp rx=0 tx=0).stop 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 -- 172.21.15.31:0/1088979284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c0006a8b0 msgr2=0x7f5c00158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c0006a8b0 0x7f5c00158600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c7c0 tx=0x7f5bf0007f70 comp rx=0 tx=0).stop 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 -- 172.21.15.31:0/1088979284 shutdown_connections 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5bec060860 0x7f5bec062d10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c0015d530 0x7f5c000cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c000ade80 0x7f5c000c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 --2- 172.21.15.31:0/1088979284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c0006a8b0 0x7f5c00158600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 -- 172.21.15.31:0/1088979284 >> 172.21.15.31:0/1088979284 conn(0x7f5c000cbe50 msgr2=0x7f5c000aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.850+0000 7f5c0841a700 1 -- 172.21.15.31:0/1088979284 shutdown_connections 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.854+0000 7f5c0841a700 1 -- 172.21.15.31:0/1088979284 wait complete. 2024-08-17T02:25:13.870 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:43.691230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:45.035480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:13.870 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:13.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc30c733700 1 Processor -- start 2024-08-17T02:25:13.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc30c733700 1 -- start start 2024-08-17T02:25:13.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc30c733700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3040b4340 0x7fc3040b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc30c733700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 0x7fc3040b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc30c733700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040b2a60 con 0x7fc304159330 2024-08-17T02:25:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc30c733700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3040b0fb0 con 0x7fc3040b4340 2024-08-17T02:25:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc30c733700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040b11b0 con 0x7fc304159700 2024-08-17T02:25:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc309cce700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3040b4340 0x7fc3040b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc309cce700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3040b4340 0x7fc3040b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39788/0 (socket says 172.21.15.31:39788) 2024-08-17T02:25:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc309cce700 1 -- 172.21.15.31:0/4045314901 learned_addr learned my addr 172.21.15.31:0/4045314901 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.978+0000 7fc30acd0700 1 --2- 172.21.15.31:0/4045314901 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 0x7fc3040b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc309cce700 1 -- 172.21.15.31:0/4045314901 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 msgr2=0x7fc3040b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc309cce700 1 --2- 172.21.15.31:0/4045314901 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 0x7fc3040b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc309cce700 1 -- 172.21.15.31:0/4045314901 >> v1:172.21.15.92:6789/0 conn(0x7fc304159330 legacy=0x7fc3040b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc309cce700 1 -- 172.21.15.31:0/4045314901 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3040b1490 con 0x7fc3040b4340 2024-08-17T02:25:13.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc30acd0700 1 --2- 172.21.15.31:0/4045314901 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 0x7fc3040b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:13.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc309cce700 1 --2- 172.21.15.31:0/4045314901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3040b4340 0x7fc3040b0530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc3000099b0 tx=0x7fc300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05672ec15cfb478 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc3094cd700 1 -- 172.21.15.31:0/4045314901 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30000b860 con 0x7fc3040b4340 2024-08-17T02:25:13.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc3094cd700 1 -- 172.21.15.31:0/4045314901 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30000b9c0 con 0x7fc3040b4340 2024-08-17T02:25:13.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc3094cd700 1 -- 172.21.15.31:0/4045314901 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30000bd60 con 0x7fc3040b4340 2024-08-17T02:25:13.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc30c733700 1 -- 172.21.15.31:0/4045314901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3040b4340 msgr2=0x7fc3040b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc30c733700 1 --2- 172.21.15.31:0/4045314901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3040b4340 0x7fc3040b0530 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc3000099b0 tx=0x7fc300009250 comp rx=0 tx=0).stop 2024-08-17T02:25:13.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc30c733700 1 -- 172.21.15.31:0/4045314901 shutdown_connections 2024-08-17T02:25:13.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc30c733700 1 --2- 172.21.15.31:0/4045314901 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 0x7fc3040b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc30c733700 1 --2- 172.21.15.31:0/4045314901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3040b4340 0x7fc3040b0530 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc30c733700 1 -- 172.21.15.31:0/4045314901 >> 172.21.15.31:0/4045314901 conn(0x7fc304099610 msgr2=0x7fc304067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:13.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc30c733700 1 -- 172.21.15.31:0/4045314901 shutdown_connections 2024-08-17T02:25:13.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.982+0000 7fc30c733700 1 -- 172.21.15.31:0/4045314901 wait complete. 2024-08-17T02:25:13.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30c733700 1 Processor -- start 2024-08-17T02:25:13.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30c733700 1 -- start start 2024-08-17T02:25:13.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30c733700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3040b4340 0x7fc30409b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30c733700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc304159330 0x7fc30409d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30c733700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 0x7fc3040ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30c733700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30409ad30 con 0x7fc304159330 2024-08-17T02:25:13.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30c733700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3041574c0 con 0x7fc3040b4340 2024-08-17T02:25:13.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30c733700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30409a120 con 0x7fc304159700 2024-08-17T02:25:13.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc309cce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc304159330 0x7fc30409d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc309cce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc304159330 0x7fc30409d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39804/0 (socket says 172.21.15.31:39804) 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc309cce700 1 -- 172.21.15.31:0/2326175930 learned_addr learned my addr 172.21.15.31:0/2326175930 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30a4cf700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3040b4340 0x7fc30409b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30acd0700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 0x7fc3040ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc309cce700 1 -- 172.21.15.31:0/2326175930 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 msgr2=0x7fc3040ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc309cce700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 0x7fc3040ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc309cce700 1 -- 172.21.15.31:0/2326175930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3040b4340 msgr2=0x7fc30409b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc309cce700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3040b4340 0x7fc30409b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc309cce700 1 -- 172.21.15.31:0/2326175930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3000094f0 con 0x7fc304159330 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc309cce700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc304159330 0x7fc30409d260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc3000090b0 tx=0x7fc300017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc2fa7fc700 1 -- 172.21.15.31:0/2326175930 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300011e00 con 0x7fc304159330 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc2fa7fc700 1 -- 172.21.15.31:0/2326175930 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30001f070 con 0x7fc304159330 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30c733700 1 -- 172.21.15.31:0/2326175930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30409a400 con 0x7fc304159330 2024-08-17T02:25:13.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc2fa7fc700 1 -- 172.21.15.31:0/2326175930 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000266d0 con 0x7fc304159330 2024-08-17T02:25:13.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.986+0000 7fc30c733700 1 -- 172.21.15.31:0/2326175930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30409a9c0 con 0x7fc304159330 2024-08-17T02:25:13.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.990+0000 7fc30c733700 1 -- 172.21.15.31:0/2326175930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30409aea0 con 0x7fc304159330 2024-08-17T02:25:13.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.990+0000 7fc2fa7fc700 1 -- 172.21.15.31:0/2326175930 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc300026a40 con 0x7fc304159330 2024-08-17T02:25:13.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.990+0000 7fc2fa7fc700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc2e8060860 0x7fc2e8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.990+0000 7fc2fa7fc700 1 -- 172.21.15.31:0/2326175930 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc300021070 con 0x7fc304159330 2024-08-17T02:25:13.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.990+0000 7fc30a4cf700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc2e8060860 0x7fc2e8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.990+0000 7fc30a4cf700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc2e8060860 0x7fc2e8062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc3040b2dc0 tx=0x7fc2f4007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:13.998+0000 7fc2fa7fc700 1 -- 172.21.15.31:0/2326175930 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc30004ece0 con 0x7fc304159330 2024-08-17T02:25:14.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.158+0000 7fc30c733700 1 -- 172.21.15.31:0/2326175930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3040712b0 con 0x7fc304159330 2024-08-17T02:25:14.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc2fa7fc700 1 -- 172.21.15.31:0/2326175930 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc300015020 con 0x7fc304159330 2024-08-17T02:25:14.166 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:25:14.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 -- 172.21.15.31:0/2326175930 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc2e8060860 msgr2=0x7fc2e8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc2e8060860 0x7fc2e8062d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc3040b2dc0 tx=0x7fc2f4007e80 comp rx=0 tx=0).stop 2024-08-17T02:25:14.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 -- 172.21.15.31:0/2326175930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc304159330 msgr2=0x7fc30409d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc304159330 0x7fc30409d260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc3000090b0 tx=0x7fc300017000 comp rx=0 tx=0).stop 2024-08-17T02:25:14.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 -- 172.21.15.31:0/2326175930 shutdown_connections 2024-08-17T02:25:14.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc2e8060860 0x7fc2e8062d10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc304159700 0x7fc3040ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc304159330 0x7fc30409d260 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 --2- 172.21.15.31:0/2326175930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3040b4340 0x7fc30409b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 -- 172.21.15.31:0/2326175930 >> 172.21.15.31:0/2326175930 conn(0x7fc304099610 msgr2=0x7fc3040aa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 -- 172.21.15.31:0/2326175930 shutdown_connections 2024-08-17T02:25:14.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.162+0000 7fc30c733700 1 -- 172.21.15.31:0/2326175930 wait complete. 2024-08-17T02:25:14.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:14.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 Processor -- start 2024-08-17T02:25:14.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 -- start start 2024-08-17T02:25:14.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f56841592f0 0x7f56840cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568415a780 con 0x7f56841596c0 2024-08-17T02:25:14.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568415ac10 con 0x7f56840cb6a0 2024-08-17T02:25:14.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5684159b70 con 0x7f56841592f0 2024-08-17T02:25:14.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f56895c1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f56841592f0 0x7f56840cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f5689dc2700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f56841596c0 0x7f56840ce240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55004/0 (socket says 172.21.15.31:55004) 2024-08-17T02:25:14.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f5689dc2700 1 -- 172.21.15.31:0/4207015955 learned_addr learned my addr 172.21.15.31:0/4207015955 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:14.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f56895c1700 1 -- 172.21.15.31:0/4207015955 >> v1:172.21.15.92:6789/0 conn(0x7f56840cb6a0 legacy=0x7f56840cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f56895c1700 1 -- 172.21.15.31:0/4207015955 >> v1:172.21.15.31:6789/0 conn(0x7f56841596c0 legacy=0x7f56840ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f567bfff700 1 -- 172.21.15.31:0/4207015955 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833295604 0 0) 0x7f568415a780 con 0x7f56841596c0 2024-08-17T02:25:14.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f56895c1700 1 -- 172.21.15.31:0/4207015955 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5684159e50 con 0x7f56841592f0 2024-08-17T02:25:14.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f56895c1700 1 --2- 172.21.15.31:0/4207015955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56841592f0 0x7f56840cb160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f56740098e0 tx=0x7f56740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df448f2a9f3dccf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f567bfff700 1 -- 172.21.15.31:0/4207015955 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674009e80 con 0x7f56841592f0 2024-08-17T02:25:14.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f567bfff700 1 -- 172.21.15.31:0/4207015955 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567400b860 con 0x7f56841592f0 2024-08-17T02:25:14.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f567bfff700 1 -- 172.21.15.31:0/4207015955 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567400bbe0 con 0x7f56841592f0 2024-08-17T02:25:14.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 -- 172.21.15.31:0/4207015955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56841592f0 msgr2=0x7f56840cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 --2- 172.21.15.31:0/4207015955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56841592f0 0x7f56840cb160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f56740098e0 tx=0x7f56740091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 -- 172.21.15.31:0/4207015955 shutdown_connections 2024-08-17T02:25:14.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 --2- 172.21.15.31:0/4207015955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56841592f0 0x7f56840cb160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 -- 172.21.15.31:0/4207015955 >> 172.21.15.31:0/4207015955 conn(0x7f5684067400 msgr2=0x7f5684067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 -- 172.21.15.31:0/4207015955 shutdown_connections 2024-08-17T02:25:14.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 -- 172.21.15.31:0/4207015955 wait complete. 2024-08-17T02:25:14.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 Processor -- start 2024-08-17T02:25:14.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.286+0000 7f568a5c3700 1 -- start start 2024-08-17T02:25:14.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f568a5c3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56841592f0 0x7f5684169890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f568a5c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56841596c0 0x7f5684155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f568a5c3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5684147a00 0x7f56840b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f568a5c3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5684169ee0 con 0x7f5684147a00 2024-08-17T02:25:14.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f568a5c3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568416a1c0 con 0x7f56841596c0 2024-08-17T02:25:14.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f568a5c3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568416a4a0 con 0x7f56841592f0 2024-08-17T02:25:14.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5689dc2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5684147a00 0x7f56840b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5689dc2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5684147a00 0x7f56840b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39814/0 (socket says 172.21.15.31:39814) 2024-08-17T02:25:14.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5689dc2700 1 -- 172.21.15.31:0/1912558485 learned_addr learned my addr 172.21.15.31:0/1912558485 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:14.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5688dc0700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56841596c0 0x7f5684155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f56895c1700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56841592f0 0x7f5684169890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5689dc2700 1 -- 172.21.15.31:0/1912558485 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56841592f0 msgr2=0x7f5684169890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5689dc2700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56841592f0 0x7f5684169890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5689dc2700 1 -- 172.21.15.31:0/1912558485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56841596c0 msgr2=0x7f5684155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5689dc2700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56841596c0 0x7f5684155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5689dc2700 1 -- 172.21.15.31:0/1912558485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5674009420 con 0x7f5684147a00 2024-08-17T02:25:14.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5688dc0700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56841596c0 0x7f5684155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:14.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f5689dc2700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5684147a00 0x7f56840b0c10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f567c0011e0 tx=0x7f567c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f56797fa700 1 -- 172.21.15.31:0/1912558485 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c005b30 con 0x7f5684147a00 2024-08-17T02:25:14.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f56797fa700 1 -- 172.21.15.31:0/1912558485 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c005c90 con 0x7f5684147a00 2024-08-17T02:25:14.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f568a5c3700 1 -- 172.21.15.31:0/1912558485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568416a780 con 0x7f5684147a00 2024-08-17T02:25:14.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f56797fa700 1 -- 172.21.15.31:0/1912558485 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c007320 con 0x7f5684147a00 2024-08-17T02:25:14.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.290+0000 7f568a5c3700 1 -- 172.21.15.31:0/1912558485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5684155ea0 con 0x7f5684147a00 2024-08-17T02:25:14.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.294+0000 7f568a5c3700 1 -- 172.21.15.31:0/1912558485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56840712b0 con 0x7f5684147a00 2024-08-17T02:25:14.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.294+0000 7f56797fa700 1 -- 172.21.15.31:0/1912558485 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f567c007690 con 0x7f5684147a00 2024-08-17T02:25:14.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.294+0000 7f56797fa700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5670060860 0x7f5670062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.294+0000 7f56797fa700 1 -- 172.21.15.31:0/1912558485 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f567c07c070 con 0x7f5684147a00 2024-08-17T02:25:14.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.294+0000 7f56895c1700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5670060860 0x7f5670062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.294+0000 7f56895c1700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5670060860 0x7f5670062d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f56740093f0 tx=0x7f5674017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.302+0000 7f56797fa700 1 -- 172.21.15.31:0/1912558485 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f567c04c430 con 0x7f5684147a00 2024-08-17T02:25:14.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.466+0000 7f568a5c3700 1 -- 172.21.15.31:0/1912558485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56840cfe40 con 0x7f5684147a00 2024-08-17T02:25:14.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.466+0000 7f56797fa700 1 -- 172.21.15.31:0/1912558485 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f567c04fa50 con 0x7f5684147a00 2024-08-17T02:25:14.472 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:25:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 -- 172.21.15.31:0/1912558485 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5670060860 msgr2=0x7f5670062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5670060860 0x7f5670062d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f56740093f0 tx=0x7f5674017000 comp rx=0 tx=0).stop 2024-08-17T02:25:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 -- 172.21.15.31:0/1912558485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5684147a00 msgr2=0x7f56840b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5684147a00 0x7f56840b0c10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f567c0011e0 tx=0x7f567c007d30 comp rx=0 tx=0).stop 2024-08-17T02:25:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 -- 172.21.15.31:0/1912558485 shutdown_connections 2024-08-17T02:25:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5670060860 0x7f5670062d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5684147a00 0x7f56840b0c10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56841596c0 0x7f5684155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 --2- 172.21.15.31:0/1912558485 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56841592f0 0x7f5684169890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 -- 172.21.15.31:0/1912558485 >> 172.21.15.31:0/1912558485 conn(0x7f5684067400 msgr2=0x7f5684154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 -- 172.21.15.31:0/1912558485 shutdown_connections 2024-08-17T02:25:14.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.470+0000 7f568a5c3700 1 -- 172.21.15.31:0/1912558485 wait complete. 2024-08-17T02:25:14.486 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:14.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04d075700 1 Processor -- start 2024-08-17T02:25:14.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04d075700 1 -- start start 2024-08-17T02:25:14.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04d075700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc048159700 0x7fc0480cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04d075700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0480b2a60 con 0x7fc0480b4340 2024-08-17T02:25:14.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04d075700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0480b11b0 con 0x7fc048159330 2024-08-17T02:25:14.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04d075700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0480b1490 con 0x7fc048159700 2024-08-17T02:25:14.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc0480b4340 0x7fc0480b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55006/0 (socket says 172.21.15.31:55006) 2024-08-17T02:25:14.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04659c700 1 -- 172.21.15.31:0/4013726653 learned_addr learned my addr 172.21.15.31:0/4013726653 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:14.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04759e700 1 --2- 172.21.15.31:0/4013726653 >> v2:172.21.15.92:3300/0 conn(0x7fc048159700 0x7fc0480cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc045d9b700 1 -- 172.21.15.31:0/4013726653 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103724289 0 0) 0x7fc0480b2a60 con 0x7fc0480b4340 2024-08-17T02:25:14.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc045d9b700 1 -- 172.21.15.31:0/4013726653 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc034003570 con 0x7fc0480b4340 2024-08-17T02:25:14.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04759e700 1 -- 172.21.15.31:0/4013726653 >> v1:172.21.15.92:6789/0 conn(0x7fc048159330 legacy=0x7fc0480b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04759e700 1 -- 172.21.15.31:0/4013726653 >> v1:172.21.15.31:6789/0 conn(0x7fc0480b4340 legacy=0x7fc0480b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04759e700 1 -- 172.21.15.31:0/4013726653 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480b1770 con 0x7fc048159700 2024-08-17T02:25:14.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.594+0000 7fc04759e700 1 --2- 172.21.15.31:0/4013726653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc048159700 0x7fc0480cf2d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc040009e60 tx=0x7fc040009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b425e46976d8c8f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc045d9b700 1 -- 172.21.15.31:0/4013726653 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04000e070 con 0x7fc048159700 2024-08-17T02:25:14.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc045d9b700 1 -- 172.21.15.31:0/4013726653 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04000bb60 con 0x7fc048159700 2024-08-17T02:25:14.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc045d9b700 1 -- 172.21.15.31:0/4013726653 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040012430 con 0x7fc048159700 2024-08-17T02:25:14.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc04d075700 1 -- 172.21.15.31:0/4013726653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc048159700 msgr2=0x7fc0480cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc04d075700 1 --2- 172.21.15.31:0/4013726653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc048159700 0x7fc0480cf2d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc040009e60 tx=0x7fc040009780 comp rx=0 tx=0).stop 2024-08-17T02:25:14.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc04d075700 1 -- 172.21.15.31:0/4013726653 shutdown_connections 2024-08-17T02:25:14.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc04d075700 1 --2- 172.21.15.31:0/4013726653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc048159700 0x7fc0480cf2d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc04d075700 1 -- 172.21.15.31:0/4013726653 >> 172.21.15.31:0/4013726653 conn(0x7fc048099610 msgr2=0x7fc048067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc04d075700 1 -- 172.21.15.31:0/4013726653 shutdown_connections 2024-08-17T02:25:14.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc04d075700 1 -- 172.21.15.31:0/4013726653 wait complete. 2024-08-17T02:25:14.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc04d075700 1 Processor -- start 2024-08-17T02:25:14.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.598+0000 7fc04d075700 1 -- start start 2024-08-17T02:25:14.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04d075700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0480b4340 0x7fc048147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04d075700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc048159330 0x7fc0481686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04d075700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc048159700 0x7fc048157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04d075700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04809ab90 con 0x7fc0480b4340 2024-08-17T02:25:14.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04d075700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc048099f80 con 0x7fc048159700 2024-08-17T02:25:14.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04d075700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04809a260 con 0x7fc048159330 2024-08-17T02:25:14.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc046d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0480b4340 0x7fc048147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc046d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0480b4340 0x7fc048147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39822/0 (socket says 172.21.15.31:39822) 2024-08-17T02:25:14.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc046d9d700 1 -- 172.21.15.31:0/664056494 learned_addr learned my addr 172.21.15.31:0/664056494 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:14.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04759e700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc048159700 0x7fc048157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04659c700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc048159330 0x7fc0481686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc046d9d700 1 -- 172.21.15.31:0/664056494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc048159330 msgr2=0x7fc0481686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc046d9d700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc048159330 0x7fc0481686d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc046d9d700 1 -- 172.21.15.31:0/664056494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc048159700 msgr2=0x7fc048157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc046d9d700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc048159700 0x7fc048157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc046d9d700 1 -- 172.21.15.31:0/664056494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc040009a20 con 0x7fc0480b4340 2024-08-17T02:25:14.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04759e700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc048159700 0x7fc048157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:14.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc046d9d700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0480b4340 0x7fc048147440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c590 tx=0x7fc03000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc03effd700 1 -- 172.21.15.31:0/664056494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030011590 con 0x7fc0480b4340 2024-08-17T02:25:14.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc03effd700 1 -- 172.21.15.31:0/664056494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0300116f0 con 0x7fc0480b4340 2024-08-17T02:25:14.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc03effd700 1 -- 172.21.15.31:0/664056494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030011ab0 con 0x7fc0480b4340 2024-08-17T02:25:14.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04d075700 1 -- 172.21.15.31:0/664056494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04809a540 con 0x7fc0480b4340 2024-08-17T02:25:14.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04d075700 1 -- 172.21.15.31:0/664056494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc048168c10 con 0x7fc0480b4340 2024-08-17T02:25:14.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.602+0000 7fc04d075700 1 -- 172.21.15.31:0/664056494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0480712b0 con 0x7fc0480b4340 2024-08-17T02:25:14.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.606+0000 7fc03effd700 1 -- 172.21.15.31:0/664056494 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc03001b3b0 con 0x7fc0480b4340 2024-08-17T02:25:14.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.606+0000 7fc03effd700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc028060860 0x7fc028062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.606+0000 7fc03effd700 1 -- 172.21.15.31:0/664056494 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc03007c1e0 con 0x7fc0480b4340 2024-08-17T02:25:14.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.606+0000 7fc04659c700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc028060860 0x7fc028062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.606+0000 7fc04659c700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc028060860 0x7fc028062d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc0480688c0 tx=0x7fc038009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.618+0000 7fc03effd700 1 -- 172.21.15.31:0/664056494 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc03004c630 con 0x7fc0480b4340 2024-08-17T02:25:14.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.782+0000 7fc04d075700 1 -- 172.21.15.31:0/664056494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc04806f8c0 con 0x7fc0480b4340 2024-08-17T02:25:14.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.782+0000 7fc03effd700 1 -- 172.21.15.31:0/664056494 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0300170a0 con 0x7fc0480b4340 2024-08-17T02:25:14.789 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 -- 172.21.15.31:0/664056494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc028060860 msgr2=0x7fc028062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc028060860 0x7fc028062d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc0480688c0 tx=0x7fc038009040 comp rx=0 tx=0).stop 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 -- 172.21.15.31:0/664056494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0480b4340 msgr2=0x7fc048147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0480b4340 0x7fc048147440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c590 tx=0x7fc03000c950 comp rx=0 tx=0).stop 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 -- 172.21.15.31:0/664056494 shutdown_connections 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc028060860 0x7fc028062d10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc048159700 0x7fc048157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc048159330 0x7fc0481686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 --2- 172.21.15.31:0/664056494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0480b4340 0x7fc048147440 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 -- 172.21.15.31:0/664056494 >> 172.21.15.31:0/664056494 conn(0x7fc048099610 msgr2=0x7fc04815c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 -- 172.21.15.31:0/664056494 shutdown_connections 2024-08-17T02:25:14.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.786+0000 7fc04d075700 1 -- 172.21.15.31:0/664056494 wait complete. 2024-08-17T02:25:14.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:14.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aee1f5700 1 Processor -- start 2024-08-17T02:25:14.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aee1f5700 1 -- start start 2024-08-17T02:25:14.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aee1f5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6ae8140780 0x7f6ae8140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aee1f5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ae80b0fe0 0x7f6ae80b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aee1f5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae80ca7c0 con 0x7f6ae80c9c30 2024-08-17T02:25:14.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aee1f5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80b1970 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aee1f5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80ab690 con 0x7f6ae8140780 2024-08-17T02:25:14.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aec9f2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ae80b0fe0 0x7f6ae80b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aed9f4700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6ae80c9c30 0x7f6ae80ca0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55022/0 (socket says 172.21.15.31:55022) 2024-08-17T02:25:14.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aed9f4700 1 -- 172.21.15.31:0/2661718240 learned_addr learned my addr 172.21.15.31:0/2661718240 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:14.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aed1f3700 1 --2- 172.21.15.31:0/2661718240 >> v2:172.21.15.92:3300/0 conn(0x7f6ae8140780 0x7f6ae8140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aec9f2700 1 -- 172.21.15.31:0/2661718240 >> v2:172.21.15.92:3300/0 conn(0x7f6ae8140780 msgr2=0x7f6ae8140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:14.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aec9f2700 1 --2- 172.21.15.31:0/2661718240 >> v2:172.21.15.92:3300/0 conn(0x7f6ae8140780 0x7f6ae8140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aec9f2700 1 -- 172.21.15.31:0/2661718240 >> v1:172.21.15.31:6789/0 conn(0x7f6ae80c9c30 legacy=0x7f6ae80ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aec9f2700 1 -- 172.21.15.31:0/2661718240 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae80caa00 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.906+0000 7f6aec9f2700 1 --2- 172.21.15.31:0/2661718240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 0x7f6ae80b1430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80cce30 tx=0x7f6ae40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47cdd7d7171f4b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6adffff700 1 -- 172.21.15.31:0/2661718240 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4011630 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6adffff700 1 -- 172.21.15.31:0/2661718240 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4011790 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6adffff700 1 -- 172.21.15.31:0/2661718240 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4011b30 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2661718240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 msgr2=0x7f6ae80b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 --2- 172.21.15.31:0/2661718240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 0x7f6ae80b1430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80cce30 tx=0x7f6ae40091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2661718240 shutdown_connections 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 --2- 172.21.15.31:0/2661718240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 0x7f6ae80b1430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 --2- 172.21.15.31:0/2661718240 >> v2:172.21.15.92:3300/0 conn(0x7f6ae8140780 0x7f6ae8140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2661718240 >> 172.21.15.31:0/2661718240 conn(0x7f6ae8067400 msgr2=0x7f6ae8067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2661718240 shutdown_connections 2024-08-17T02:25:14.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2661718240 wait complete. 2024-08-17T02:25:14.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 Processor -- start 2024-08-17T02:25:14.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 -- start start 2024-08-17T02:25:14.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 0x7f6ae816b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ae80c9c30 0x7f6ae81564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae8140780 0x7f6ae80acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae816b6f0 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81578d0 con 0x7f6ae8140780 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aee1f5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae8158730 con 0x7f6ae80c9c30 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aed1f3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 0x7f6ae816b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.910+0000 7f6aed1f3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 0x7f6ae816b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39842/0 (socket says 172.21.15.31:39842) 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aed1f3700 1 -- 172.21.15.31:0/2706544333 learned_addr learned my addr 172.21.15.31:0/2706544333 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aec9f2700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ae80c9c30 0x7f6ae81564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aed9f4700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae8140780 0x7f6ae80acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aed1f3700 1 -- 172.21.15.31:0/2706544333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ae80c9c30 msgr2=0x7f6ae81564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aed1f3700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ae80c9c30 0x7f6ae81564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aed1f3700 1 -- 172.21.15.31:0/2706544333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae8140780 msgr2=0x7f6ae80acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aed1f3700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae8140780 0x7f6ae80acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aed1f3700 1 -- 172.21.15.31:0/2706544333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4009420 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aed1f3700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 0x7f6ae816b1b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800e930 tx=0x7f6ad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6add7fa700 1 -- 172.21.15.31:0/2706544333 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800eed0 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6add7fa700 1 -- 172.21.15.31:0/2706544333 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad800c850 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2706544333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae8157b20 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6add7fa700 1 -- 172.21.15.31:0/2706544333 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800cbf0 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2706544333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae81580e0 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2706544333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae80712b0 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.914+0000 7f6add7fa700 1 -- 172.21.15.31:0/2706544333 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6ad8013470 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.918+0000 7f6add7fa700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060890 0x7f6acc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.918+0000 7f6add7fa700 1 -- 172.21.15.31:0/2706544333 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ad807cdb0 con 0x7f6ae80b0fe0 2024-08-17T02:25:14.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.918+0000 7f6aec9f2700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060890 0x7f6acc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.918+0000 7f6aec9f2700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060890 0x7f6acc062d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40093f0 tx=0x7f6ae4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:14.922+0000 7f6add7fa700 1 -- 172.21.15.31:0/2706544333 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6ad804d200 con 0x7f6ae80b0fe0 2024-08-17T02:25:15.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.086+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2706544333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ae80ae5b0 con 0x7f6ae80b0fe0 2024-08-17T02:25:15.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.090+0000 7f6add7fa700 1 -- 172.21.15.31:0/2706544333 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f6ad8050820 con 0x7f6ae80b0fe0 2024-08-17T02:25:15.096 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:15.096 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2706544333 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060890 msgr2=0x7f6acc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060890 0x7f6acc062d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40093f0 tx=0x7f6ae4017000 comp rx=0 tx=0).stop 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2706544333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 msgr2=0x7f6ae816b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 0x7f6ae816b1b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800e930 tx=0x7f6ad80091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2706544333 shutdown_connections 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060890 0x7f6acc062d40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae8140780 0x7f6ae80acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ae80c9c30 0x7f6ae81564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 --2- 172.21.15.31:0/2706544333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80b0fe0 0x7f6ae816b1b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2706544333 >> 172.21.15.31:0/2706544333 conn(0x7f6ae8067400 msgr2=0x7f6ae8068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2706544333 shutdown_connections 2024-08-17T02:25:15.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.098+0000 7f6aee1f5700 1 -- 172.21.15.31:0/2706544333 wait complete. 2024-08-17T02:25:15.114 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:43.691230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:45.035480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:15.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:15.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 Processor -- start 2024-08-17T02:25:15.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 -- start start 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d8806f180 0x7f3d880aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d880c9860 con 0x7f3d88157160 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8815b4b0 con 0x7f3d88157530 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880b1530 con 0x7f3d8806f180 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8c983700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3d88157160 0x7f3d880b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55032/0 (socket says 172.21.15.31:55032) 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8c983700 1 -- 172.21.15.31:0/4003875433 learned_addr learned my addr 172.21.15.31:0/4003875433 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d87fff700 1 --2- 172.21.15.31:0/4003875433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d8806f180 0x7f3d880aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d877fe700 1 -- 172.21.15.31:0/4003875433 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101723924 0 0) 0x7f3d880c9860 con 0x7f3d88157160 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d877fe700 1 -- 172.21.15.31:0/4003875433 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d70003570 con 0x7f3d88157160 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d87fff700 1 -- 172.21.15.31:0/4003875433 >> v1:172.21.15.92:6789/0 conn(0x7f3d88157530 legacy=0x7f3d880c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d877fe700 1 -- 172.21.15.31:0/4003875433 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660314428 0 0) 0x7f3d8815b4b0 con 0x7f3d88157530 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d87fff700 1 -- 172.21.15.31:0/4003875433 >> v1:172.21.15.31:6789/0 conn(0x7f3d88157160 legacy=0x7f3d880b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d87fff700 1 -- 172.21.15.31:0/4003875433 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8815b790 con 0x7f3d8806f180 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d87fff700 1 --2- 172.21.15.31:0/4003875433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d8806f180 0x7f3d880aed30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009910 tx=0x7f3d780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec013780d80f73 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d877fe700 1 -- 172.21.15.31:0/4003875433 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c001470 con 0x7f3d8806f180 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d877fe700 1 -- 172.21.15.31:0/4003875433 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78011420 con 0x7f3d8806f180 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d877fe700 1 -- 172.21.15.31:0/4003875433 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780117a0 con 0x7f3d8806f180 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/4003875433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d8806f180 msgr2=0x7f3d880aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 --2- 172.21.15.31:0/4003875433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d8806f180 0x7f3d880aed30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009910 tx=0x7f3d780091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/4003875433 shutdown_connections 2024-08-17T02:25:15.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 --2- 172.21.15.31:0/4003875433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d8806f180 0x7f3d880aed30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/4003875433 >> 172.21.15.31:0/4003875433 conn(0x7f3d88068510 msgr2=0x7f3d880688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/4003875433 shutdown_connections 2024-08-17T02:25:15.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.222+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/4003875433 wait complete. 2024-08-17T02:25:15.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 Processor -- start 2024-08-17T02:25:15.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 -- start start 2024-08-17T02:25:15.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8806f180 0x7f3d8815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d88157160 0x7f3d8815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d88157530 0x7f3d88148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880cd5b0 con 0x7f3d88157160 2024-08-17T02:25:15.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88149160 con 0x7f3d8806f180 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880cc510 con 0x7f3d88157530 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d87fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d88157160 0x7f3d8815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d87fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d88157160 0x7f3d8815cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39850/0 (socket says 172.21.15.31:39850) 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d87fff700 1 -- 172.21.15.31:0/3202022713 learned_addr learned my addr 172.21.15.31:0/3202022713 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8c983700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8806f180 0x7f3d8815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8d184700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d88157530 0x7f3d88148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d87fff700 1 -- 172.21.15.31:0/3202022713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d88157530 msgr2=0x7f3d88148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d87fff700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d88157530 0x7f3d88148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d87fff700 1 -- 172.21.15.31:0/3202022713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8806f180 msgr2=0x7f3d8815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d87fff700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8806f180 0x7f3d8815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d87fff700 1 -- 172.21.15.31:0/3202022713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d78009420 con 0x7f3d88157160 2024-08-17T02:25:15.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8d184700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d88157530 0x7f3d88148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:15.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d87fff700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d88157160 0x7f3d8815cc90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d78002000 tx=0x7f3d78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d84ff9700 1 -- 172.21.15.31:0/3202022713 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78010b30 con 0x7f3d88157160 2024-08-17T02:25:15.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d84ff9700 1 -- 172.21.15.31:0/3202022713 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78010c90 con 0x7f3d88157160 2024-08-17T02:25:15.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d84ff9700 1 -- 172.21.15.31:0/3202022713 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7801d640 con 0x7f3d88157160 2024-08-17T02:25:15.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/3202022713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d880cc7f0 con 0x7f3d88157160 2024-08-17T02:25:15.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/3202022713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d880ccdb0 con 0x7f3d88157160 2024-08-17T02:25:15.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/3202022713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d880712b0 con 0x7f3d88157160 2024-08-17T02:25:15.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d84ff9700 1 -- 172.21.15.31:0/3202022713 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3d7801d9f0 con 0x7f3d88157160 2024-08-17T02:25:15.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d84ff9700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3d74060860 0x7f3d74062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d84ff9700 1 -- 172.21.15.31:0/3202022713 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d7807e910 con 0x7f3d88157160 2024-08-17T02:25:15.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8c983700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3d74060860 0x7f3d74062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.230+0000 7f3d8c983700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3d74060860 0x7f3d74062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0015a0 tx=0x7f3d7c000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.238+0000 7f3d84ff9700 1 -- 172.21.15.31:0/3202022713 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3d7804ed60 con 0x7f3d88157160 2024-08-17T02:25:15.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.402+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/3202022713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d880af990 con 0x7f3d88157160 2024-08-17T02:25:15.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.402+0000 7f3d84ff9700 1 -- 172.21.15.31:0/3202022713 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d780210a0 con 0x7f3d88157160 2024-08-17T02:25:15.410 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:25:15.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/3202022713 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3d74060860 msgr2=0x7f3d74062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3d74060860 0x7f3d74062d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0015a0 tx=0x7f3d7c000bc0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/3202022713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d88157160 msgr2=0x7f3d8815cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d88157160 0x7f3d8815cc90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d78002000 tx=0x7f3d78017000 comp rx=0 tx=0).stop 2024-08-17T02:25:15.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/3202022713 shutdown_connections 2024-08-17T02:25:15.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3d74060860 0x7f3d74062d10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d88157530 0x7f3d88148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d88157160 0x7f3d8815cc90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 --2- 172.21.15.31:0/3202022713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8806f180 0x7f3d8815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/3202022713 >> 172.21.15.31:0/3202022713 conn(0x7f3d88068510 msgr2=0x7f3d880b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/3202022713 shutdown_connections 2024-08-17T02:25:15.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.406+0000 7f3d8ebe7700 1 -- 172.21.15.31:0/3202022713 wait complete. 2024-08-17T02:25:15.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:15.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 Processor -- start 2024-08-17T02:25:15.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 -- start start 2024-08-17T02:25:15.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8934159470 0x7f8934159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8934068000 0x7f89340c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89340cf2f0 con 0x7f89340c62f0 2024-08-17T02:25:15.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89340cf5d0 con 0x7f8934068000 2024-08-17T02:25:15.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89340c52d0 con 0x7f8934159470 2024-08-17T02:25:15.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f89327fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8934068000 0x7f89340c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f89337fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f89340c62f0 0x7f89340cb130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55034/0 (socket says 172.21.15.31:55034) 2024-08-17T02:25:15.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f89327fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8934068000 0x7f89340c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39860/0 (socket says 172.21.15.31:39860) 2024-08-17T02:25:15.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f89337fe700 1 -- 172.21.15.31:0/3080142389 learned_addr learned my addr 172.21.15.31:0/3080142389 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:15.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f8932ffd700 1 --2- 172.21.15.31:0/3080142389 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8934159470 0x7f8934159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f89327fc700 1 -- 172.21.15.31:0/3080142389 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8934159470 msgr2=0x7f8934159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:15.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f8931ffb700 1 -- 172.21.15.31:0/3080142389 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129316334 0 0) 0x7f89340cf2f0 con 0x7f89340c62f0 2024-08-17T02:25:15.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f89327fc700 1 --2- 172.21.15.31:0/3080142389 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8934159470 0x7f8934159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f89327fc700 1 -- 172.21.15.31:0/3080142389 >> v1:172.21.15.31:6789/0 conn(0x7f89340c62f0 legacy=0x7f89340cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f89327fc700 1 -- 172.21.15.31:0/3080142389 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89340c55b0 con 0x7f8934068000 2024-08-17T02:25:15.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f89327fc700 1 --2- 172.21.15.31:0/3080142389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 0x7f89340c5db0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f89240098e0 tx=0x7f89240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03c95ba72247960 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f8931ffb700 1 -- 172.21.15.31:0/3080142389 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400b640 con 0x7f8934068000 2024-08-17T02:25:15.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f8931ffb700 1 -- 172.21.15.31:0/3080142389 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892400b7a0 con 0x7f8934068000 2024-08-17T02:25:15.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f8931ffb700 1 -- 172.21.15.31:0/3080142389 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400bb40 con 0x7f8934068000 2024-08-17T02:25:15.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 -- 172.21.15.31:0/3080142389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 msgr2=0x7f89340c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 --2- 172.21.15.31:0/3080142389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 0x7f89340c5db0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f89240098e0 tx=0x7f89240091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 -- 172.21.15.31:0/3080142389 shutdown_connections 2024-08-17T02:25:15.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 --2- 172.21.15.31:0/3080142389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 0x7f89340c5db0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 --2- 172.21.15.31:0/3080142389 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8934159470 0x7f8934159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 -- 172.21.15.31:0/3080142389 >> 172.21.15.31:0/3080142389 conn(0x7f8934067b90 msgr2=0x7f89340d0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 -- 172.21.15.31:0/3080142389 shutdown_connections 2024-08-17T02:25:15.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.538+0000 7f893970c700 1 -- 172.21.15.31:0/3080142389 wait complete. 2024-08-17T02:25:15.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f893970c700 1 Processor -- start 2024-08-17T02:25:15.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f893970c700 1 -- start start 2024-08-17T02:25:15.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f893970c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 0x7f893409a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f893970c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340c62f0 0x7f8934158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f893970c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8934159470 0x7f893414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f893970c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893409af50 con 0x7f8934068000 2024-08-17T02:25:15.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f893970c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893409c900 con 0x7f89340c62f0 2024-08-17T02:25:15.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f893970c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893409cbe0 con 0x7f8934159470 2024-08-17T02:25:15.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f8932ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 0x7f893409a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f8932ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 0x7f893409a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39864/0 (socket says 172.21.15.31:39864) 2024-08-17T02:25:15.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f8932ffd700 1 -- 172.21.15.31:0/1531783850 learned_addr learned my addr 172.21.15.31:0/1531783850 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:15.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f89337fe700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8934159470 0x7f893414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f89327fc700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340c62f0 0x7f8934158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f8932ffd700 1 -- 172.21.15.31:0/1531783850 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8934159470 msgr2=0x7f893414d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f8932ffd700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8934159470 0x7f893414d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f8932ffd700 1 -- 172.21.15.31:0/1531783850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340c62f0 msgr2=0x7f8934158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f8932ffd700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340c62f0 0x7f8934158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f8932ffd700 1 -- 172.21.15.31:0/1531783850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8924009420 con 0x7f8934068000 2024-08-17T02:25:15.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f8932ffd700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 0x7f893409a720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f892800e930 tx=0x7f89280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f891affd700 1 -- 172.21.15.31:0/1531783850 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928013680 con 0x7f8934068000 2024-08-17T02:25:15.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f891affd700 1 -- 172.21.15.31:0/1531783850 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89280137e0 con 0x7f8934068000 2024-08-17T02:25:15.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f893970c700 1 -- 172.21.15.31:0/1531783850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893409cec0 con 0x7f8934068000 2024-08-17T02:25:15.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f891affd700 1 -- 172.21.15.31:0/1531783850 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928013b80 con 0x7f8934068000 2024-08-17T02:25:15.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.542+0000 7f893970c700 1 -- 172.21.15.31:0/1531783850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893409c5d0 con 0x7f8934068000 2024-08-17T02:25:15.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.546+0000 7f893970c700 1 -- 172.21.15.31:0/1531783850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89340712b0 con 0x7f8934068000 2024-08-17T02:25:15.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.546+0000 7f891affd700 1 -- 172.21.15.31:0/1531783850 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f892800c3e0 con 0x7f8934068000 2024-08-17T02:25:15.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.546+0000 7f891affd700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8920060860 0x7f8920062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.546+0000 7f891affd700 1 -- 172.21.15.31:0/1531783850 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f892807cc60 con 0x7f8934068000 2024-08-17T02:25:15.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.546+0000 7f89327fc700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8920060860 0x7f8920062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.546+0000 7f89327fc700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8920060860 0x7f8920062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89240093f0 tx=0x7f8924017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.554+0000 7f891affd700 1 -- 172.21.15.31:0/1531783850 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f892804d0b0 con 0x7f8934068000 2024-08-17T02:25:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.722+0000 7f893970c700 1 -- 172.21.15.31:0/1531783850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8934089f10 con 0x7f8934068000 2024-08-17T02:25:15.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.722+0000 7f891affd700 1 -- 172.21.15.31:0/1531783850 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f89280506d0 con 0x7f8934068000 2024-08-17T02:25:15.730 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:25:15.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 -- 172.21.15.31:0/1531783850 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8920060860 msgr2=0x7f8920062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8920060860 0x7f8920062d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89240093f0 tx=0x7f8924017000 comp rx=0 tx=0).stop 2024-08-17T02:25:15.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 -- 172.21.15.31:0/1531783850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 msgr2=0x7f893409a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 0x7f893409a720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f892800e930 tx=0x7f89280091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 -- 172.21.15.31:0/1531783850 shutdown_connections 2024-08-17T02:25:15.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8920060860 0x7f8920062d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8934159470 0x7f893414d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89340c62f0 0x7f8934158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 --2- 172.21.15.31:0/1531783850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8934068000 0x7f893409a720 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 -- 172.21.15.31:0/1531783850 >> 172.21.15.31:0/1531783850 conn(0x7f8934067b90 msgr2=0x7f8934069660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 -- 172.21.15.31:0/1531783850 shutdown_connections 2024-08-17T02:25:15.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.726+0000 7f893970c700 1 -- 172.21.15.31:0/1531783850 wait complete. 2024-08-17T02:25:15.744 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:15.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.854+0000 7f5af8a30700 1 Processor -- start 2024-08-17T02:25:15.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.854+0000 7f5af8a30700 1 -- start start 2024-08-17T02:25:15.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af8a30700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5af4156d60 0x7f5af4067b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af8a30700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af4068850 0x7f5af40c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af8a30700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af4067400 con 0x7f5af40c8bf0 2024-08-17T02:25:15.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af8a30700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af406ea10 con 0x7f5af4156d60 2024-08-17T02:25:15.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af8a30700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af406ecf0 con 0x7f5af4068850 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af2d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5af4156d60 0x7f5af4067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af259c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af4068850 0x7f5af40c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af359e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5af40c8bf0 0x7f5af4157130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:58294/0 (socket says 172.21.15.31:58294) 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af2d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5af4156d60 0x7f5af4067b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36260/0 (socket says 172.21.15.31:36260) 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af359e700 1 -- 172.21.15.31:0/4006673098 learned_addr learned my addr 172.21.15.31:0/4006673098 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af2d9d700 1 -- 172.21.15.31:0/4006673098 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af4068850 msgr2=0x7f5af40c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af2d9d700 1 --2- 172.21.15.31:0/4006673098 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af4068850 0x7f5af40c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af2d9d700 1 -- 172.21.15.31:0/4006673098 >> v1:172.21.15.92:6789/0 conn(0x7f5af40c8bf0 legacy=0x7f5af4157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af2d9d700 1 -- 172.21.15.31:0/4006673098 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af406efd0 con 0x7f5af4156d60 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af1d9b700 1 -- 172.21.15.31:0/4006673098 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988444845 0 0) 0x7f5af4067400 con 0x7f5af40c8bf0 2024-08-17T02:25:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af259c700 1 --2- 172.21.15.31:0/4006673098 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af4068850 0x7f5af40c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:15.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af2d9d700 1 --2- 172.21.15.31:0/4006673098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4156d60 0x7f5af4067b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40098e0 tx=0x7f5ae40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d07a4042d25d15c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af1d9b700 1 -- 172.21.15.31:0/4006673098 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400b640 con 0x7f5af4156d60 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af1d9b700 1 -- 172.21.15.31:0/4006673098 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae400b7a0 con 0x7f5af4156d60 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.858+0000 7f5af1d9b700 1 -- 172.21.15.31:0/4006673098 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400bb40 con 0x7f5af4156d60 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.862+0000 7f5af8a30700 1 -- 172.21.15.31:0/4006673098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4156d60 msgr2=0x7f5af4067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.862+0000 7f5af8a30700 1 --2- 172.21.15.31:0/4006673098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4156d60 0x7f5af4067b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40098e0 tx=0x7f5ae40091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.862+0000 7f5af8a30700 1 -- 172.21.15.31:0/4006673098 shutdown_connections 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.862+0000 7f5af8a30700 1 --2- 172.21.15.31:0/4006673098 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af4068850 0x7f5af40c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.862+0000 7f5af8a30700 1 --2- 172.21.15.31:0/4006673098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4156d60 0x7f5af4067b70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.862+0000 7f5af8a30700 1 -- 172.21.15.31:0/4006673098 >> 172.21.15.31:0/4006673098 conn(0x7f5af406bbb0 msgr2=0x7f5af40b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.862+0000 7f5af8a30700 1 -- 172.21.15.31:0/4006673098 shutdown_connections 2024-08-17T02:25:15.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.862+0000 7f5af8a30700 1 -- 172.21.15.31:0/4006673098 wait complete. 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.862+0000 7f5af8a30700 1 Processor -- start 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.862+0000 7f5af8a30700 1 -- start start 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af8a30700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4068850 0x7f5af4152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af8a30700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af40c8bf0 0x7f5af414d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af8a30700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4156d60 0x7f5af414de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af8a30700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4167990 con 0x7f5af4156d60 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af8a30700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af414ad90 con 0x7f5af4068850 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af8a30700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af414f0b0 con 0x7f5af40c8bf0 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4156d60 0x7f5af414de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4156d60 0x7f5af414de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39876/0 (socket says 172.21.15.31:39876) 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af359e700 1 -- 172.21.15.31:0/262080309 learned_addr learned my addr 172.21.15.31:0/262080309 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:15.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af259c700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af40c8bf0 0x7f5af414d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af2d9d700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4068850 0x7f5af4152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af359e700 1 -- 172.21.15.31:0/262080309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af40c8bf0 msgr2=0x7f5af414d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af359e700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af40c8bf0 0x7f5af414d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af359e700 1 -- 172.21.15.31:0/262080309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4068850 msgr2=0x7f5af4152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af359e700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4068850 0x7f5af4152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af359e700 1 -- 172.21.15.31:0/262080309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc009420 con 0x7f5af4156d60 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af359e700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4156d60 0x7f5af414de20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00cc90 tx=0x7f5aec001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5aeaffd700 1 -- 172.21.15.31:0/262080309 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00a850 con 0x7f5af4156d60 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5aeaffd700 1 -- 172.21.15.31:0/262080309 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec00a9b0 con 0x7f5af4156d60 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af8a30700 1 -- 172.21.15.31:0/262080309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae4009420 con 0x7f5af4156d60 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5af8a30700 1 -- 172.21.15.31:0/262080309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af414e550 con 0x7f5af4156d60 2024-08-17T02:25:15.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.866+0000 7f5aeaffd700 1 -- 172.21.15.31:0/262080309 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00ad70 con 0x7f5af4156d60 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.870+0000 7f5aeaffd700 1 -- 172.21.15.31:0/262080309 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5aec007300 con 0x7f5af4156d60 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.870+0000 7f5aeaffd700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5ad4060860 0x7f5ad4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.870+0000 7f5af8a30700 1 -- 172.21.15.31:0/262080309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af414f220 con 0x7f5af4156d60 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.870+0000 7f5af2d9d700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5ad4060860 0x7f5ad4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.870+0000 7f5aeaffd700 1 -- 172.21.15.31:0/262080309 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5aec07cf20 con 0x7f5af4156d60 2024-08-17T02:25:15.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.870+0000 7f5af2d9d700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5ad4060860 0x7f5ad4062d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40093f0 tx=0x7f5ae4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:15.878+0000 7f5aeaffd700 1 -- 172.21.15.31:0/262080309 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5aec04d370 con 0x7f5af4156d60 2024-08-17T02:25:16.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.042+0000 7f5af8a30700 1 -- 172.21.15.31:0/262080309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5af40712b0 con 0x7f5af4156d60 2024-08-17T02:25:16.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5aeaffd700 1 -- 172.21.15.31:0/262080309 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5aec050990 con 0x7f5af4156d60 2024-08-17T02:25:16.046 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-08-17T02:25:16.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 -- 172.21.15.31:0/262080309 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5ad4060860 msgr2=0x7f5ad4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5ad4060860 0x7f5ad4062d10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40093f0 tx=0x7f5ae4017000 comp rx=0 tx=0).stop 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 -- 172.21.15.31:0/262080309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4156d60 msgr2=0x7f5af414de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4156d60 0x7f5af414de20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00cc90 tx=0x7f5aec001a80 comp rx=0 tx=0).stop 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 -- 172.21.15.31:0/262080309 shutdown_connections 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5ad4060860 0x7f5ad4062d10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5af4156d60 0x7f5af414de20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5af40c8bf0 0x7f5af414d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 --2- 172.21.15.31:0/262080309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5af4068850 0x7f5af4152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 -- 172.21.15.31:0/262080309 >> 172.21.15.31:0/262080309 conn(0x7f5af406bbb0 msgr2=0x7f5af40b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 -- 172.21.15.31:0/262080309 shutdown_connections 2024-08-17T02:25:16.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.046+0000 7f5af8a30700 1 -- 172.21.15.31:0/262080309 wait complete. 2024-08-17T02:25:16.061 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:16.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.166+0000 7f459b46c700 1 Processor -- start 2024-08-17T02:25:16.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.166+0000 7f459b46c700 1 -- start start 2024-08-17T02:25:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.166+0000 7f459b46c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f459415ce20 0x7f459415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.166+0000 7f459b46c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45940ad6f0 0x7f45940adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.166+0000 7f459b46c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459415b2b0 con 0x7f4594159830 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.166+0000 7f459b46c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45940ae410 con 0x7f459415ce20 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.166+0000 7f459b46c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459415aca0 con 0x7f45940ad6f0 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.166+0000 7f4599c69700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45940ad6f0 0x7f45940adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.166+0000 7f459a46a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f459415ce20 0x7f459415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f4599c69700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45940ad6f0 0x7f45940adae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:56306/0 (socket says 172.21.15.31:56306) 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f4599c69700 1 -- 172.21.15.31:0/416444515 learned_addr learned my addr 172.21.15.31:0/416444515 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f459ac6b700 1 --1- 172.21.15.31:0/416444515 >> v1:172.21.15.92:6789/0 conn(0x7f4594159830 0x7f4594159cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:58296/0 (socket says 172.21.15.31:58296) 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f4599c69700 1 -- 172.21.15.31:0/416444515 >> v2:172.21.15.92:3300/0 conn(0x7f459415ce20 msgr2=0x7f459415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f4599c69700 1 --2- 172.21.15.31:0/416444515 >> v2:172.21.15.92:3300/0 conn(0x7f459415ce20 0x7f459415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f4599c69700 1 -- 172.21.15.31:0/416444515 >> v1:172.21.15.92:6789/0 conn(0x7f4594159830 legacy=0x7f4594159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f4599c69700 1 -- 172.21.15.31:0/416444515 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459415d730 con 0x7f45940ad6f0 2024-08-17T02:25:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f4599c69700 1 --2- 172.21.15.31:0/416444515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45940ad6f0 0x7f45940adae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45900099b0 tx=0x7f4590009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6d65adfea7baa5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f4599468700 1 -- 172.21.15.31:0/416444515 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590009ea0 con 0x7f45940ad6f0 2024-08-17T02:25:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f4599468700 1 -- 172.21.15.31:0/416444515 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459000b860 con 0x7f45940ad6f0 2024-08-17T02:25:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f4599468700 1 -- 172.21.15.31:0/416444515 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459000bc00 con 0x7f45940ad6f0 2024-08-17T02:25:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f459b46c700 1 -- 172.21.15.31:0/416444515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45940ad6f0 msgr2=0x7f45940adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f459b46c700 1 --2- 172.21.15.31:0/416444515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45940ad6f0 0x7f45940adae0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45900099b0 tx=0x7f4590009250 comp rx=0 tx=0).stop 2024-08-17T02:25:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f459b46c700 1 -- 172.21.15.31:0/416444515 shutdown_connections 2024-08-17T02:25:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f459b46c700 1 --2- 172.21.15.31:0/416444515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45940ad6f0 0x7f45940adae0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f459b46c700 1 --2- 172.21.15.31:0/416444515 >> v2:172.21.15.92:3300/0 conn(0x7f459415ce20 0x7f459415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f459b46c700 1 -- 172.21.15.31:0/416444515 >> 172.21.15.31:0/416444515 conn(0x7f4594089cb0 msgr2=0x7f45940995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f459b46c700 1 -- 172.21.15.31:0/416444515 shutdown_connections 2024-08-17T02:25:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.170+0000 7f459b46c700 1 -- 172.21.15.31:0/416444515 wait complete. 2024-08-17T02:25:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459b46c700 1 Processor -- start 2024-08-17T02:25:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459b46c700 1 -- start start 2024-08-17T02:25:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459b46c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45940ad6f0 0x7f45940ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459b46c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4594159830 0x7f4594152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459b46c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f459415ce20 0x7f4594150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459b46c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940cf810 con 0x7f4594159830 2024-08-17T02:25:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459b46c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940cf530 con 0x7f45940ad6f0 2024-08-17T02:25:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459b46c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45940cc9c0 con 0x7f459415ce20 2024-08-17T02:25:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f4599c69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4594159830 0x7f4594152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f4599c69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4594159830 0x7f4594152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39888/0 (socket says 172.21.15.31:39888) 2024-08-17T02:25:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f4599c69700 1 -- 172.21.15.31:0/4106754645 learned_addr learned my addr 172.21.15.31:0/4106754645 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459a46a700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45940ad6f0 0x7f45940ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459ac6b700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f459415ce20 0x7f4594150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f4599c69700 1 -- 172.21.15.31:0/4106754645 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f459415ce20 msgr2=0x7f4594150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f4599c69700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f459415ce20 0x7f4594150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f4599c69700 1 -- 172.21.15.31:0/4106754645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45940ad6f0 msgr2=0x7f45940ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f4599c69700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45940ad6f0 0x7f45940ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f4599c69700 1 -- 172.21.15.31:0/4106754645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900094f0 con 0x7f4594159830 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459a46a700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45940ad6f0 0x7f45940ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f4599c69700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4594159830 0x7f4594152840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f459408a990 tx=0x7f4590017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f458a7fc700 1 -- 172.21.15.31:0/4106754645 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459000bbe0 con 0x7f4594159830 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f458a7fc700 1 -- 172.21.15.31:0/4106754645 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4590011420 con 0x7f4594159830 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459b46c700 1 -- 172.21.15.31:0/4106754645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45940ccca0 con 0x7f4594159830 2024-08-17T02:25:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f458a7fc700 1 -- 172.21.15.31:0/4106754645 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45900117c0 con 0x7f4594159830 2024-08-17T02:25:16.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.174+0000 7f459b46c700 1 -- 172.21.15.31:0/4106754645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45940cf150 con 0x7f4594159830 2024-08-17T02:25:16.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.178+0000 7f459b46c700 1 -- 172.21.15.31:0/4106754645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45940712b0 con 0x7f4594159830 2024-08-17T02:25:16.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.178+0000 7f458a7fc700 1 -- 172.21.15.31:0/4106754645 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4590011bf0 con 0x7f4594159830 2024-08-17T02:25:16.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.178+0000 7f458a7fc700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4578060890 0x7f4578062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.178+0000 7f458a7fc700 1 -- 172.21.15.31:0/4106754645 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f459007e460 con 0x7f4594159830 2024-08-17T02:25:16.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.178+0000 7f459a46a700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4578060890 0x7f4578062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.178+0000 7f459a46a700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4578060890 0x7f4578062d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4584009d80 tx=0x7f4584008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.182+0000 7f458a7fc700 1 -- 172.21.15.31:0/4106754645 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f459004e810 con 0x7f4594159830 2024-08-17T02:25:16.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.346+0000 7f459b46c700 1 -- 172.21.15.31:0/4106754645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45940af460 con 0x7f4594159830 2024-08-17T02:25:16.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f458a7fc700 1 -- 172.21.15.31:0/4106754645 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f4590051e30 con 0x7f4594159830 2024-08-17T02:25:16.351 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:16.352 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 -- 172.21.15.31:0/4106754645 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4578060890 msgr2=0x7f4578062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4578060890 0x7f4578062d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4584009d80 tx=0x7f4584008040 comp rx=0 tx=0).stop 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 -- 172.21.15.31:0/4106754645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4594159830 msgr2=0x7f4594152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4594159830 0x7f4594152840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f459408a990 tx=0x7f4590017000 comp rx=0 tx=0).stop 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 -- 172.21.15.31:0/4106754645 shutdown_connections 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4578060890 0x7f4578062d40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f459415ce20 0x7f4594150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4594159830 0x7f4594152840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 --2- 172.21.15.31:0/4106754645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45940ad6f0 0x7f45940ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 -- 172.21.15.31:0/4106754645 >> 172.21.15.31:0/4106754645 conn(0x7f4594089cb0 msgr2=0x7f4594068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 -- 172.21.15.31:0/4106754645 shutdown_connections 2024-08-17T02:25:16.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.350+0000 7f459b46c700 1 -- 172.21.15.31:0/4106754645 wait complete. 2024-08-17T02:25:16.365 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:43.691230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:45.035480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:16.365 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:16.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.474+0000 7f58da325700 1 Processor -- start 2024-08-17T02:25:16.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.474+0000 7f58da325700 1 -- start start 2024-08-17T02:25:16.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58d4154800 0x7f58d415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58d4157f20 0x7f58d40b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d415b9b0 con 0x7f58d4154bd0 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d41583a0 con 0x7f58d4157f20 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d415b110 con 0x7f58d4154800 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58d9b24700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58d4157f20 0x7f58d40b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58d9b24700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58d4157f20 0x7f58d40b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39904/0 (socket says 172.21.15.31:39904) 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58d8b22700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f58d4154bd0 0x7f58d406e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55036/0 (socket says 172.21.15.31:55036) 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58d9b24700 1 -- 172.21.15.31:0/1672498979 learned_addr learned my addr 172.21.15.31:0/1672498979 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58d9323700 1 --2- 172.21.15.31:0/1672498979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58d4154800 0x7f58d415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58d9b24700 1 -- 172.21.15.31:0/1672498979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58d4154800 msgr2=0x7f58d415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58d9b24700 1 --2- 172.21.15.31:0/1672498979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58d4154800 0x7f58d415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58d9b24700 1 -- 172.21.15.31:0/1672498979 >> v1:172.21.15.31:6789/0 conn(0x7f58d4154bd0 legacy=0x7f58d406e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58d9b24700 1 -- 172.21.15.31:0/1672498979 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d415b3f0 con 0x7f58d4157f20 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58cbfff700 1 -- 172.21.15.31:0/1672498979 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302483975 0 0) 0x7f58d415b9b0 con 0x7f58d4154bd0 2024-08-17T02:25:16.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58d9b24700 1 --2- 172.21.15.31:0/1672498979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 0x7f58d40b1ec0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0099b0 tx=0x7f58cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4948cbcf6f576a40 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58cbfff700 1 -- 172.21.15.31:0/1672498979 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc009ea0 con 0x7f58d4157f20 2024-08-17T02:25:16.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58cbfff700 1 -- 172.21.15.31:0/1672498979 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc00b860 con 0x7f58d4157f20 2024-08-17T02:25:16.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58cbfff700 1 -- 172.21.15.31:0/1672498979 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc00bc00 con 0x7f58d4157f20 2024-08-17T02:25:16.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 -- 172.21.15.31:0/1672498979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 msgr2=0x7f58d40b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 --2- 172.21.15.31:0/1672498979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 0x7f58d40b1ec0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0099b0 tx=0x7f58cc009250 comp rx=0 tx=0).stop 2024-08-17T02:25:16.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 -- 172.21.15.31:0/1672498979 shutdown_connections 2024-08-17T02:25:16.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 --2- 172.21.15.31:0/1672498979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 0x7f58d40b1ec0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 --2- 172.21.15.31:0/1672498979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58d4154800 0x7f58d415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 -- 172.21.15.31:0/1672498979 >> 172.21.15.31:0/1672498979 conn(0x7f58d4068510 msgr2=0x7f58d4068910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 -- 172.21.15.31:0/1672498979 shutdown_connections 2024-08-17T02:25:16.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.478+0000 7f58da325700 1 -- 172.21.15.31:0/1672498979 wait complete. 2024-08-17T02:25:16.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58da325700 1 Processor -- start 2024-08-17T02:25:16.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58da325700 1 -- start start 2024-08-17T02:25:16.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58da325700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58d4154800 0x7f58d40af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58da325700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58d4154bd0 0x7f58d40a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58da325700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 0x7f58d40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58da325700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40aee10 con 0x7f58d4157f20 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58da325700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40ae200 con 0x7f58d4154800 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58da325700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d40ae4e0 con 0x7f58d4154bd0 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9b24700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 0x7f58d40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9b24700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 0x7f58d40ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39914/0 (socket says 172.21.15.31:39914) 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9b24700 1 -- 172.21.15.31:0/830965519 learned_addr learned my addr 172.21.15.31:0/830965519 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d8b22700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58d4154bd0 0x7f58d40a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9323700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58d4154800 0x7f58d40af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9b24700 1 -- 172.21.15.31:0/830965519 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58d4154bd0 msgr2=0x7f58d40a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9b24700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58d4154bd0 0x7f58d40a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9b24700 1 -- 172.21.15.31:0/830965519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58d4154800 msgr2=0x7f58d40af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9b24700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58d4154800 0x7f58d40af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9b24700 1 -- 172.21.15.31:0/830965519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0094f0 con 0x7f58d4157f20 2024-08-17T02:25:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9323700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58d4154800 0x7f58d40af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58d9b24700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 0x7f58d40ad9b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58cc006fd0 tx=0x7f58cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58c97fa700 1 -- 172.21.15.31:0/830965519 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc027450 con 0x7f58d4157f20 2024-08-17T02:25:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58c97fa700 1 -- 172.21.15.31:0/830965519 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc0275d0 con 0x7f58d4157f20 2024-08-17T02:25:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58da325700 1 -- 172.21.15.31:0/830965519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d40ae7c0 con 0x7f58d4157f20 2024-08-17T02:25:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58c97fa700 1 -- 172.21.15.31:0/830965519 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc027990 con 0x7f58d4157f20 2024-08-17T02:25:16.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.482+0000 7f58da325700 1 -- 172.21.15.31:0/830965519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d40adef0 con 0x7f58d4157f20 2024-08-17T02:25:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.486+0000 7f58da325700 1 -- 172.21.15.31:0/830965519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d40aefc0 con 0x7f58d4157f20 2024-08-17T02:25:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.486+0000 7f58c97fa700 1 -- 172.21.15.31:0/830965519 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f58cc01a430 con 0x7f58d4157f20 2024-08-17T02:25:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.486+0000 7f58c97fa700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f58c0060860 0x7f58c0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.486+0000 7f58d9323700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f58c0060860 0x7f58c0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.486+0000 7f58c97fa700 1 -- 172.21.15.31:0/830965519 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58cc07ec20 con 0x7f58d4157f20 2024-08-17T02:25:16.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.486+0000 7f58d9323700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f58c0060860 0x7f58c0062d10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58d4153f70 tx=0x7f58c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.494+0000 7f58c97fa700 1 -- 172.21.15.31:0/830965519 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f58d40aefc0 con 0x7f58d4157f20 2024-08-17T02:25:16.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.654+0000 7f58da325700 1 -- 172.21.15.31:0/830965519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58d40712b0 con 0x7f58d4157f20 2024-08-17T02:25:16.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.654+0000 7f58c97fa700 1 -- 172.21.15.31:0/830965519 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58cc015020 con 0x7f58d4157f20 2024-08-17T02:25:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:25:16.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.654+0000 7f58da325700 1 -- 172.21.15.31:0/830965519 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f58c0060860 msgr2=0x7f58c0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.654+0000 7f58da325700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f58c0060860 0x7f58c0062d10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58d4153f70 tx=0x7f58c4008040 comp rx=0 tx=0).stop 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.654+0000 7f58da325700 1 -- 172.21.15.31:0/830965519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 msgr2=0x7f58d40ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.654+0000 7f58da325700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 0x7f58d40ad9b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58cc006fd0 tx=0x7f58cc017000 comp rx=0 tx=0).stop 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.658+0000 7f58da325700 1 -- 172.21.15.31:0/830965519 shutdown_connections 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.658+0000 7f58da325700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f58c0060860 0x7f58c0062d10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.658+0000 7f58da325700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d4157f20 0x7f58d40ad9b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.658+0000 7f58da325700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58d4154bd0 0x7f58d40a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.658+0000 7f58da325700 1 --2- 172.21.15.31:0/830965519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58d4154800 0x7f58d40af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.658+0000 7f58da325700 1 -- 172.21.15.31:0/830965519 >> 172.21.15.31:0/830965519 conn(0x7f58d4068510 msgr2=0x7f58d41508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.658+0000 7f58da325700 1 -- 172.21.15.31:0/830965519 shutdown_connections 2024-08-17T02:25:16.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.658+0000 7f58da325700 1 -- 172.21.15.31:0/830965519 wait complete. 2024-08-17T02:25:16.670 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0537fff700 1 Processor -- start 2024-08-17T02:25:16.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0537fff700 1 -- start start 2024-08-17T02:25:16.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0537fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05381591e0 0x7f0538156440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0537fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f053806ed10 0x7f0538068510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0537fff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0538068e60 con 0x7f0538068a50 2024-08-17T02:25:16.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0537fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05380cadf0 con 0x7f05381591e0 2024-08-17T02:25:16.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0537fff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05380cb0d0 con 0x7f053806ed10 2024-08-17T02:25:16.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0536ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05381591e0 0x7f0538156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0536ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f05381591e0 0x7f0538156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39926/0 (socket says 172.21.15.31:39926) 2024-08-17T02:25:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0536ffd700 1 -- 172.21.15.31:0/2112079146 learned_addr learned my addr 172.21.15.31:0/2112079146 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f05367fc700 1 --2- 172.21.15.31:0/2112079146 >> v2:172.21.15.92:3300/0 conn(0x7f053806ed10 0x7f0538068510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0535ffb700 1 -- 172.21.15.31:0/2112079146 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219107654 0 0) 0x7f0538068e60 con 0x7f0538068a50 2024-08-17T02:25:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0536ffd700 1 -- 172.21.15.31:0/2112079146 >> v2:172.21.15.92:3300/0 conn(0x7f053806ed10 msgr2=0x7f0538068510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0536ffd700 1 --2- 172.21.15.31:0/2112079146 >> v2:172.21.15.92:3300/0 conn(0x7f053806ed10 0x7f0538068510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.790+0000 7f0536ffd700 1 -- 172.21.15.31:0/2112079146 >> v1:172.21.15.92:6789/0 conn(0x7f0538068a50 legacy=0x7f05381599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0536ffd700 1 -- 172.21.15.31:0/2112079146 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05380cb3b0 con 0x7f05381591e0 2024-08-17T02:25:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0536ffd700 1 --2- 172.21.15.31:0/2112079146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05381591e0 0x7f0538156440 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0538064ce0 tx=0x7f0528009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3171c1b38134968 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0535ffb700 1 -- 172.21.15.31:0/2112079146 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528009e70 con 0x7f05381591e0 2024-08-17T02:25:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0535ffb700 1 -- 172.21.15.31:0/2112079146 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052800b860 con 0x7f05381591e0 2024-08-17T02:25:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0535ffb700 1 -- 172.21.15.31:0/2112079146 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800bc00 con 0x7f05381591e0 2024-08-17T02:25:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0537fff700 1 -- 172.21.15.31:0/2112079146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05381591e0 msgr2=0x7f0538156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0537fff700 1 --2- 172.21.15.31:0/2112079146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05381591e0 0x7f0538156440 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0538064ce0 tx=0x7f0528009250 comp rx=0 tx=0).stop 2024-08-17T02:25:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0537fff700 1 -- 172.21.15.31:0/2112079146 shutdown_connections 2024-08-17T02:25:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0537fff700 1 --2- 172.21.15.31:0/2112079146 >> v2:172.21.15.92:3300/0 conn(0x7f053806ed10 0x7f0538068510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0537fff700 1 --2- 172.21.15.31:0/2112079146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05381591e0 0x7f0538156440 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0537fff700 1 -- 172.21.15.31:0/2112079146 >> 172.21.15.31:0/2112079146 conn(0x7f053806a0c0 msgr2=0x7f053806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0537fff700 1 -- 172.21.15.31:0/2112079146 shutdown_connections 2024-08-17T02:25:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.794+0000 7f0537fff700 1 -- 172.21.15.31:0/2112079146 wait complete. 2024-08-17T02:25:16.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f0537fff700 1 Processor -- start 2024-08-17T02:25:16.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f0537fff700 1 -- start start 2024-08-17T02:25:16.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f0537fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0538068a50 0x7f05380a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f0537fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053806ed10 0x7f05380a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f0537fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05381591e0 0x7f05380c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f0537fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05380c92a0 con 0x7f053806ed10 2024-08-17T02:25:16.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f0537fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05380a7020 con 0x7f05381591e0 2024-08-17T02:25:16.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f0537fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05380c8ce0 con 0x7f0538068a50 2024-08-17T02:25:16.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f05367fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053806ed10 0x7f05380a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f05367fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053806ed10 0x7f05380a74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39940/0 (socket says 172.21.15.31:39940) 2024-08-17T02:25:16.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f05367fc700 1 -- 172.21.15.31:0/2369812595 learned_addr learned my addr 172.21.15.31:0/2369812595 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:16.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f0536ffd700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0538068a50 0x7f05380a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.798+0000 7f05377fe700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05381591e0 0x7f05380c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f05367fc700 1 -- 172.21.15.31:0/2369812595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0538068a50 msgr2=0x7f05380a56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f05367fc700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0538068a50 0x7f05380a56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f05367fc700 1 -- 172.21.15.31:0/2369812595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05381591e0 msgr2=0x7f05380c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f05367fc700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05381591e0 0x7f05380c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f05367fc700 1 -- 172.21.15.31:0/2369812595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280094f0 con 0x7f053806ed10 2024-08-17T02:25:16.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f05367fc700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053806ed10 0x7f05380a74b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f052c00ecb0 tx=0x7f052c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f051effd700 1 -- 172.21.15.31:0/2369812595 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00c850 con 0x7f053806ed10 2024-08-17T02:25:16.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f051effd700 1 -- 172.21.15.31:0/2369812595 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00c9b0 con 0x7f053806ed10 2024-08-17T02:25:16.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f0537fff700 1 -- 172.21.15.31:0/2369812595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05380c8fc0 con 0x7f053806ed10 2024-08-17T02:25:16.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f051effd700 1 -- 172.21.15.31:0/2369812595 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00cd50 con 0x7f053806ed10 2024-08-17T02:25:16.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f0537fff700 1 -- 172.21.15.31:0/2369812595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0538169000 con 0x7f053806ed10 2024-08-17T02:25:16.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f0537fff700 1 -- 172.21.15.31:0/2369812595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05380a71b0 con 0x7f053806ed10 2024-08-17T02:25:16.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.802+0000 7f051effd700 1 -- 172.21.15.31:0/2369812595 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f052c013680 con 0x7f053806ed10 2024-08-17T02:25:16.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.806+0000 7f051effd700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0524060860 0x7f0524062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.806+0000 7f051effd700 1 -- 172.21.15.31:0/2369812595 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f052c07cdb0 con 0x7f053806ed10 2024-08-17T02:25:16.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.806+0000 7f0536ffd700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0524060860 0x7f0524062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.806+0000 7f0536ffd700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0524060860 0x7f0524062d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0538064ce0 tx=0x7f0528017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.814+0000 7f051effd700 1 -- 172.21.15.31:0/2369812595 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f052c04d200 con 0x7f053806ed10 2024-08-17T02:25:16.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 -- 172.21.15.31:0/2369812595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05380712b0 con 0x7f053806ed10 2024-08-17T02:25:16.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f051effd700 1 -- 172.21.15.31:0/2369812595 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f052c050820 con 0x7f053806ed10 2024-08-17T02:25:16.979 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:25:16.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 -- 172.21.15.31:0/2369812595 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0524060860 msgr2=0x7f0524062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0524060860 0x7f0524062d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0538064ce0 tx=0x7f0528017000 comp rx=0 tx=0).stop 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 -- 172.21.15.31:0/2369812595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053806ed10 msgr2=0x7f05380a74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053806ed10 0x7f05380a74b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f052c00ecb0 tx=0x7f052c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 -- 172.21.15.31:0/2369812595 shutdown_connections 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0524060860 0x7f0524062d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05381591e0 0x7f05380c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f053806ed10 0x7f05380a74b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 --2- 172.21.15.31:0/2369812595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0538068a50 0x7f05380a56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 -- 172.21.15.31:0/2369812595 >> 172.21.15.31:0/2369812595 conn(0x7f053806a0c0 msgr2=0x7f0538156cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 -- 172.21.15.31:0/2369812595 shutdown_connections 2024-08-17T02:25:16.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:16.978+0000 7f0537fff700 1 -- 172.21.15.31:0/2369812595 wait complete. 2024-08-17T02:25:16.993 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:17.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.110+0000 7f1331d75700 1 Processor -- start 2024-08-17T02:25:17.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.110+0000 7f1331d75700 1 -- start start 2024-08-17T02:25:17.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f1331d75700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f132c158f20 0x7f132c1592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f1331d75700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f132c0ad9b0 0x7f132c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f1331d75700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132c067dd0 con 0x7f132c0ac8a0 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f1331d75700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132c0674a0 con 0x7f132c158f20 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f1331d75700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132c067780 con 0x7f132c0ad9b0 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f1330d73700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f132c158f20 0x7f132c1592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f1330d73700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f132c158f20 0x7f132c1592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39948/0 (socket says 172.21.15.31:39948) 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f132bfff700 1 --2- 172.21.15.31:0/779782087 >> v2:172.21.15.92:3300/0 conn(0x7f132c0ad9b0 0x7f132c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f1330d73700 1 -- 172.21.15.31:0/779782087 learned_addr learned my addr 172.21.15.31:0/779782087 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f132bfff700 1 -- 172.21.15.31:0/779782087 >> v2:172.21.15.31:3300/0 conn(0x7f132c158f20 msgr2=0x7f132c1592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f132bfff700 1 --2- 172.21.15.31:0/779782087 >> v2:172.21.15.31:3300/0 conn(0x7f132c158f20 0x7f132c1592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f132bfff700 1 -- 172.21.15.31:0/779782087 >> v1:172.21.15.92:6789/0 conn(0x7f132c0ac8a0 legacy=0x7f132c15cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f132bfff700 1 -- 172.21.15.31:0/779782087 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c067a60 con 0x7f132c0ad9b0 2024-08-17T02:25:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f1330d73700 1 --2- 172.21.15.31:0/779782087 >> v2:172.21.15.31:3300/0 conn(0x7f132c158f20 0x7f132c1592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:17.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f132bfff700 1 --2- 172.21.15.31:0/779782087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ad9b0 0x7f132c0adde0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f132c0b21a0 tx=0x7f131c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=667e57e1c77f7d0f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f132b7fe700 1 -- 172.21.15.31:0/779782087 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c00b690 con 0x7f132c0ad9b0 2024-08-17T02:25:17.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f132b7fe700 1 -- 172.21.15.31:0/779782087 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c00b7f0 con 0x7f132c0ad9b0 2024-08-17T02:25:17.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.114+0000 7f132b7fe700 1 -- 172.21.15.31:0/779782087 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c00bb90 con 0x7f132c0ad9b0 2024-08-17T02:25:17.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 -- 172.21.15.31:0/779782087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ad9b0 msgr2=0x7f132c0adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 --2- 172.21.15.31:0/779782087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ad9b0 0x7f132c0adde0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f132c0b21a0 tx=0x7f131c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 -- 172.21.15.31:0/779782087 shutdown_connections 2024-08-17T02:25:17.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 --2- 172.21.15.31:0/779782087 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ad9b0 0x7f132c0adde0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 --2- 172.21.15.31:0/779782087 >> v2:172.21.15.31:3300/0 conn(0x7f132c158f20 0x7f132c1592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 -- 172.21.15.31:0/779782087 >> 172.21.15.31:0/779782087 conn(0x7f132c06a0c0 msgr2=0x7f132c06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:17.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 -- 172.21.15.31:0/779782087 shutdown_connections 2024-08-17T02:25:17.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 -- 172.21.15.31:0/779782087 wait complete. 2024-08-17T02:25:17.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 Processor -- start 2024-08-17T02:25:17.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 -- start start 2024-08-17T02:25:17.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ac8a0 0x7f132c140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f132c0ad9b0 0x7f132c15ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f132c158f20 0x7f132c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c157ad0 con 0x7f132c158f20 2024-08-17T02:25:17.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c151ee0 con 0x7f132c0ac8a0 2024-08-17T02:25:17.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.118+0000 7f1331d75700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c15c730 con 0x7f132c0ad9b0 2024-08-17T02:25:17.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331574700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f132c158f20 0x7f132c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331574700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f132c158f20 0x7f132c15d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39960/0 (socket says 172.21.15.31:39960) 2024-08-17T02:25:17.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331574700 1 -- 172.21.15.31:0/717141665 learned_addr learned my addr 172.21.15.31:0/717141665 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1330d73700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ac8a0 0x7f132c140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f132bfff700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f132c0ad9b0 0x7f132c15ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331574700 1 -- 172.21.15.31:0/717141665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f132c0ad9b0 msgr2=0x7f132c15ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331574700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f132c0ad9b0 0x7f132c15ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331574700 1 -- 172.21.15.31:0/717141665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ac8a0 msgr2=0x7f132c140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331574700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ac8a0 0x7f132c140140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331574700 1 -- 172.21.15.31:0/717141665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13200094f0 con 0x7f132c158f20 2024-08-17T02:25:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331574700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f132c158f20 0x7f132c15d3f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f132400c910 tx=0x7f1324001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1328ff9700 1 -- 172.21.15.31:0/717141665 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324012630 con 0x7f132c158f20 2024-08-17T02:25:17.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1328ff9700 1 -- 172.21.15.31:0/717141665 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1324012790 con 0x7f132c158f20 2024-08-17T02:25:17.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331d75700 1 -- 172.21.15.31:0/717141665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131c009420 con 0x7f132c158f20 2024-08-17T02:25:17.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1328ff9700 1 -- 172.21.15.31:0/717141665 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324012b50 con 0x7f132c158f20 2024-08-17T02:25:17.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331d75700 1 -- 172.21.15.31:0/717141665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132c15be00 con 0x7f132c158f20 2024-08-17T02:25:17.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1331d75700 1 -- 172.21.15.31:0/717141665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132c15c8c0 con 0x7f132c158f20 2024-08-17T02:25:17.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.122+0000 7f1328ff9700 1 -- 172.21.15.31:0/717141665 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f132401a3a0 con 0x7f132c158f20 2024-08-17T02:25:17.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.126+0000 7f1328ff9700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1318060860 0x7f1318062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.126+0000 7f1328ff9700 1 -- 172.21.15.31:0/717141665 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f132407ce60 con 0x7f132c158f20 2024-08-17T02:25:17.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.126+0000 7f1330d73700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1318060860 0x7f1318062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.126+0000 7f1330d73700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1318060860 0x7f1318062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f132c158700 tx=0x7f1320009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.130+0000 7f1328ff9700 1 -- 172.21.15.31:0/717141665 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1324050d40 con 0x7f132c158f20 2024-08-17T02:25:17.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.294+0000 7f1331d75700 1 -- 172.21.15.31:0/717141665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f132c069470 con 0x7f132c158f20 2024-08-17T02:25:17.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.298+0000 7f1328ff9700 1 -- 172.21.15.31:0/717141665 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13240508d0 con 0x7f132c158f20 2024-08-17T02:25:17.299 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-08-17T02:25:17.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 -- 172.21.15.31:0/717141665 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1318060860 msgr2=0x7f1318062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1318060860 0x7f1318062d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f132c158700 tx=0x7f1320009250 comp rx=0 tx=0).stop 2024-08-17T02:25:17.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 -- 172.21.15.31:0/717141665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f132c158f20 msgr2=0x7f132c15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f132c158f20 0x7f132c15d3f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f132400c910 tx=0x7f1324001710 comp rx=0 tx=0).stop 2024-08-17T02:25:17.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 -- 172.21.15.31:0/717141665 shutdown_connections 2024-08-17T02:25:17.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1318060860 0x7f1318062d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f132c158f20 0x7f132c15d3f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f132c0ad9b0 0x7f132c15ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 --2- 172.21.15.31:0/717141665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f132c0ac8a0 0x7f132c140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 -- 172.21.15.31:0/717141665 >> 172.21.15.31:0/717141665 conn(0x7f132c06a0c0 msgr2=0x7f132c0a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:17.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 -- 172.21.15.31:0/717141665 shutdown_connections 2024-08-17T02:25:17.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.302+0000 7f1331d75700 1 -- 172.21.15.31:0/717141665 wait complete. 2024-08-17T02:25:17.318 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.426+0000 7f50a3fff700 1 Processor -- start 2024-08-17T02:25:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.426+0000 7f50a3fff700 1 -- start start 2024-08-17T02:25:17.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f50a4156cd0 0x7f50a41570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a415b060 con 0x7f50a4067760 2024-08-17T02:25:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a415ad30 con 0x7f50a406e580 2024-08-17T02:25:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a4068390 con 0x7f50a4156cd0 2024-08-17T02:25:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a27fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f50a4067760 0x7f50a415b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55042/0 (socket says 172.21.15.31:55042) 2024-08-17T02:25:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a27fc700 1 -- 172.21.15.31:0/1813134226 learned_addr learned my addr 172.21.15.31:0/1813134226 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a2ffd700 1 --2- 172.21.15.31:0/1813134226 >> v2:172.21.15.92:3300/0 conn(0x7f50a4156cd0 0x7f50a41570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a1ffb700 1 -- 172.21.15.31:0/1813134226 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103670617 0 0) 0x7f50a415b060 con 0x7f50a4067760 2024-08-17T02:25:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a1ffb700 1 -- 172.21.15.31:0/1813134226 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5090003570 con 0x7f50a4067760 2024-08-17T02:25:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a1ffb700 1 -- 172.21.15.31:0/1813134226 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529969773 0 0) 0x7f50a415ad30 con 0x7f50a406e580 2024-08-17T02:25:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a1ffb700 1 -- 172.21.15.31:0/1813134226 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a415b060 con 0x7f50a406e580 2024-08-17T02:25:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a1ffb700 1 -- 172.21.15.31:0/1813134226 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4034930606 0 0) 0x7f5090003570 con 0x7f50a4067760 2024-08-17T02:25:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a2ffd700 1 -- 172.21.15.31:0/1813134226 >> v1:172.21.15.92:6789/0 conn(0x7f50a406e580 legacy=0x7f50a40b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a2ffd700 1 -- 172.21.15.31:0/1813134226 >> v1:172.21.15.31:6789/0 conn(0x7f50a4067760 legacy=0x7f50a415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a2ffd700 1 -- 172.21.15.31:0/1813134226 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a4067dd0 con 0x7f50a4156cd0 2024-08-17T02:25:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a2ffd700 1 --2- 172.21.15.31:0/1813134226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a4156cd0 0x7f50a41570a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50940098e0 tx=0x7f50940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4793e995e14a55bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a1ffb700 1 -- 172.21.15.31:0/1813134226 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c001470 con 0x7f50a4156cd0 2024-08-17T02:25:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a1ffb700 1 -- 172.21.15.31:0/1813134226 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5094011420 con 0x7f50a4156cd0 2024-08-17T02:25:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a1ffb700 1 -- 172.21.15.31:0/1813134226 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50940117a0 con 0x7f50a4156cd0 2024-08-17T02:25:17.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 -- 172.21.15.31:0/1813134226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a4156cd0 msgr2=0x7f50a41570a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 --2- 172.21.15.31:0/1813134226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a4156cd0 0x7f50a41570a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f50940098e0 tx=0x7f50940091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 -- 172.21.15.31:0/1813134226 shutdown_connections 2024-08-17T02:25:17.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 --2- 172.21.15.31:0/1813134226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a4156cd0 0x7f50a41570a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 -- 172.21.15.31:0/1813134226 >> 172.21.15.31:0/1813134226 conn(0x7f50a4063b20 msgr2=0x7f50a406b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:17.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 -- 172.21.15.31:0/1813134226 shutdown_connections 2024-08-17T02:25:17.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.430+0000 7f50a3fff700 1 -- 172.21.15.31:0/1813134226 wait complete. 2024-08-17T02:25:17.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a3fff700 1 Processor -- start 2024-08-17T02:25:17.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a3fff700 1 -- start start 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50a4067760 0x7f50a40ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a406e580 0x7f50a41477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50a4156cd0 0x7f50a406e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a3fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40abf00 con 0x7f50a4156cd0 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a3fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a416cf90 con 0x7f50a406e580 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a3fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a416d270 con 0x7f50a4067760 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50a4156cd0 0x7f50a406e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a27fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a406e580 0x7f50a41477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a2ffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50a4067760 0x7f50a40ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50a4156cd0 0x7f50a406e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39974/0 (socket says 172.21.15.31:39974) 2024-08-17T02:25:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a37fe700 1 -- 172.21.15.31:0/3667716638 learned_addr learned my addr 172.21.15.31:0/3667716638 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a37fe700 1 -- 172.21.15.31:0/3667716638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50a4067760 msgr2=0x7f50a40ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a37fe700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50a4067760 0x7f50a40ab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a37fe700 1 -- 172.21.15.31:0/3667716638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a406e580 msgr2=0x7f50a41477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a37fe700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a406e580 0x7f50a41477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a37fe700 1 -- 172.21.15.31:0/3667716638 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5094009420 con 0x7f50a4156cd0 2024-08-17T02:25:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a37fe700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50a4156cd0 0x7f50a406e9e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f509c00c910 tx=0x7f509c0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f509affd700 1 -- 172.21.15.31:0/3667716638 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c012630 con 0x7f50a4156cd0 2024-08-17T02:25:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f509affd700 1 -- 172.21.15.31:0/3667716638 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c0127b0 con 0x7f50a4156cd0 2024-08-17T02:25:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a3fff700 1 -- 172.21.15.31:0/3667716638 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a416d550 con 0x7f50a4156cd0 2024-08-17T02:25:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f509affd700 1 -- 172.21.15.31:0/3667716638 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c012b70 con 0x7f50a4156cd0 2024-08-17T02:25:17.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.434+0000 7f50a3fff700 1 -- 172.21.15.31:0/3667716638 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a4157140 con 0x7f50a4156cd0 2024-08-17T02:25:17.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.438+0000 7f50a3fff700 1 -- 172.21.15.31:0/3667716638 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a406b3b0 con 0x7f50a4156cd0 2024-08-17T02:25:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.438+0000 7f509affd700 1 -- 172.21.15.31:0/3667716638 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f509c01b400 con 0x7f50a4156cd0 2024-08-17T02:25:17.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.438+0000 7f509affd700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5084060890 0x7f5084062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.438+0000 7f50a2ffd700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5084060890 0x7f5084062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.438+0000 7f509affd700 1 -- 172.21.15.31:0/3667716638 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f509c07cf40 con 0x7f50a4156cd0 2024-08-17T02:25:17.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.442+0000 7f50a2ffd700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5084060890 0x7f5084062d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f50940093f0 tx=0x7f5094016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.446+0000 7f509affd700 1 -- 172.21.15.31:0/3667716638 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f50a406b3b0 con 0x7f50a4156cd0 2024-08-17T02:25:17.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.610+0000 7f50a3fff700 1 -- 172.21.15.31:0/3667716638 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50a406b3b0 con 0x7f50a4156cd0 2024-08-17T02:25:17.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f509affd700 1 -- 172.21.15.31:0/3667716638 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f50a406b3b0 con 0x7f50a4156cd0 2024-08-17T02:25:17.615 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:17.616 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:17.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 -- 172.21.15.31:0/3667716638 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5084060890 msgr2=0x7f5084062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5084060890 0x7f5084062d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f50940093f0 tx=0x7f5094016000 comp rx=0 tx=0).stop 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 -- 172.21.15.31:0/3667716638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50a4156cd0 msgr2=0x7f50a406e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50a4156cd0 0x7f50a406e9e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f509c00c910 tx=0x7f509c0027a0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 -- 172.21.15.31:0/3667716638 shutdown_connections 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5084060890 0x7f5084062d40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50a4156cd0 0x7f50a406e9e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a406e580 0x7f50a41477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 --2- 172.21.15.31:0/3667716638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50a4067760 0x7f50a40ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 -- 172.21.15.31:0/3667716638 >> 172.21.15.31:0/3667716638 conn(0x7f50a4063b20 msgr2=0x7f50a40affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 -- 172.21.15.31:0/3667716638 shutdown_connections 2024-08-17T02:25:17.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.614+0000 7f50a3fff700 1 -- 172.21.15.31:0/3667716638 wait complete. 2024-08-17T02:25:17.629 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:43.691230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:45.035480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:17.630 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:17.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.746+0000 7ff16e13f700 1 Processor -- start 2024-08-17T02:25:17.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.746+0000 7ff16e13f700 1 -- start start 2024-08-17T02:25:17.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.746+0000 7ff16e13f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff168140630 0x7ff1680aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.746+0000 7ff16e13f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1680cba30 0x7ff1680af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.746+0000 7ff16e13f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1680ccab0 con 0x7ff1680677e0 2024-08-17T02:25:17.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.746+0000 7ff16e13f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff168068880 con 0x7ff1680cba30 2024-08-17T02:25:17.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.746+0000 7ff16e13f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680cbea0 con 0x7ff168140630 2024-08-17T02:25:17.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16c93c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1680cba30 0x7ff1680af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16c93c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1680cba30 0x7ff1680af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39980/0 (socket says 172.21.15.31:39980) 2024-08-17T02:25:17.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16c93c700 1 -- 172.21.15.31:0/1082462449 learned_addr learned my addr 172.21.15.31:0/1082462449 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:17.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16d13d700 1 --2- 172.21.15.31:0/1082462449 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff168140630 0x7ff1680aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16c93c700 1 -- 172.21.15.31:0/1082462449 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff168140630 msgr2=0x7ff1680aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:17.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16c93c700 1 --2- 172.21.15.31:0/1082462449 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff168140630 0x7ff1680aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16c93c700 1 -- 172.21.15.31:0/1082462449 >> v1:172.21.15.92:6789/0 conn(0x7ff1680677e0 legacy=0x7ff16806e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16c93c700 1 -- 172.21.15.31:0/1082462449 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680cc180 con 0x7ff1680cba30 2024-08-17T02:25:17.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16c93c700 1 --2- 172.21.15.31:0/1082462449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1680cba30 0x7ff1680af270 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff154009f20 tx=0x7ff154009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a13bc68035392a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff167fff700 1 -- 172.21.15.31:0/1082462449 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15400e070 con 0x7ff1680cba30 2024-08-17T02:25:17.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff167fff700 1 -- 172.21.15.31:0/1082462449 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15400b9d0 con 0x7ff1680cba30 2024-08-17T02:25:17.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff167fff700 1 -- 172.21.15.31:0/1082462449 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1540092e0 con 0x7ff1680cba30 2024-08-17T02:25:17.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16e13f700 1 -- 172.21.15.31:0/1082462449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1680cba30 msgr2=0x7ff1680af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16e13f700 1 --2- 172.21.15.31:0/1082462449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1680cba30 0x7ff1680af270 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff154009f20 tx=0x7ff154009840 comp rx=0 tx=0).stop 2024-08-17T02:25:17.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16e13f700 1 -- 172.21.15.31:0/1082462449 shutdown_connections 2024-08-17T02:25:17.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16e13f700 1 --2- 172.21.15.31:0/1082462449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1680cba30 0x7ff1680af270 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16e13f700 1 --2- 172.21.15.31:0/1082462449 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff168140630 0x7ff1680aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16e13f700 1 -- 172.21.15.31:0/1082462449 >> 172.21.15.31:0/1082462449 conn(0x7ff16806a0c0 msgr2=0x7ff16806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:17.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16e13f700 1 -- 172.21.15.31:0/1082462449 shutdown_connections 2024-08-17T02:25:17.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.750+0000 7ff16e13f700 1 -- 172.21.15.31:0/1082462449 wait complete. 2024-08-17T02:25:17.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16e13f700 1 Processor -- start 2024-08-17T02:25:17.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16e13f700 1 -- start start 2024-08-17T02:25:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16e13f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1680677e0 0x7ff16815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16e13f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1680cba30 0x7ff1680acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16e13f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff168140630 0x7ff168154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16e13f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680adb40 con 0x7ff168140630 2024-08-17T02:25:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16e13f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815d930 con 0x7ff1680677e0 2024-08-17T02:25:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16e13f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680ad810 con 0x7ff1680cba30 2024-08-17T02:25:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16d93e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff168140630 0x7ff168154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16d13d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1680677e0 0x7ff16815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16d93e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff168140630 0x7ff168154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39988/0 (socket says 172.21.15.31:39988) 2024-08-17T02:25:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16d93e700 1 -- 172.21.15.31:0/1637763617 learned_addr learned my addr 172.21.15.31:0/1637763617 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16c93c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1680cba30 0x7ff1680acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16d13d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1680677e0 0x7ff16815cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36356/0 (socket says 172.21.15.31:36356) 2024-08-17T02:25:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16d93e700 1 -- 172.21.15.31:0/1637763617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1680cba30 msgr2=0x7ff1680acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16d93e700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1680cba30 0x7ff1680acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16d93e700 1 -- 172.21.15.31:0/1637763617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1680677e0 msgr2=0x7ff16815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16d93e700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1680677e0 0x7ff16815cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.754+0000 7ff16d93e700 1 -- 172.21.15.31:0/1637763617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154009ae0 con 0x7ff168140630 2024-08-17T02:25:17.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff16d93e700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff168140630 0x7ff168154510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c4c0 tx=0x7ff160007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff1657fa700 1 -- 172.21.15.31:0/1637763617 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16000ce70 con 0x7ff168140630 2024-08-17T02:25:17.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff1657fa700 1 -- 172.21.15.31:0/1637763617 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160011590 con 0x7ff168140630 2024-08-17T02:25:17.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff16e13f700 1 -- 172.21.15.31:0/1637763617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1680ad330 con 0x7ff168140630 2024-08-17T02:25:17.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff1657fa700 1 -- 172.21.15.31:0/1637763617 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160011970 con 0x7ff168140630 2024-08-17T02:25:17.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff16e13f700 1 -- 172.21.15.31:0/1637763617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16815d650 con 0x7ff168140630 2024-08-17T02:25:17.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff16e13f700 1 -- 172.21.15.31:0/1637763617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1680cacd0 con 0x7ff168140630 2024-08-17T02:25:17.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff1657fa700 1 -- 172.21.15.31:0/1637763617 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff160011ce0 con 0x7ff168140630 2024-08-17T02:25:17.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff1657fa700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff150060860 0x7ff150062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff1657fa700 1 -- 172.21.15.31:0/1637763617 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff16007bf80 con 0x7ff168140630 2024-08-17T02:25:17.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.758+0000 7ff16d13d700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff150060860 0x7ff150062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.762+0000 7ff16d13d700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff150060860 0x7ff150062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff158009db0 tx=0x7ff1580091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.766+0000 7ff1657fa700 1 -- 172.21.15.31:0/1637763617 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff1680cacd0 con 0x7ff168140630 2024-08-17T02:25:17.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.934+0000 7ff16e13f700 1 -- 172.21.15.31:0/1637763617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1680caca0 con 0x7ff168140630 2024-08-17T02:25:17.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.934+0000 7ff1657fa700 1 -- 172.21.15.31:0/1637763617 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1600170a0 con 0x7ff168140630 2024-08-17T02:25:17.937 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:25:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 -- 172.21.15.31:0/1637763617 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff150060860 msgr2=0x7ff150062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff150060860 0x7ff150062d10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff158009db0 tx=0x7ff1580091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 -- 172.21.15.31:0/1637763617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff168140630 msgr2=0x7ff168154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff168140630 0x7ff168154510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c4c0 tx=0x7ff160007f50 comp rx=0 tx=0).stop 2024-08-17T02:25:17.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 -- 172.21.15.31:0/1637763617 shutdown_connections 2024-08-17T02:25:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff150060860 0x7ff150062d10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff168140630 0x7ff168154510 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff1680cba30 0x7ff1680acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 --2- 172.21.15.31:0/1637763617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1680677e0 0x7ff16815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 -- 172.21.15.31:0/1637763617 >> 172.21.15.31:0/1637763617 conn(0x7ff16806a0c0 msgr2=0x7ff1680aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 -- 172.21.15.31:0/1637763617 shutdown_connections 2024-08-17T02:25:17.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:17.938+0000 7ff16e13f700 1 -- 172.21.15.31:0/1637763617 wait complete. 2024-08-17T02:25:17.956 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:18.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.074+0000 7fa5858d2700 1 Processor -- start 2024-08-17T02:25:18.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.074+0000 7fa5858d2700 1 -- start start 2024-08-17T02:25:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa580159cb0 0x7fa5801604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa580155e90 con 0x7fa580159130 2024-08-17T02:25:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa580156150 con 0x7fa5801553b0 2024-08-17T02:25:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa580156430 con 0x7fa580159cb0 2024-08-17T02:25:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa57ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa580159130 0x7fa5801595a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55056/0 (socket says 172.21.15.31:55056) 2024-08-17T02:25:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5850d1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa580159cb0 0x7fa5801604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa57ffff700 1 -- 172.21.15.31:0/2405493772 learned_addr learned my addr 172.21.15.31:0/2405493772 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa57f7fe700 1 -- 172.21.15.31:0/2405493772 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681800569 0 0) 0x7fa580155e90 con 0x7fa580159130 2024-08-17T02:25:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa57f7fe700 1 -- 172.21.15.31:0/2405493772 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa568003570 con 0x7fa580159130 2024-08-17T02:25:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5850d1700 1 -- 172.21.15.31:0/2405493772 >> v1:172.21.15.92:6789/0 conn(0x7fa5801553b0 legacy=0x7fa580155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5850d1700 1 -- 172.21.15.31:0/2405493772 >> v1:172.21.15.31:6789/0 conn(0x7fa580159130 legacy=0x7fa5801595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa57f7fe700 1 -- 172.21.15.31:0/2405493772 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1688353039 0 0) 0x7fa568003570 con 0x7fa580159130 2024-08-17T02:25:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5850d1700 1 -- 172.21.15.31:0/2405493772 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580156710 con 0x7fa580159cb0 2024-08-17T02:25:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5850d1700 1 --2- 172.21.15.31:0/2405493772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580159cb0 0x7fa5801604b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa578009e60 tx=0x7fa578009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bede3b25e4845bf5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa57f7fe700 1 -- 172.21.15.31:0/2405493772 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57800e070 con 0x7fa580159cb0 2024-08-17T02:25:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa57f7fe700 1 -- 172.21.15.31:0/2405493772 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57800b850 con 0x7fa580159cb0 2024-08-17T02:25:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa57f7fe700 1 -- 172.21.15.31:0/2405493772 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa570001470 con 0x7fa580159cb0 2024-08-17T02:25:18.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 -- 172.21.15.31:0/2405493772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580159cb0 msgr2=0x7fa5801604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 --2- 172.21.15.31:0/2405493772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580159cb0 0x7fa5801604b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa578009e60 tx=0x7fa578009780 comp rx=0 tx=0).stop 2024-08-17T02:25:18.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 -- 172.21.15.31:0/2405493772 shutdown_connections 2024-08-17T02:25:18.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 --2- 172.21.15.31:0/2405493772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa580159cb0 0x7fa5801604b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 -- 172.21.15.31:0/2405493772 >> 172.21.15.31:0/2405493772 conn(0x7fa58006bbb0 msgr2=0x7fa5800b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 -- 172.21.15.31:0/2405493772 shutdown_connections 2024-08-17T02:25:18.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.078+0000 7fa5858d2700 1 -- 172.21.15.31:0/2405493772 wait complete. 2024-08-17T02:25:18.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5858d2700 1 Processor -- start 2024-08-17T02:25:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5858d2700 1 -- start start 2024-08-17T02:25:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5858d2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5801553b0 0x7fa5800a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5858d2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580159130 0x7fa5800675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5858d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580159cb0 0x7fa580150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5858d2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800a5d00 con 0x7fa5801553b0 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5858d2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580160a30 con 0x7fa580159cb0 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5858d2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa580160d10 con 0x7fa580159130 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5848d0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5801553b0 0x7fa5800a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5848d0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5801553b0 0x7fa5800a57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40014/0 (socket says 172.21.15.31:40014) 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5848d0700 1 -- 172.21.15.31:0/1257057949 learned_addr learned my addr 172.21.15.31:0/1257057949 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa5850d1700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580159cb0 0x7fa580150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.082+0000 7fa57ffff700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580159130 0x7fa5800675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa5848d0700 1 -- 172.21.15.31:0/1257057949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580159130 msgr2=0x7fa5800675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa5848d0700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580159130 0x7fa5800675a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa5848d0700 1 -- 172.21.15.31:0/1257057949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580159cb0 msgr2=0x7fa580150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa5848d0700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580159cb0 0x7fa580150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa5848d0700 1 -- 172.21.15.31:0/1257057949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa578009a20 con 0x7fa5801553b0 2024-08-17T02:25:18.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa5850d1700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580159cb0 0x7fa580150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:18.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa5848d0700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5801553b0 0x7fa5800a57c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa57400c5d0 tx=0x7fa574007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa57cff9700 1 -- 172.21.15.31:0/1257057949 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574011590 con 0x7fa5801553b0 2024-08-17T02:25:18.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa57cff9700 1 -- 172.21.15.31:0/1257057949 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574011710 con 0x7fa5801553b0 2024-08-17T02:25:18.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa5858d2700 1 -- 172.21.15.31:0/1257057949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa580160ff0 con 0x7fa5801553b0 2024-08-17T02:25:18.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa57cff9700 1 -- 172.21.15.31:0/1257057949 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574011ad0 con 0x7fa5801553b0 2024-08-17T02:25:18.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa5858d2700 1 -- 172.21.15.31:0/1257057949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa580166df0 con 0x7fa5801553b0 2024-08-17T02:25:18.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa5858d2700 1 -- 172.21.15.31:0/1257057949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5800712b0 con 0x7fa5801553b0 2024-08-17T02:25:18.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa57cff9700 1 -- 172.21.15.31:0/1257057949 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa57401c460 con 0x7fa5801553b0 2024-08-17T02:25:18.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.086+0000 7fa57cff9700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa56c060860 0x7fa56c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.090+0000 7fa57ffff700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa56c060860 0x7fa56c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.090+0000 7fa57cff9700 1 -- 172.21.15.31:0/1257057949 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa57407ca70 con 0x7fa5801553b0 2024-08-17T02:25:18.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.090+0000 7fa57ffff700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa56c060860 0x7fa56c062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa570001ed0 tx=0x7fa570001520 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.094+0000 7fa57cff9700 1 -- 172.21.15.31:0/1257057949 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa57404ce20 con 0x7fa5801553b0 2024-08-17T02:25:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.262+0000 7fa5858d2700 1 -- 172.21.15.31:0/1257057949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa58006ef10 con 0x7fa5801553b0 2024-08-17T02:25:18.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa57cff9700 1 -- 172.21.15.31:0/1257057949 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa574050440 con 0x7fa5801553b0 2024-08-17T02:25:18.266 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:25:18.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 -- 172.21.15.31:0/1257057949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa56c060860 msgr2=0x7fa56c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa56c060860 0x7fa56c062d10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa570001ed0 tx=0x7fa570001520 comp rx=0 tx=0).stop 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 -- 172.21.15.31:0/1257057949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5801553b0 msgr2=0x7fa5800a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5801553b0 0x7fa5800a57c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa57400c5d0 tx=0x7fa574007f60 comp rx=0 tx=0).stop 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 -- 172.21.15.31:0/1257057949 shutdown_connections 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa56c060860 0x7fa56c062d10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa580159cb0 0x7fa580150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa580159130 0x7fa5800675a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 --2- 172.21.15.31:0/1257057949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5801553b0 0x7fa5800a57c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 -- 172.21.15.31:0/1257057949 >> 172.21.15.31:0/1257057949 conn(0x7fa58006bbb0 msgr2=0x7fa580152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 -- 172.21.15.31:0/1257057949 shutdown_connections 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.266+0000 7fa5858d2700 1 -- 172.21.15.31:0/1257057949 wait complete. 2024-08-17T02:25:18.280 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:18.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c348fa700 1 Processor -- start 2024-08-17T02:25:18.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c348fa700 1 -- start start 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c348fa700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1c30155d10 0x7f1c300b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c348fa700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c300aff40 0x7f1c301560e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c348fa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c300aebb0 0x7f1c300af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c348fa700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300c9960 con 0x7f1c300aff40 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c348fa700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300b1340 con 0x7f1c30155d10 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c348fa700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300af570 con 0x7f1c300aebb0 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2dd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c300aff40 0x7f1c301560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2dd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c300aff40 0x7f1c301560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40026/0 (socket says 172.21.15.31:40026) 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2dd9b700 1 -- 172.21.15.31:0/2003124597 learned_addr learned my addr 172.21.15.31:0/2003124597 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2e59c700 1 --2- 172.21.15.31:0/2003124597 >> v2:172.21.15.92:3300/0 conn(0x7f1c30155d10 0x7f1c300b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2ed9d700 1 --2- 172.21.15.31:0/2003124597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c300aebb0 0x7f1c300af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2dd9b700 1 -- 172.21.15.31:0/2003124597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c300aebb0 msgr2=0x7f1c300af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:18.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2dd9b700 1 --2- 172.21.15.31:0/2003124597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c300aebb0 0x7f1c300af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2dd9b700 1 -- 172.21.15.31:0/2003124597 >> v2:172.21.15.92:3300/0 conn(0x7f1c30155d10 msgr2=0x7f1c300b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:18.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2dd9b700 1 --2- 172.21.15.31:0/2003124597 >> v2:172.21.15.92:3300/0 conn(0x7f1c30155d10 0x7f1c300b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2dd9b700 1 -- 172.21.15.31:0/2003124597 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300afa30 con 0x7f1c300aff40 2024-08-17T02:25:18.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2ed9d700 1 --2- 172.21.15.31:0/2003124597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c300aebb0 0x7f1c300af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:18.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2dd9b700 1 --2- 172.21.15.31:0/2003124597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aff40 0x7f1c301560e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009a10 tx=0x7f1c18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47487786b0674a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2d59a700 1 -- 172.21.15.31:0/2003124597 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1800b7e0 con 0x7f1c300aff40 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.394+0000 7f1c2d59a700 1 -- 172.21.15.31:0/2003124597 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1800b940 con 0x7f1c300aff40 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2d59a700 1 -- 172.21.15.31:0/2003124597 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1800bce0 con 0x7f1c300aff40 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 -- 172.21.15.31:0/2003124597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aff40 msgr2=0x7f1c301560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 --2- 172.21.15.31:0/2003124597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aff40 0x7f1c301560e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009a10 tx=0x7f1c18009250 comp rx=0 tx=0).stop 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 -- 172.21.15.31:0/2003124597 shutdown_connections 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 --2- 172.21.15.31:0/2003124597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c300aebb0 0x7f1c300af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 --2- 172.21.15.31:0/2003124597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aff40 0x7f1c301560e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 --2- 172.21.15.31:0/2003124597 >> v2:172.21.15.92:3300/0 conn(0x7f1c30155d10 0x7f1c300b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 -- 172.21.15.31:0/2003124597 >> 172.21.15.31:0/2003124597 conn(0x7f1c3006b120 msgr2=0x7f1c3006b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 -- 172.21.15.31:0/2003124597 shutdown_connections 2024-08-17T02:25:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 -- 172.21.15.31:0/2003124597 wait complete. 2024-08-17T02:25:18.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 Processor -- start 2024-08-17T02:25:18.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 -- start start 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aebb0 0x7f1c3015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c300aff40 0x7f1c300ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c30155d10 0x7f1c300ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300c3710 con 0x7f1c300aebb0 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300c3cd0 con 0x7f1c300aff40 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c348fa700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300c8ef0 con 0x7f1c30155d10 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aebb0 0x7f1c3015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aebb0 0x7f1c3015afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40038/0 (socket says 172.21.15.31:40038) 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2e59c700 1 -- 172.21.15.31:0/432336882 learned_addr learned my addr 172.21.15.31:0/432336882 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2dd9b700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c300aff40 0x7f1c300ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2ed9d700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c30155d10 0x7f1c300ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2e59c700 1 -- 172.21.15.31:0/432336882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c30155d10 msgr2=0x7f1c300ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2e59c700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c30155d10 0x7f1c300ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2e59c700 1 -- 172.21.15.31:0/432336882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c300aff40 msgr2=0x7f1c300ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2e59c700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c300aff40 0x7f1c300ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.398+0000 7f1c2e59c700 1 -- 172.21.15.31:0/432336882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c180094f0 con 0x7f1c300aebb0 2024-08-17T02:25:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c2e59c700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aebb0 0x7f1c3015afc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009e80 tx=0x7f1c2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c267fc700 1 -- 172.21.15.31:0/432336882 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2000caa0 con 0x7f1c300aebb0 2024-08-17T02:25:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c267fc700 1 -- 172.21.15.31:0/432336882 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2000f040 con 0x7f1c300aebb0 2024-08-17T02:25:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c348fa700 1 -- 172.21.15.31:0/432336882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c300c91d0 con 0x7f1c300aebb0 2024-08-17T02:25:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c267fc700 1 -- 172.21.15.31:0/432336882 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2000ce50 con 0x7f1c300aebb0 2024-08-17T02:25:18.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c348fa700 1 -- 172.21.15.31:0/432336882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3015b500 con 0x7f1c300aebb0 2024-08-17T02:25:18.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c348fa700 1 -- 172.21.15.31:0/432336882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c300712b0 con 0x7f1c300aebb0 2024-08-17T02:25:18.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c267fc700 1 -- 172.21.15.31:0/432336882 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1c20014690 con 0x7f1c300aebb0 2024-08-17T02:25:18.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c267fc700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1c10060860 0x7f1c10062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c267fc700 1 -- 172.21.15.31:0/432336882 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c2007d470 con 0x7f1c300aebb0 2024-08-17T02:25:18.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c2dd9b700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1c10060860 0x7f1c10062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.402+0000 7f1c2dd9b700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1c10060860 0x7f1c10062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009a10 tx=0x7f1c18019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.414+0000 7f1c267fc700 1 -- 172.21.15.31:0/432336882 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1c20051350 con 0x7f1c300aebb0 2024-08-17T02:25:18.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 -- 172.21.15.31:0/432336882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c3006e500 con 0x7f1c300aebb0 2024-08-17T02:25:18.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c267fc700 1 -- 172.21.15.31:0/432336882 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c20050ee0 con 0x7f1c300aebb0 2024-08-17T02:25:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-08-17T02:25:18.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 -- 172.21.15.31:0/432336882 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1c10060860 msgr2=0x7f1c10062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1c10060860 0x7f1c10062d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009a10 tx=0x7f1c18019000 comp rx=0 tx=0).stop 2024-08-17T02:25:18.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 -- 172.21.15.31:0/432336882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aebb0 msgr2=0x7f1c3015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aebb0 0x7f1c3015afc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009e80 tx=0x7f1c2000b040 comp rx=0 tx=0).stop 2024-08-17T02:25:18.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 -- 172.21.15.31:0/432336882 shutdown_connections 2024-08-17T02:25:18.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1c10060860 0x7f1c10062d10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c30155d10 0x7f1c300ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c300aff40 0x7f1c300ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 --2- 172.21.15.31:0/432336882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c300aebb0 0x7f1c3015afc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 -- 172.21.15.31:0/432336882 >> 172.21.15.31:0/432336882 conn(0x7f1c3006b120 msgr2=0x7f1c300cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 -- 172.21.15.31:0/432336882 shutdown_connections 2024-08-17T02:25:18.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.578+0000 7f1c348fa700 1 -- 172.21.15.31:0/432336882 wait complete. 2024-08-17T02:25:18.666 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:25:18.666 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:25:18.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:18.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.778+0000 7f2aeffff700 1 Processor -- start 2024-08-17T02:25:18.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.778+0000 7f2aeffff700 1 -- start start 2024-08-17T02:25:18.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.778+0000 7f2aeffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2af0155fe0 0x7f2af0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.778+0000 7f2aeffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2af01563b0 0x7f2af0068f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.778+0000 7f2aeffff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af00cbb30 con 0x7f2af00adb00 2024-08-17T02:25:18.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.778+0000 7f2aeffff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af015ad30 con 0x7f2af01563b0 2024-08-17T02:25:18.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.778+0000 7f2aeffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af015a490 con 0x7f2af0155fe0 2024-08-17T02:25:18.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aeeffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2af0155fe0 0x7f2af0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2ae7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2af01563b0 0x7f2af0068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aef7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2af00adb00 0x7f2af00aca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:58350/0 (socket says 172.21.15.31:58350) 2024-08-17T02:25:18.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aef7fe700 1 -- 172.21.15.31:0/2222538595 learned_addr learned my addr 172.21.15.31:0/2222538595 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:18.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2ae7fff700 1 -- 172.21.15.31:0/2222538595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2af0155fe0 msgr2=0x7f2af0159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:18.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2ae7fff700 1 --2- 172.21.15.31:0/2222538595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2af0155fe0 0x7f2af0159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2ae7fff700 1 -- 172.21.15.31:0/2222538595 >> v1:172.21.15.92:6789/0 conn(0x7f2af00adb00 legacy=0x7f2af00aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2ae7fff700 1 -- 172.21.15.31:0/2222538595 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af015a770 con 0x7f2af01563b0 2024-08-17T02:25:18.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2ae7fff700 1 --2- 172.21.15.31:0/2222538595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2af01563b0 0x7f2af0068f80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80098e0 tx=0x7f2ad80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ef01d4ab066ee9a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aee7fc700 1 -- 172.21.15.31:0/2222538595 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad800b640 con 0x7f2af01563b0 2024-08-17T02:25:18.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aee7fc700 1 -- 172.21.15.31:0/2222538595 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad800b7a0 con 0x7f2af01563b0 2024-08-17T02:25:18.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aee7fc700 1 -- 172.21.15.31:0/2222538595 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad800bb40 con 0x7f2af01563b0 2024-08-17T02:25:18.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aeffff700 1 -- 172.21.15.31:0/2222538595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2af01563b0 msgr2=0x7f2af0068f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aeffff700 1 --2- 172.21.15.31:0/2222538595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2af01563b0 0x7f2af0068f80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80098e0 tx=0x7f2ad80091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aeffff700 1 -- 172.21.15.31:0/2222538595 shutdown_connections 2024-08-17T02:25:18.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aeffff700 1 --2- 172.21.15.31:0/2222538595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2af01563b0 0x7f2af0068f80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aeffff700 1 --2- 172.21.15.31:0/2222538595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2af0155fe0 0x7f2af0159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aeffff700 1 -- 172.21.15.31:0/2222538595 >> 172.21.15.31:0/2222538595 conn(0x7f2af0067400 msgr2=0x7f2af0067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aeffff700 1 -- 172.21.15.31:0/2222538595 shutdown_connections 2024-08-17T02:25:18.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.782+0000 7f2aeffff700 1 -- 172.21.15.31:0/2222538595 wait complete. 2024-08-17T02:25:18.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeffff700 1 Processor -- start 2024-08-17T02:25:18.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeffff700 1 -- start start 2024-08-17T02:25:18.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af00adb00 0x7f2af0153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2af0155fe0 0x7f2af0141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2af01563b0 0x7f2af016b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af0149e50 con 0x7f2af00adb00 2024-08-17T02:25:18.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af0142130 con 0x7f2af01563b0 2024-08-17T02:25:18.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af00c9930 con 0x7f2af0155fe0 2024-08-17T02:25:18.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af00adb00 0x7f2af0153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af00adb00 0x7f2af0153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40050/0 (socket says 172.21.15.31:40050) 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeeffd700 1 -- 172.21.15.31:0/944107695 learned_addr learned my addr 172.21.15.31:0/944107695 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2ae7fff700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2af0155fe0 0x7f2af0141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aef7fe700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2af01563b0 0x7f2af016b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeeffd700 1 -- 172.21.15.31:0/944107695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2af0155fe0 msgr2=0x7f2af0141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeeffd700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2af0155fe0 0x7f2af0141bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeeffd700 1 -- 172.21.15.31:0/944107695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2af01563b0 msgr2=0x7f2af016b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeeffd700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2af01563b0 0x7f2af016b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeeffd700 1 -- 172.21.15.31:0/944107695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad8009420 con 0x7f2af00adb00 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeeffd700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af00adb00 0x7f2af0153600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000e960 tx=0x7f2ae00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2ae6ffd700 1 -- 172.21.15.31:0/944107695 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0013680 con 0x7f2af00adb00 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2ae6ffd700 1 -- 172.21.15.31:0/944107695 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae00137e0 con 0x7f2af00adb00 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeffff700 1 -- 172.21.15.31:0/944107695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af016bd40 con 0x7f2af00adb00 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2ae6ffd700 1 -- 172.21.15.31:0/944107695 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0013b80 con 0x7f2af00adb00 2024-08-17T02:25:18.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.786+0000 7f2aeffff700 1 -- 172.21.15.31:0/944107695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af00c92e0 con 0x7f2af00adb00 2024-08-17T02:25:18.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.790+0000 7f2aeffff700 1 -- 172.21.15.31:0/944107695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af00712b0 con 0x7f2af00adb00 2024-08-17T02:25:18.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.790+0000 7f2ae6ffd700 1 -- 172.21.15.31:0/944107695 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2ae00123d0 con 0x7f2af00adb00 2024-08-17T02:25:18.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.790+0000 7f2ae6ffd700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ad0060860 0x7f2ad0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.790+0000 7f2ae6ffd700 1 -- 172.21.15.31:0/944107695 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ae007cd30 con 0x7f2af00adb00 2024-08-17T02:25:18.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.790+0000 7f2ae7fff700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ad0060860 0x7f2ad0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.790+0000 7f2ae7fff700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ad0060860 0x7f2ad0062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80093f0 tx=0x7f2ad8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.798+0000 7f2ae6ffd700 1 -- 172.21.15.31:0/944107695 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2ae004d180 con 0x7f2af00adb00 2024-08-17T02:25:18.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.970+0000 7f2aeffff700 1 -- 172.21.15.31:0/944107695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2af006a0b0 con 0x7f2af00adb00 2024-08-17T02:25:18.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.970+0000 7f2ae6ffd700 1 -- 172.21.15.31:0/944107695 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f2ae00507a0 con 0x7f2af00adb00 2024-08-17T02:25:18.972 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:18.972 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 -- 172.21.15.31:0/944107695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ad0060860 msgr2=0x7f2ad0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ad0060860 0x7f2ad0062d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80093f0 tx=0x7f2ad8017000 comp rx=0 tx=0).stop 2024-08-17T02:25:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 -- 172.21.15.31:0/944107695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af00adb00 msgr2=0x7f2af0153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af00adb00 0x7f2af0153600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000e960 tx=0x7f2ae00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 -- 172.21.15.31:0/944107695 shutdown_connections 2024-08-17T02:25:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ad0060860 0x7f2ad0062d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2af01563b0 0x7f2af016b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2af0155fe0 0x7f2af0141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 --2- 172.21.15.31:0/944107695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2af00adb00 0x7f2af0153600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 -- 172.21.15.31:0/944107695 >> 172.21.15.31:0/944107695 conn(0x7f2af0067400 msgr2=0x7f2af0147cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 -- 172.21.15.31:0/944107695 shutdown_connections 2024-08-17T02:25:18.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:18.974+0000 7f2aeffff700 1 -- 172.21.15.31:0/944107695 wait complete. 2024-08-17T02:25:18.987 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:43.691230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:45.035480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:18.988 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:19.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.094+0000 7fb42b342700 1 Processor -- start 2024-08-17T02:25:19.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.094+0000 7fb42b342700 1 -- start start 2024-08-17T02:25:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240add50 0x7fb4240b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb424069690 0x7fb4240ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb4240aba20 0x7fb4240abea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240ad9b0 con 0x7fb424069690 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240ae660 con 0x7fb4240aba20 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240acda0 con 0x7fb4240add50 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4288dd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb424069690 0x7fb4240ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4288dd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb424069690 0x7fb4240ae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40064/0 (socket says 172.21.15.31:40064) 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4288dd700 1 -- 172.21.15.31:0/2659930809 learned_addr learned my addr 172.21.15.31:0/2659930809 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4298df700 1 --2- 172.21.15.31:0/2659930809 >> v2:172.21.15.92:3300/0 conn(0x7fb4240aba20 0x7fb4240abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4290de700 1 --2- 172.21.15.31:0/2659930809 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240add50 0x7fb4240b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4288dd700 1 -- 172.21.15.31:0/2659930809 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240add50 msgr2=0x7fb4240b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4288dd700 1 --2- 172.21.15.31:0/2659930809 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240add50 0x7fb4240b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4288dd700 1 -- 172.21.15.31:0/2659930809 >> v2:172.21.15.92:3300/0 conn(0x7fb4240aba20 msgr2=0x7fb4240abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4288dd700 1 --2- 172.21.15.31:0/2659930809 >> v2:172.21.15.92:3300/0 conn(0x7fb4240aba20 0x7fb4240abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4288dd700 1 -- 172.21.15.31:0/2659930809 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240ad080 con 0x7fb424069690 2024-08-17T02:25:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4290de700 1 --2- 172.21.15.31:0/2659930809 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240add50 0x7fb4240b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb4288dd700 1 --2- 172.21.15.31:0/2659930809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 0x7fb4240ae120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb42406fa50 tx=0x7fb418009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbffb8a4337fa3f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb417fff700 1 -- 172.21.15.31:0/2659930809 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41800b860 con 0x7fb424069690 2024-08-17T02:25:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb417fff700 1 -- 172.21.15.31:0/2659930809 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41800b9c0 con 0x7fb424069690 2024-08-17T02:25:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb417fff700 1 -- 172.21.15.31:0/2659930809 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41800bd60 con 0x7fb424069690 2024-08-17T02:25:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 -- 172.21.15.31:0/2659930809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 msgr2=0x7fb4240ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 --2- 172.21.15.31:0/2659930809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 0x7fb4240ae120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb42406fa50 tx=0x7fb418009250 comp rx=0 tx=0).stop 2024-08-17T02:25:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 -- 172.21.15.31:0/2659930809 shutdown_connections 2024-08-17T02:25:19.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 --2- 172.21.15.31:0/2659930809 >> v2:172.21.15.92:3300/0 conn(0x7fb4240aba20 0x7fb4240abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 --2- 172.21.15.31:0/2659930809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 0x7fb4240ae120 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 --2- 172.21.15.31:0/2659930809 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240add50 0x7fb4240b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 -- 172.21.15.31:0/2659930809 >> 172.21.15.31:0/2659930809 conn(0x7fb424067e40 msgr2=0x7fb424068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 -- 172.21.15.31:0/2659930809 shutdown_connections 2024-08-17T02:25:19.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 -- 172.21.15.31:0/2659930809 wait complete. 2024-08-17T02:25:19.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 Processor -- start 2024-08-17T02:25:19.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.098+0000 7fb42b342700 1 -- start start 2024-08-17T02:25:19.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb42b342700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 0x7fb424158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb42b342700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240aba20 0x7fb4240a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb42b342700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4240add50 0x7fb42415be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb42b342700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4241594b0 con 0x7fb424069690 2024-08-17T02:25:19.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb42b342700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240a63c0 con 0x7fb4240add50 2024-08-17T02:25:19.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb42b342700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb424158790 con 0x7fb4240aba20 2024-08-17T02:25:19.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4290de700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 0x7fb424158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4290de700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 0x7fb424158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40078/0 (socket says 172.21.15.31:40078) 2024-08-17T02:25:19.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4290de700 1 -- 172.21.15.31:0/944312439 learned_addr learned my addr 172.21.15.31:0/944312439 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:19.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4288dd700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240aba20 0x7fb4240a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4298df700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4240add50 0x7fb42415be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4290de700 1 -- 172.21.15.31:0/944312439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240aba20 msgr2=0x7fb4240a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4290de700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240aba20 0x7fb4240a5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4290de700 1 -- 172.21.15.31:0/944312439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4240add50 msgr2=0x7fb42415be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4290de700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4240add50 0x7fb42415be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4290de700 1 -- 172.21.15.31:0/944312439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180094f0 con 0x7fb424069690 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4298df700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4240add50 0x7fb42415be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4290de700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 0x7fb424158f70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb42000c850 tx=0x7fb420008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4157fa700 1 -- 172.21.15.31:0/944312439 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420011600 con 0x7fb424069690 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4157fa700 1 -- 172.21.15.31:0/944312439 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb420011760 con 0x7fb424069690 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb42b342700 1 -- 172.21.15.31:0/944312439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42415a200 con 0x7fb424069690 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb4157fa700 1 -- 172.21.15.31:0/944312439 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420011b00 con 0x7fb424069690 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb42b342700 1 -- 172.21.15.31:0/944312439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb424158a50 con 0x7fb424069690 2024-08-17T02:25:19.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.102+0000 7fb42b342700 1 -- 172.21.15.31:0/944312439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4240712b0 con 0x7fb424069690 2024-08-17T02:25:19.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.106+0000 7fb4157fa700 1 -- 172.21.15.31:0/944312439 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb4200073b0 con 0x7fb424069690 2024-08-17T02:25:19.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.106+0000 7fb4157fa700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb408060890 0x7fb408062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.106+0000 7fb4157fa700 1 -- 172.21.15.31:0/944312439 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb42007cb70 con 0x7fb424069690 2024-08-17T02:25:19.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.106+0000 7fb4288dd700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb408060890 0x7fb408062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.106+0000 7fb4288dd700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb408060890 0x7fb408062d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb42406fa50 tx=0x7fb418017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.114+0000 7fb4157fa700 1 -- 172.21.15.31:0/944312439 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb420050a50 con 0x7fb424069690 2024-08-17T02:25:19.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.274+0000 7fb42b342700 1 -- 172.21.15.31:0/944312439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4240c93f0 con 0x7fb424069690 2024-08-17T02:25:19.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb4157fa700 1 -- 172.21.15.31:0/944312439 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4200505e0 con 0x7fb424069690 2024-08-17T02:25:19.278 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 -- 172.21.15.31:0/944312439 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb408060890 msgr2=0x7fb408062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb408060890 0x7fb408062d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb42406fa50 tx=0x7fb418017000 comp rx=0 tx=0).stop 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 -- 172.21.15.31:0/944312439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 msgr2=0x7fb424158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 0x7fb424158f70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb42000c850 tx=0x7fb420008040 comp rx=0 tx=0).stop 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 -- 172.21.15.31:0/944312439 shutdown_connections 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb408060890 0x7fb408062d40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4240add50 0x7fb42415be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4240aba20 0x7fb4240a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 --2- 172.21.15.31:0/944312439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb424069690 0x7fb424158f70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 -- 172.21.15.31:0/944312439 >> 172.21.15.31:0/944312439 conn(0x7fb424067e40 msgr2=0x7fb424068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 -- 172.21.15.31:0/944312439 shutdown_connections 2024-08-17T02:25:19.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.278+0000 7fb42b342700 1 -- 172.21.15.31:0/944312439 wait complete. 2024-08-17T02:25:19.292 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:19.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.402+0000 7f5666bae700 1 Processor -- start 2024-08-17T02:25:19.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.402+0000 7f5666bae700 1 -- start start 2024-08-17T02:25:19.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5660069ca0 0x7f566006a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f566006e3e0 0x7f5660158c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56600cc250 con 0x7f566006e830 2024-08-17T02:25:19.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56600caf30 con 0x7f566006e3e0 2024-08-17T02:25:19.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56600cb1d0 con 0x7f5660069ca0 2024-08-17T02:25:19.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f56663ad700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f566006e830 0x7f5660159190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55060/0 (socket says 172.21.15.31:55060) 2024-08-17T02:25:19.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f56663ad700 1 -- 172.21.15.31:0/2917224894 learned_addr learned my addr 172.21.15.31:0/2917224894 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:19.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f56653ab700 1 --2- 172.21.15.31:0/2917224894 >> v2:172.21.15.92:3300/0 conn(0x7f566006e3e0 0x7f5660158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5665bac700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5660069ca0 0x7f566006a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995225737 0 0) 0x7f5658001490 con 0x7f566006e830 2024-08-17T02:25:19.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f564c003570 con 0x7f566006e830 2024-08-17T02:25:19.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934321624 0 0) 0x7f564c003570 con 0x7f566006e830 2024-08-17T02:25:19.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5660069ca0 msgr2=0x7f566006a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5660069ca0 0x7f566006a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 >> v2:172.21.15.92:3300/0 conn(0x7f566006e3e0 msgr2=0x7f5660158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 --2- 172.21.15.31:0/2917224894 >> v2:172.21.15.92:3300/0 conn(0x7f566006e3e0 0x7f5660158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56600cb4b0 con 0x7f566006e830 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f5658001980 con 0x7f566006e830 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 >> v1:172.21.15.31:6789/0 conn(0x7f566006e830 legacy=0x7f5660159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f564c003a60 0x7f564c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5660069ca0 0x7f564c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f564c004d50 0x7f564c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56600caf30 con 0x7f564c003a60 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56600cb1d0 con 0x7f564c004d50 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c00ba60 con 0x7f5660069ca0 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5665bac700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f564c003a60 0x7f564c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f56653ab700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5660069ca0 0x7f564c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f56663ad700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f564c004d50 0x7f564c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5665bac700 1 -- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5660069ca0 msgr2=0x7f564c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5665bac700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5660069ca0 0x7f564c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5665bac700 1 -- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f564c004d50 msgr2=0x7f564c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5665bac700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f564c004d50 0x7f564c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5665bac700 1 -- 172.21.15.31:0/2917224894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c003570 con 0x7f564c003a60 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5665bac700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f564c003a60 0x7f564c003e70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5654009c00 tx=0x7f56540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de246388d57e832 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400e6b0 con 0x7f564c003a60 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565400e810 con 0x7f564c003a60 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5664baa700 1 -- 172.21.15.31:0/2917224894 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400ebd0 con 0x7f564c003a60 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 -- 172.21.15.31:0/2917224894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f564c003a60 msgr2=0x7f564c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 --2- 172.21.15.31:0/2917224894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f564c003a60 0x7f564c003e70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5654009c00 tx=0x7f56540091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f56663ad700 1 -- 172.21.15.31:0/2917224894 reap_dead start 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 -- 172.21.15.31:0/2917224894 shutdown_connections 2024-08-17T02:25:19.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 -- 172.21.15.31:0/2917224894 >> 172.21.15.31:0/2917224894 conn(0x7f5660069670 msgr2=0x7f56600b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 -- 172.21.15.31:0/2917224894 shutdown_connections 2024-08-17T02:25:19.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.406+0000 7f5666bae700 1 -- 172.21.15.31:0/2917224894 wait complete. 2024-08-17T02:25:19.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5666bae700 1 Processor -- start 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5666bae700 1 -- start start 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5666bae700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56601516a0 0x7f56600c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5666bae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56600c5d40 0x7f56601696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5666bae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5660169be0 0x7f56600c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5666bae700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566015b340 con 0x7f5660169be0 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5666bae700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566015aa10 con 0x7f56600c5d40 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5666bae700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566015acf0 con 0x7f56601516a0 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56663ad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5660169be0 0x7f56600c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56663ad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5660169be0 0x7f56600c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40098/0 (socket says 172.21.15.31:40098) 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56663ad700 1 -- 172.21.15.31:0/3462091153 learned_addr learned my addr 172.21.15.31:0/3462091153 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5665bac700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56601516a0 0x7f56600c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56653ab700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56600c5d40 0x7f56601696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56663ad700 1 -- 172.21.15.31:0/3462091153 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56601516a0 msgr2=0x7f56600c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56663ad700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56601516a0 0x7f56600c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56663ad700 1 -- 172.21.15.31:0/3462091153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56600c5d40 msgr2=0x7f56601696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56663ad700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56600c5d40 0x7f56601696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56663ad700 1 -- 172.21.15.31:0/3462091153 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566015afd0 con 0x7f5660169be0 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5665bac700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56601516a0 0x7f56600c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56653ab700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56600c5d40 0x7f56601696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f56663ad700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5660169be0 0x7f56600c6270 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5658000f80 tx=0x7f565800a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5651ffb700 1 -- 172.21.15.31:0/3462091153 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658013600 con 0x7f5660169be0 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5651ffb700 1 -- 172.21.15.31:0/3462091153 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5658013780 con 0x7f5660169be0 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5666bae700 1 -- 172.21.15.31:0/3462091153 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56600c89f0 con 0x7f5660169be0 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5651ffb700 1 -- 172.21.15.31:0/3462091153 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658013b40 con 0x7f5660169be0 2024-08-17T02:25:19.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.410+0000 7f5666bae700 1 -- 172.21.15.31:0/3462091153 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5660151c10 con 0x7f5660169be0 2024-08-17T02:25:19.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.414+0000 7f5666bae700 1 -- 172.21.15.31:0/3462091153 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566015b4b0 con 0x7f5660169be0 2024-08-17T02:25:19.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.414+0000 7f5651ffb700 1 -- 172.21.15.31:0/3462091153 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f565801b3b0 con 0x7f5660169be0 2024-08-17T02:25:19.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.414+0000 7f5651ffb700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5644060860 0x7f5644062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.414+0000 7f5665bac700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5644060860 0x7f5644062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.414+0000 7f5651ffb700 1 -- 172.21.15.31:0/3462091153 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f565807d940 con 0x7f5660169be0 2024-08-17T02:25:19.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.414+0000 7f5665bac700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5644060860 0x7f5644062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f566006d480 tx=0x7f565401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.422+0000 7f5651ffb700 1 -- 172.21.15.31:0/3462091153 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f565804dd90 con 0x7f5660169be0 2024-08-17T02:25:19.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 -- 172.21.15.31:0/3462091153 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56600cc250 con 0x7f5660169be0 2024-08-17T02:25:19.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5651ffb700 1 -- 172.21.15.31:0/3462091153 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56600cc250 con 0x7f5660169be0 2024-08-17T02:25:19.587 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 -- 172.21.15.31:0/3462091153 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5644060860 msgr2=0x7f5644062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5644060860 0x7f5644062d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f566006d480 tx=0x7f565401a000 comp rx=0 tx=0).stop 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 -- 172.21.15.31:0/3462091153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5660169be0 msgr2=0x7f56600c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5660169be0 0x7f56600c6270 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5658000f80 tx=0x7f565800a1a0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 -- 172.21.15.31:0/3462091153 shutdown_connections 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5644060860 0x7f5644062d10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5660169be0 0x7f56600c6270 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56600c5d40 0x7f56601696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 --2- 172.21.15.31:0/3462091153 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56601516a0 0x7f56600c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 -- 172.21.15.31:0/3462091153 >> 172.21.15.31:0/3462091153 conn(0x7f5660069670 msgr2=0x7f56600b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 -- 172.21.15.31:0/3462091153 shutdown_connections 2024-08-17T02:25:19.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.586+0000 7f5666bae700 1 -- 172.21.15.31:0/3462091153 wait complete. 2024-08-17T02:25:19.600 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:19.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.714+0000 7f52c8b43700 1 Processor -- start 2024-08-17T02:25:19.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.714+0000 7f52c8b43700 1 -- start start 2024-08-17T02:25:19.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.714+0000 7f52c8b43700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c40cd050 0x7f52c4164370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.714+0000 7f52c8b43700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c415a780 con 0x7f52c41592f0 2024-08-17T02:25:19.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.714+0000 7f52c8b43700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c415ac10 con 0x7f52c41596c0 2024-08-17T02:25:19.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.714+0000 7f52c8b43700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40cb870 con 0x7f52c40cd050 2024-08-17T02:25:19.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c37fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f52c41592f0 0x7f52c40cb160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55064/0 (socket says 172.21.15.31:55064) 2024-08-17T02:25:19.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c37fe700 1 -- 172.21.15.31:0/947824155 learned_addr learned my addr 172.21.15.31:0/947824155 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:19.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c3fff700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c40cd050 0x7f52c4164370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371864952 0 0) 0x7f52c415a780 con 0x7f52c41592f0 2024-08-17T02:25:19.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ac003570 con 0x7f52c41592f0 2024-08-17T02:25:19.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3657335375 0 0) 0x7f52ac003570 con 0x7f52c41592f0 2024-08-17T02:25:19.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c40cd050 msgr2=0x7f52c4164370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c40cd050 0x7f52c4164370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 >> v1:172.21.15.92:6789/0 conn(0x7f52c41596c0 legacy=0x7f52c40cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4159b70 con 0x7f52c41592f0 2024-08-17T02:25:19.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f52b8001470 con 0x7f52c41592f0 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 >> v1:172.21.15.31:6789/0 conn(0x7f52c41592f0 legacy=0x7f52c40cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c40cd050 0x7f52ac003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ac003fd0 0x7f52ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52ac004d50 0x7f52ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40cb870 con 0x7f52ac003fd0 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac00bb40 con 0x7f52ac004d50 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ac00bd00 con 0x7f52c40cd050 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c2ffd700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ac003fd0 0x7f52ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c37fe700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c40cd050 0x7f52ac003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c3fff700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52ac004d50 0x7f52ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c2ffd700 1 -- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c40cd050 msgr2=0x7f52ac003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c2ffd700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c40cd050 0x7f52ac003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c2ffd700 1 -- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52ac004d50 msgr2=0x7f52ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c2ffd700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52ac004d50 0x7f52ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c2ffd700 1 -- 172.21.15.31:0/947824155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ac003570 con 0x7f52ac003fd0 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c2ffd700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ac003fd0 0x7f52ac004810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52b4001a70 tx=0x7f52b4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302efdd6797ad83a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400c550 con 0x7f52ac003fd0 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b400c6b0 con 0x7f52ac003fd0 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c27fc700 1 -- 172.21.15.31:0/947824155 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400ca50 con 0x7f52ac003fd0 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c8b43700 1 -- 172.21.15.31:0/947824155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ac003fd0 msgr2=0x7f52ac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c8b43700 1 --2- 172.21.15.31:0/947824155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52ac003fd0 0x7f52ac004810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52b4001a70 tx=0x7f52b4007d30 comp rx=0 tx=0).stop 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c3fff700 1 -- 172.21.15.31:0/947824155 reap_dead start 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c8b43700 1 -- 172.21.15.31:0/947824155 shutdown_connections 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c8b43700 1 -- 172.21.15.31:0/947824155 >> 172.21.15.31:0/947824155 conn(0x7f52c4067400 msgr2=0x7f52c4067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c8b43700 1 -- 172.21.15.31:0/947824155 shutdown_connections 2024-08-17T02:25:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.718+0000 7f52c8b43700 1 -- 172.21.15.31:0/947824155 wait complete. 2024-08-17T02:25:19.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c8b43700 1 Processor -- start 2024-08-17T02:25:19.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c8b43700 1 -- start start 2024-08-17T02:25:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c8b43700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52ac003fd0 0x7f52c4151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c8b43700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c41528e0 0x7f52c4157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c8b43700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c4158340 0x7f52c40b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c8b43700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c40b3560 con 0x7f52c4158340 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c8b43700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c41587e0 con 0x7f52ac003fd0 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c8b43700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4158ac0 con 0x7f52c41528e0 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c4158340 0x7f52c40b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c4158340 0x7f52c40b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40114/0 (socket says 172.21.15.31:40114) 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.722+0000 7f52c3fff700 1 -- 172.21.15.31:0/477948721 learned_addr learned my addr 172.21.15.31:0/477948721 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c2ffd700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c41528e0 0x7f52c4157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c37fe700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52ac003fd0 0x7f52c4151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c3fff700 1 -- 172.21.15.31:0/477948721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c41528e0 msgr2=0x7f52c4157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c3fff700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c41528e0 0x7f52c4157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c3fff700 1 -- 172.21.15.31:0/477948721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52ac003fd0 msgr2=0x7f52c4151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c3fff700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52ac003fd0 0x7f52c4151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c3fff700 1 -- 172.21.15.31:0/477948721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40b2f10 con 0x7f52c4158340 2024-08-17T02:25:19.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c37fe700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52ac003fd0 0x7f52c4151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:19.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c3fff700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c4158340 0x7f52c40b0f90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f52c4089620 tx=0x7f52bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52ab7fe700 1 -- 172.21.15.31:0/477948721 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00e040 con 0x7f52c4158340 2024-08-17T02:25:19.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52ab7fe700 1 -- 172.21.15.31:0/477948721 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc00f040 con 0x7f52c4158340 2024-08-17T02:25:19.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c8b43700 1 -- 172.21.15.31:0/477948721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c40b31f0 con 0x7f52c4158340 2024-08-17T02:25:19.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52ab7fe700 1 -- 172.21.15.31:0/477948721 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00fe20 con 0x7f52c4158340 2024-08-17T02:25:19.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c8b43700 1 -- 172.21.15.31:0/477948721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c40b14d0 con 0x7f52c4158340 2024-08-17T02:25:19.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52c8b43700 1 -- 172.21.15.31:0/477948721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c40b36d0 con 0x7f52c4158340 2024-08-17T02:25:19.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.726+0000 7f52ab7fe700 1 -- 172.21.15.31:0/477948721 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f52bc015640 con 0x7f52c4158340 2024-08-17T02:25:19.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.730+0000 7f52ab7fe700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f52b0060860 0x7f52b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.730+0000 7f52ab7fe700 1 -- 172.21.15.31:0/477948721 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52bc07d4d0 con 0x7f52c4158340 2024-08-17T02:25:19.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.730+0000 7f52c37fe700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f52b0060860 0x7f52b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.730+0000 7f52c37fe700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f52b0060860 0x7f52b0062d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52b80015a0 tx=0x7f52b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.734+0000 7f52ab7fe700 1 -- 172.21.15.31:0/477948721 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f52bc04d920 con 0x7f52c4158340 2024-08-17T02:25:19.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.902+0000 7f52c8b43700 1 -- 172.21.15.31:0/477948721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52c40712b0 con 0x7f52c4158340 2024-08-17T02:25:19.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.902+0000 7f52ab7fe700 1 -- 172.21.15.31:0/477948721 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52bc050f40 con 0x7f52c4158340 2024-08-17T02:25:19.906 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-08-17T02:25:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 -- 172.21.15.31:0/477948721 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f52b0060860 msgr2=0x7f52b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f52b0060860 0x7f52b0062d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52b80015a0 tx=0x7f52b8009040 comp rx=0 tx=0).stop 2024-08-17T02:25:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 -- 172.21.15.31:0/477948721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c4158340 msgr2=0x7f52c40b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c4158340 0x7f52c40b0f90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f52c4089620 tx=0x7f52bc00b040 comp rx=0 tx=0).stop 2024-08-17T02:25:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 -- 172.21.15.31:0/477948721 shutdown_connections 2024-08-17T02:25:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f52b0060860 0x7f52b0062d10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52c4158340 0x7f52c40b0f90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c41528e0 0x7f52c4157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 --2- 172.21.15.31:0/477948721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52ac003fd0 0x7f52c4151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 -- 172.21.15.31:0/477948721 >> 172.21.15.31:0/477948721 conn(0x7f52c4067400 msgr2=0x7f52c40b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 -- 172.21.15.31:0/477948721 shutdown_connections 2024-08-17T02:25:19.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:19.906+0000 7f52c8b43700 1 -- 172.21.15.31:0/477948721 wait complete. 2024-08-17T02:25:19.921 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:25:20.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.022+0000 7fbab8774700 1 Processor -- start 2024-08-17T02:25:20.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.022+0000 7fbab8774700 1 -- start start 2024-08-17T02:25:20.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab8774700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbab0155e90 0x7fbab00cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab8774700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab0157d50 con 0x7fbab0068510 2024-08-17T02:25:20.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab8774700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab0157180 con 0x7fbab006bec0 2024-08-17T02:25:20.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab8774700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab00cc550 con 0x7fbab0155e90 2024-08-17T02:25:20.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab5d0f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbab0068510 0x7fbab006b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55078/0 (socket says 172.21.15.31:55078) 2024-08-17T02:25:20.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab5d0f700 1 -- 172.21.15.31:0/1683331811 learned_addr learned my addr 172.21.15.31:0/1683331811 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:20.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab6510700 1 --2- 172.21.15.31:0/1683331811 >> v2:172.21.15.92:3300/0 conn(0x7fbab0155e90 0x7fbab00cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab550e700 1 -- 172.21.15.31:0/1683331811 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895160134 0 0) 0x7fbab0157d50 con 0x7fbab0068510 2024-08-17T02:25:20.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab550e700 1 -- 172.21.15.31:0/1683331811 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba9c003570 con 0x7fbab0068510 2024-08-17T02:25:20.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab550e700 1 -- 172.21.15.31:0/1683331811 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919746475 0 0) 0x7fbab0157180 con 0x7fbab006bec0 2024-08-17T02:25:20.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab550e700 1 -- 172.21.15.31:0/1683331811 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab0157d50 con 0x7fbab006bec0 2024-08-17T02:25:20.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab6510700 1 -- 172.21.15.31:0/1683331811 >> v1:172.21.15.92:6789/0 conn(0x7fbab006bec0 legacy=0x7fbab01581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab6510700 1 -- 172.21.15.31:0/1683331811 >> v1:172.21.15.31:6789/0 conn(0x7fbab0068510 legacy=0x7fbab006b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab6510700 1 -- 172.21.15.31:0/1683331811 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab0157420 con 0x7fbab0155e90 2024-08-17T02:25:20.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab6510700 1 --2- 172.21.15.31:0/1683331811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab0155e90 0x7fbab00cc010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0098e0 tx=0x7fbaac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=318a300a0887b701 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab550e700 1 -- 172.21.15.31:0/1683331811 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac00f6b0 con 0x7fbab0155e90 2024-08-17T02:25:20.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab550e700 1 -- 172.21.15.31:0/1683331811 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac00f810 con 0x7fbab0155e90 2024-08-17T02:25:20.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.026+0000 7fbab550e700 1 -- 172.21.15.31:0/1683331811 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac00fb90 con 0x7fbab0155e90 2024-08-17T02:25:20.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 -- 172.21.15.31:0/1683331811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab0155e90 msgr2=0x7fbab00cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 --2- 172.21.15.31:0/1683331811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab0155e90 0x7fbab00cc010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0098e0 tx=0x7fbaac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 -- 172.21.15.31:0/1683331811 shutdown_connections 2024-08-17T02:25:20.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 --2- 172.21.15.31:0/1683331811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab0155e90 0x7fbab00cc010 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 -- 172.21.15.31:0/1683331811 >> 172.21.15.31:0/1683331811 conn(0x7fbab006b3b0 msgr2=0x7fbab00b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:20.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 -- 172.21.15.31:0/1683331811 shutdown_connections 2024-08-17T02:25:20.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 -- 172.21.15.31:0/1683331811 wait complete. 2024-08-17T02:25:20.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 Processor -- start 2024-08-17T02:25:20.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 -- start start 2024-08-17T02:25:20.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbab0068510 0x7fbab014b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbab006bec0 0x7fbab0151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab0155e90 0x7fbab0146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab016cea0 con 0x7fbab0068510 2024-08-17T02:25:20.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab0151560 con 0x7fbab0155e90 2024-08-17T02:25:20.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab8774700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab00c5f50 con 0x7fbab006bec0 2024-08-17T02:25:20.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab6510700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbab0068510 0x7fbab014b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab6510700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbab0068510 0x7fbab014b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40128/0 (socket says 172.21.15.31:40128) 2024-08-17T02:25:20.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab6510700 1 -- 172.21.15.31:0/3937044635 learned_addr learned my addr 172.21.15.31:0/3937044635 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:20.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab6d11700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab0155e90 0x7fbab0146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.030+0000 7fbab5d0f700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbab006bec0 0x7fbab0151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab6510700 1 -- 172.21.15.31:0/3937044635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbab006bec0 msgr2=0x7fbab0151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab6510700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbab006bec0 0x7fbab0151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab6510700 1 -- 172.21.15.31:0/3937044635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab0155e90 msgr2=0x7fbab0146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab6510700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab0155e90 0x7fbab0146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab6510700 1 -- 172.21.15.31:0/3937044635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac009420 con 0x7fbab0068510 2024-08-17T02:25:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab6d11700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab0155e90 0x7fbab0146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab5d0f700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbab006bec0 0x7fbab0151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab6510700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbab0068510 0x7fbab014b220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbab006d3f0 tx=0x7fbaac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbaa67fc700 1 -- 172.21.15.31:0/3937044635 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac01d040 con 0x7fbab0068510 2024-08-17T02:25:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbaa67fc700 1 -- 172.21.15.31:0/3937044635 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac000d10 con 0x7fbab0068510 2024-08-17T02:25:20.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab8774700 1 -- 172.21.15.31:0/3937044635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab00c89b0 con 0x7fbab0068510 2024-08-17T02:25:20.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbaa67fc700 1 -- 172.21.15.31:0/3937044635 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac00fb90 con 0x7fbab0068510 2024-08-17T02:25:20.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab8774700 1 -- 172.21.15.31:0/3937044635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab00c8c30 con 0x7fbab0068510 2024-08-17T02:25:20.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbab8774700 1 -- 172.21.15.31:0/3937044635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab00712b0 con 0x7fbab0068510 2024-08-17T02:25:20.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbaa67fc700 1 -- 172.21.15.31:0/3937044635 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbaac0228e0 con 0x7fbab0068510 2024-08-17T02:25:20.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.034+0000 7fbaa67fc700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fba94060860 0x7fba94062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.038+0000 7fbaa67fc700 1 -- 172.21.15.31:0/3937044635 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbaac014070 con 0x7fbab0068510 2024-08-17T02:25:20.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.038+0000 7fbab5d0f700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fba94060860 0x7fba94062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.038+0000 7fbab5d0f700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fba94060860 0x7fba94062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbab006f2b0 tx=0x7fbaa0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.042+0000 7fbaa67fc700 1 -- 172.21.15.31:0/3937044635 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbaac04e610 con 0x7fbab0068510 2024-08-17T02:25:20.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.266+0000 7fbab8774700 1 -- 172.21.15.31:0/3937044635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fbab00aea70 con 0x7fbab0068510 2024-08-17T02:25:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.842+0000 7fbaa67fc700 1 -- 172.21.15.31:0/3937044635 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbaac051c30 con 0x7fbab0068510 2024-08-17T02:25:20.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 -- 172.21.15.31:0/3937044635 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fba94060860 msgr2=0x7fba94062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fba94060860 0x7fba94062d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbab006f2b0 tx=0x7fbaa0009040 comp rx=0 tx=0).stop 2024-08-17T02:25:20.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 -- 172.21.15.31:0/3937044635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbab0068510 msgr2=0x7fbab014b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbab0068510 0x7fbab014b220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbab006d3f0 tx=0x7fbaac019000 comp rx=0 tx=0).stop 2024-08-17T02:25:20.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 -- 172.21.15.31:0/3937044635 shutdown_connections 2024-08-17T02:25:20.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fba94060860 0x7fba94062d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab0155e90 0x7fbab0146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbab006bec0 0x7fbab0151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 --2- 172.21.15.31:0/3937044635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbab0068510 0x7fbab014b220 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 -- 172.21.15.31:0/3937044635 >> 172.21.15.31:0/3937044635 conn(0x7fbab006b3b0 msgr2=0x7fbab0067400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:20.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 -- 172.21.15.31:0/3937044635 shutdown_connections 2024-08-17T02:25:20.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.846+0000 7fbab8774700 1 -- 172.21.15.31:0/3937044635 wait complete. 2024-08-17T02:25:20.865 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:25:20.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.986+0000 7f2cc1eac700 1 Processor -- start 2024-08-17T02:25:20.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.986+0000 7f2cc1eac700 1 -- start start 2024-08-17T02:25:20.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2cbc157080 0x7f2cbc0b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cbc0af0e0 con 0x7f2cbc0cc670 2024-08-17T02:25:20.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cbc157450 con 0x7f2cbc069ec0 2024-08-17T02:25:20.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cbc0b0e10 con 0x7f2cbc157080 2024-08-17T02:25:20.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc0eaa700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2cbc157080 0x7f2cbc0b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cbbfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2cbc0cc670 0x7f2cbc0af570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52606/0 (socket says 172.21.15.31:52606) 2024-08-17T02:25:20.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cbbfff700 1 -- 172.21.15.31:0/4247490723 learned_addr learned my addr 172.21.15.31:0/4247490723 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:20.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc0eaa700 1 -- 172.21.15.31:0/4247490723 >> v1:172.21.15.92:6789/0 conn(0x7f2cbc069ec0 legacy=0x7f2cbc0c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc0eaa700 1 -- 172.21.15.31:0/4247490723 >> v1:172.21.15.31:6789/0 conn(0x7f2cbc0cc670 legacy=0x7f2cbc0af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cbb7fe700 1 -- 172.21.15.31:0/4247490723 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379437235 0 0) 0x7f2cbc0af0e0 con 0x7f2cbc0cc670 2024-08-17T02:25:20.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc0eaa700 1 -- 172.21.15.31:0/4247490723 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc0b10f0 con 0x7f2cbc157080 2024-08-17T02:25:20.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc0eaa700 1 --2- 172.21.15.31:0/4247490723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 0x7f2cbc0b0780 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0098e0 tx=0x7f2cac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f7f1d46e6d57d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cbb7fe700 1 -- 172.21.15.31:0/4247490723 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac009e80 con 0x7f2cbc157080 2024-08-17T02:25:20.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cbb7fe700 1 -- 172.21.15.31:0/4247490723 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac00b860 con 0x7f2cbc157080 2024-08-17T02:25:20.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cbb7fe700 1 -- 172.21.15.31:0/4247490723 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00bbe0 con 0x7f2cbc157080 2024-08-17T02:25:20.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 -- 172.21.15.31:0/4247490723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 msgr2=0x7f2cbc0b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 --2- 172.21.15.31:0/4247490723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 0x7f2cbc0b0780 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0098e0 tx=0x7f2cac0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 -- 172.21.15.31:0/4247490723 shutdown_connections 2024-08-17T02:25:20.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 --2- 172.21.15.31:0/4247490723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 0x7f2cbc0b0780 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 -- 172.21.15.31:0/4247490723 >> 172.21.15.31:0/4247490723 conn(0x7f2cbc067e90 msgr2=0x7f2cbc0cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:20.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 -- 172.21.15.31:0/4247490723 shutdown_connections 2024-08-17T02:25:20.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.990+0000 7f2cc1eac700 1 -- 172.21.15.31:0/4247490723 wait complete. 2024-08-17T02:25:20.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc1eac700 1 Processor -- start 2024-08-17T02:25:20.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc1eac700 1 -- start start 2024-08-17T02:25:20.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc1eac700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cbc069ec0 0x7f2cbc0aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc1eac700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2cbc0cc670 0x7f2cbc0a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc1eac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 0x7f2cbc0a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc1eac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc159e50 con 0x7f2cbc157080 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc1eac700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc159540 con 0x7f2cbc069ec0 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc1eac700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc0ab2d0 con 0x7f2cbc0cc670 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc16ab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 0x7f2cbc0a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc16ab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 0x7f2cbc0a59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36718/0 (socket says 172.21.15.31:36718) 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc16ab700 1 -- 172.21.15.31:0/634491973 learned_addr learned my addr 172.21.15.31:0/634491973 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc0eaa700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cbc069ec0 0x7f2cbc0aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cbbfff700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2cbc0cc670 0x7f2cbc0a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc16ab700 1 -- 172.21.15.31:0/634491973 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2cbc0cc670 msgr2=0x7f2cbc0a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc16ab700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2cbc0cc670 0x7f2cbc0a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc16ab700 1 -- 172.21.15.31:0/634491973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cbc069ec0 msgr2=0x7f2cbc0aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc16ab700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cbc069ec0 0x7f2cbc0aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc16ab700 1 -- 172.21.15.31:0/634491973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac009420 con 0x7f2cbc157080 2024-08-17T02:25:20.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc16ab700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 0x7f2cbc0a59b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400c4c0 tx=0x7f2cb4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cb8ff9700 1 -- 172.21.15.31:0/634491973 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4011590 con 0x7f2cbc157080 2024-08-17T02:25:20.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc1eac700 1 -- 172.21.15.31:0/634491973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cbc158fb0 con 0x7f2cbc157080 2024-08-17T02:25:20.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cb8ff9700 1 -- 172.21.15.31:0/634491973 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb4011710 con 0x7f2cbc157080 2024-08-17T02:25:20.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cb8ff9700 1 -- 172.21.15.31:0/634491973 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4011ad0 con 0x7f2cbc157080 2024-08-17T02:25:20.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.994+0000 7f2cc1eac700 1 -- 172.21.15.31:0/634491973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc159a70 con 0x7f2cbc157080 2024-08-17T02:25:20.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.998+0000 7f2cc1eac700 1 -- 172.21.15.31:0/634491973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cbc159f90 con 0x7f2cbc157080 2024-08-17T02:25:21.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.998+0000 7f2cb8ff9700 1 -- 172.21.15.31:0/634491973 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2cb401b3b0 con 0x7f2cbc157080 2024-08-17T02:25:21.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.998+0000 7f2cb8ff9700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2c9c060860 0x7f2c9c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.998+0000 7f2cb8ff9700 1 -- 172.21.15.31:0/634491973 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2cb407c150 con 0x7f2cbc157080 2024-08-17T02:25:21.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.998+0000 7f2cc0eaa700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2c9c060860 0x7f2c9c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:20.998+0000 7f2cc0eaa700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2c9c060860 0x7f2c9c062d10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0093f0 tx=0x7f2cac017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:21.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.006+0000 7f2cb8ff9700 1 -- 172.21.15.31:0/634491973 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2cbc159f90 con 0x7f2cbc157080 2024-08-17T02:25:21.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.170+0000 7f2cc1eac700 1 -- 172.21.15.31:0/634491973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2cbc159f90 con 0x7f2cbc157080 2024-08-17T02:25:21.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.174+0000 7f2cb8ff9700 1 -- 172.21.15.31:0/634491973 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2cbc159f90 con 0x7f2cbc157080 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 -- 172.21.15.31:0/634491973 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2c9c060860 msgr2=0x7f2c9c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2c9c060860 0x7f2c9c062d10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0093f0 tx=0x7f2cac017000 comp rx=0 tx=0).stop 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 -- 172.21.15.31:0/634491973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 msgr2=0x7f2cbc0a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 0x7f2cbc0a59b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400c4c0 tx=0x7f2cb4007f50 comp rx=0 tx=0).stop 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 -- 172.21.15.31:0/634491973 shutdown_connections 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2c9c060860 0x7f2c9c062d10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cbc157080 0x7f2cbc0a59b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2cbc0cc670 0x7f2cbc0a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 --2- 172.21.15.31:0/634491973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cbc069ec0 0x7f2cbc0aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 -- 172.21.15.31:0/634491973 >> 172.21.15.31:0/634491973 conn(0x7f2cbc067e90 msgr2=0x7f2cbc150a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:21.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 -- 172.21.15.31:0/634491973 shutdown_connections 2024-08-17T02:25:21.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.178+0000 7f2cc1eac700 1 -- 172.21.15.31:0/634491973 wait complete. 2024-08-17T02:25:21.191 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:25:21.191 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:25:21.207 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:25:21.229 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:25:21.229 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2024-08-17T02:25:21.229 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:21.229 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:21.255 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:25:21.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:25:21.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:21.256 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:25:21.296 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi092.front.sepia.ceph.com... 2024-08-17T02:25:21.296 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:21.296 DEBUG:teuthology.orchestra.run.smithi092:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:21.340 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:25:21.340 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:25:21.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:21.341 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:25:21.392 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2024-08-17T02:25:21.392 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:21.392 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:21.411 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:25:21.412 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:25:21.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:21.412 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:25:21.461 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi092.front.sepia.ceph.com... 2024-08-17T02:25:21.461 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:21.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:21.478 INFO:teuthology.orchestra.run:waiting for 900 2024-08-17T02:25:21.478 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:25:21.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:21.478 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:25:21.527 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:25:21.528 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:21.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.646+0000 7fa85ffff700 1 Processor -- start 2024-08-17T02:25:21.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.646+0000 7fa85ffff700 1 -- start start 2024-08-17T02:25:21.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.646+0000 7fa85ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa8600af820 0x7fa86006a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.646+0000 7fa85ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa860156650 0x7fa86015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.646+0000 7fa85ffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600b09a0 con 0x7fa86006a430 2024-08-17T02:25:21.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.646+0000 7fa85ffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86015af40 con 0x7fa860156650 2024-08-17T02:25:21.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.646+0000 7fa85ffff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600afd90 con 0x7fa8600af820 2024-08-17T02:25:21.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.646+0000 7fa85effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa86006a430 0x7fa860155f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52620/0 (socket says 172.21.15.31:52620) 2024-08-17T02:25:21.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.646+0000 7fa85effd700 1 -- 172.21.15.31:0/1353685730 learned_addr learned my addr 172.21.15.31:0/1353685730 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:21.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.646+0000 7fa85f7fe700 1 --2- 172.21.15.31:0/1353685730 >> v2:172.21.15.31:3300/0 conn(0x7fa860156650 0x7fa86015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85e7fc700 1 --2- 172.21.15.31:0/1353685730 >> v2:172.21.15.92:3300/0 conn(0x7fa8600af820 0x7fa86006a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85dffb700 1 -- 172.21.15.31:0/1353685730 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317633176 0 0) 0x7fa8600b09a0 con 0x7fa86006a430 2024-08-17T02:25:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85dffb700 1 -- 172.21.15.31:0/1353685730 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa848003570 con 0x7fa86006a430 2024-08-17T02:25:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85f7fe700 1 -- 172.21.15.31:0/1353685730 >> v2:172.21.15.92:3300/0 conn(0x7fa8600af820 msgr2=0x7fa86006a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85f7fe700 1 --2- 172.21.15.31:0/1353685730 >> v2:172.21.15.92:3300/0 conn(0x7fa8600af820 0x7fa86006a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85f7fe700 1 -- 172.21.15.31:0/1353685730 >> v1:172.21.15.31:6789/0 conn(0x7fa86006a430 legacy=0x7fa860155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85f7fe700 1 -- 172.21.15.31:0/1353685730 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600b0070 con 0x7fa860156650 2024-08-17T02:25:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85f7fe700 1 --2- 172.21.15.31:0/1353685730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa860156650 0x7fa86015aa00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa8600635f0 tx=0x7fa858009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d2ef4115691b74 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85dffb700 1 -- 172.21.15.31:0/1353685730 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85800e070 con 0x7fa860156650 2024-08-17T02:25:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85dffb700 1 -- 172.21.15.31:0/1353685730 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85800bab0 con 0x7fa860156650 2024-08-17T02:25:21.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85dffb700 1 -- 172.21.15.31:0/1353685730 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85800be30 con 0x7fa860156650 2024-08-17T02:25:21.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85ffff700 1 -- 172.21.15.31:0/1353685730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa860156650 msgr2=0x7fa86015aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85ffff700 1 --2- 172.21.15.31:0/1353685730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa860156650 0x7fa86015aa00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa8600635f0 tx=0x7fa858009780 comp rx=0 tx=0).stop 2024-08-17T02:25:21.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85ffff700 1 -- 172.21.15.31:0/1353685730 shutdown_connections 2024-08-17T02:25:21.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85ffff700 1 --2- 172.21.15.31:0/1353685730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa860156650 0x7fa86015aa00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85ffff700 1 --2- 172.21.15.31:0/1353685730 >> v2:172.21.15.92:3300/0 conn(0x7fa8600af820 0x7fa86006a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85ffff700 1 -- 172.21.15.31:0/1353685730 >> 172.21.15.31:0/1353685730 conn(0x7fa8600cd2b0 msgr2=0x7fa860069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:21.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85ffff700 1 -- 172.21.15.31:0/1353685730 shutdown_connections 2024-08-17T02:25:21.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.650+0000 7fa85ffff700 1 -- 172.21.15.31:0/1353685730 wait complete. 2024-08-17T02:25:21.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85ffff700 1 Processor -- start 2024-08-17T02:25:21.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85ffff700 1 -- start start 2024-08-17T02:25:21.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa86006a430 0x7fa86014af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600af820 0x7fa860146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860156650 0x7fa8600c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860146ba0 con 0x7fa8600af820 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85ffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860152c10 con 0x7fa860156650 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85ffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8601685b0 con 0x7fa86006a430 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600af820 0x7fa860146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600af820 0x7fa860146660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36742/0 (socket says 172.21.15.31:36742) 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85e7fc700 1 -- 172.21.15.31:0/3412339165 learned_addr learned my addr 172.21.15.31:0/3412339165 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85effd700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa86006a430 0x7fa86014af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85f7fe700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860156650 0x7fa8600c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85e7fc700 1 -- 172.21.15.31:0/3412339165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa86006a430 msgr2=0x7fa86014af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85e7fc700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa86006a430 0x7fa86014af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85e7fc700 1 -- 172.21.15.31:0/3412339165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860156650 msgr2=0x7fa8600c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85e7fc700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860156650 0x7fa8600c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85e7fc700 1 -- 172.21.15.31:0/3412339165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858009a20 con 0x7fa8600af820 2024-08-17T02:25:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85e7fc700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600af820 0x7fa860146660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa85400ec80 tx=0x7fa8540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:21.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa846ffd700 1 -- 172.21.15.31:0/3412339165 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400c850 con 0x7fa8600af820 2024-08-17T02:25:21.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa846ffd700 1 -- 172.21.15.31:0/3412339165 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85400c9b0 con 0x7fa8600af820 2024-08-17T02:25:21.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85ffff700 1 -- 172.21.15.31:0/3412339165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa860152600 con 0x7fa8600af820 2024-08-17T02:25:21.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa846ffd700 1 -- 172.21.15.31:0/3412339165 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400cd50 con 0x7fa8600af820 2024-08-17T02:25:21.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.654+0000 7fa85ffff700 1 -- 172.21.15.31:0/3412339165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8601528a0 con 0x7fa8600af820 2024-08-17T02:25:21.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.658+0000 7fa85ffff700 1 -- 172.21.15.31:0/3412339165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa860152da0 con 0x7fa8600af820 2024-08-17T02:25:21.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.658+0000 7fa846ffd700 1 -- 172.21.15.31:0/3412339165 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa854013680 con 0x7fa8600af820 2024-08-17T02:25:21.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.658+0000 7fa846ffd700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa84c060860 0x7fa84c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.658+0000 7fa846ffd700 1 -- 172.21.15.31:0/3412339165 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa85407cdd0 con 0x7fa8600af820 2024-08-17T02:25:21.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.658+0000 7fa85effd700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa84c060860 0x7fa84c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.658+0000 7fa85effd700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa84c060860 0x7fa84c062d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa850007fd0 tx=0x7fa850009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:21.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.662+0000 7fa846ffd700 1 -- 172.21.15.31:0/3412339165 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa85404d220 con 0x7fa8600af820 2024-08-17T02:25:21.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.866+0000 7fa85ffff700 1 -- 172.21.15.31:0/3412339165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8600712b0 con 0x7fa8600af820 2024-08-17T02:25:21.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.866+0000 7fa846ffd700 1 -- 172.21.15.31:0/3412339165 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fa854050840 con 0x7fa8600af820 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:21.870 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2641277078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2641277078},{"type":"v1","addr":"172.21.15.92:6835","nonce":2641277078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2478493982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2478493982},{"type":"v1","addr":"172.21.15.92:6833","nonce":2478493982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/3915393252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3915393252},{"type":"v1","addr":"172.21.15.31:6836","nonce":3915393252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:46.040941+0000","modified":"2024-08-17T02:24:48.689838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6837/2360104768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":2360104768},{"type":"v1","addr":"172.21.15.31:6837","nonce":2360104768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 -- 172.21.15.31:0/3412339165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa84c060860 msgr2=0x7fa84c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa84c060860 0x7fa84c062d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa850007fd0 tx=0x7fa850009040 comp rx=0 tx=0).stop 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 -- 172.21.15.31:0/3412339165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600af820 msgr2=0x7fa860146660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600af820 0x7fa860146660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa85400ec80 tx=0x7fa8540091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 -- 172.21.15.31:0/3412339165 shutdown_connections 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa84c060860 0x7fa84c062d10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860156650 0x7fa8600c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8600af820 0x7fa860146660 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 --2- 172.21.15.31:0/3412339165 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa86006a430 0x7fa86014af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 -- 172.21.15.31:0/3412339165 >> 172.21.15.31:0/3412339165 conn(0x7fa8600cd2b0 msgr2=0x7fa860068380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:21.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 -- 172.21.15.31:0/3412339165 shutdown_connections 2024-08-17T02:25:21.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.870+0000 7fa85ffff700 1 -- 172.21.15.31:0/3412339165 wait complete. 2024-08-17T02:25:21.873 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-08-17T02:25:21.884 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.986+0000 7fbed9e64700 1 Processor -- start 2024-08-17T02:25:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.986+0000 7fbed9e64700 1 -- start start 2024-08-17T02:25:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbed40691b0 0x7fbed4069580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed4161e80 0x7fbed415d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed4141e40 con 0x7fbed415d8b0 2024-08-17T02:25:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed415dd30 con 0x7fbed40691b0 2024-08-17T02:25:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed4141230 con 0x7fbed4161e80 2024-08-17T02:25:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9663700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbed415d8b0 0x7fbed40b0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52622/0 (socket says 172.21.15.31:52622) 2024-08-17T02:25:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9663700 1 -- 172.21.15.31:0/3723186175 learned_addr learned my addr 172.21.15.31:0/3723186175 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:21.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed3fff700 1 --2- 172.21.15.31:0/3723186175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed4161e80 0x7fbed415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed8e62700 1 --2- 172.21.15.31:0/3723186175 >> v2:172.21.15.92:3300/0 conn(0x7fbed40691b0 0x7fbed4069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed3fff700 1 -- 172.21.15.31:0/3723186175 >> v2:172.21.15.92:3300/0 conn(0x7fbed40691b0 msgr2=0x7fbed4069580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:21.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed3fff700 1 --2- 172.21.15.31:0/3723186175 >> v2:172.21.15.92:3300/0 conn(0x7fbed40691b0 0x7fbed4069580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed3fff700 1 -- 172.21.15.31:0/3723186175 >> v1:172.21.15.31:6789/0 conn(0x7fbed415d8b0 legacy=0x7fbed40b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed3fff700 1 -- 172.21.15.31:0/3723186175 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4141510 con 0x7fbed4161e80 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed3fff700 1 --2- 172.21.15.31:0/3723186175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed4161e80 0x7fbed415d370 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0098e0 tx=0x7fbebc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d36a2b1470bf5ac6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed37fe700 1 -- 172.21.15.31:0/3723186175 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00b640 con 0x7fbed4161e80 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed37fe700 1 -- 172.21.15.31:0/3723186175 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc00b7a0 con 0x7fbed4161e80 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed37fe700 1 -- 172.21.15.31:0/3723186175 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00bb40 con 0x7fbed4161e80 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 -- 172.21.15.31:0/3723186175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed4161e80 msgr2=0x7fbed415d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 --2- 172.21.15.31:0/3723186175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed4161e80 0x7fbed415d370 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0098e0 tx=0x7fbebc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 -- 172.21.15.31:0/3723186175 shutdown_connections 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 --2- 172.21.15.31:0/3723186175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed4161e80 0x7fbed415d370 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 --2- 172.21.15.31:0/3723186175 >> v2:172.21.15.92:3300/0 conn(0x7fbed40691b0 0x7fbed4069580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 -- 172.21.15.31:0/3723186175 >> 172.21.15.31:0/3723186175 conn(0x7fbed4067400 msgr2=0x7fbed4067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:21.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 -- 172.21.15.31:0/3723186175 shutdown_connections 2024-08-17T02:25:21.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.990+0000 7fbed9e64700 1 -- 172.21.15.31:0/3723186175 wait complete. 2024-08-17T02:25:21.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9e64700 1 Processor -- start 2024-08-17T02:25:21.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9e64700 1 -- start start 2024-08-17T02:25:21.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9e64700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed40691b0 0x7fbed41708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9e64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbed415d8b0 0x7fbed40a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9e64700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbed4161e80 0x7fbed41430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9e64700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40a8090 con 0x7fbed415d8b0 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9e64700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40ab1f0 con 0x7fbed4161e80 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9e64700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed4170e20 con 0x7fbed40691b0 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed8e62700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed40691b0 0x7fbed41708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbed415d8b0 0x7fbed40a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed8e62700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed40691b0 0x7fbed41708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:48254/0 (socket says 172.21.15.31:48254) 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed8e62700 1 -- 172.21.15.31:0/2636314304 learned_addr learned my addr 172.21.15.31:0/2636314304 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9663700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbed4161e80 0x7fbed41430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed8e62700 1 -- 172.21.15.31:0/2636314304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbed4161e80 msgr2=0x7fbed41430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed8e62700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbed4161e80 0x7fbed41430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed8e62700 1 -- 172.21.15.31:0/2636314304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbed415d8b0 msgr2=0x7fbed40a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:21.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed8e62700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbed415d8b0 0x7fbed40a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:21.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed8e62700 1 -- 172.21.15.31:0/2636314304 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc009420 con 0x7fbed40691b0 2024-08-17T02:25:21.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed8e62700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed40691b0 0x7fbed41708e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbec400ec80 tx=0x7fbec40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:21.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed0ff9700 1 -- 172.21.15.31:0/2636314304 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec400c850 con 0x7fbed40691b0 2024-08-17T02:25:21.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed0ff9700 1 -- 172.21.15.31:0/2636314304 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec400c9b0 con 0x7fbed40691b0 2024-08-17T02:25:21.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9e64700 1 -- 172.21.15.31:0/2636314304 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed40a9d30 con 0x7fbed40691b0 2024-08-17T02:25:21.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed0ff9700 1 -- 172.21.15.31:0/2636314304 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec400cd50 con 0x7fbed40691b0 2024-08-17T02:25:21.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.994+0000 7fbed9e64700 1 -- 172.21.15.31:0/2636314304 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed40a79d0 con 0x7fbed40691b0 2024-08-17T02:25:21.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.998+0000 7fbed9e64700 1 -- 172.21.15.31:0/2636314304 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed40a8300 con 0x7fbed40691b0 2024-08-17T02:25:22.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.998+0000 7fbed0ff9700 1 -- 172.21.15.31:0/2636314304 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fbec4013680 con 0x7fbed40691b0 2024-08-17T02:25:22.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.998+0000 7fbed0ff9700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbeb4060860 0x7fbeb4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.998+0000 7fbed3fff700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbeb4060860 0x7fbeb4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.998+0000 7fbed0ff9700 1 -- 172.21.15.31:0/2636314304 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbec407d1e0 con 0x7fbed40691b0 2024-08-17T02:25:22.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:21.998+0000 7fbed3fff700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbeb4060860 0x7fbeb4062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0093f0 tx=0x7fbebc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.006+0000 7fbed0ff9700 1 -- 172.21.15.31:0/2636314304 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fbec404d590 con 0x7fbed40691b0 2024-08-17T02:25:22.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.174+0000 7fbed9e64700 1 -- 172.21.15.31:0/2636314304 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbed40712b0 con 0x7fbed40691b0 2024-08-17T02:25:22.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.182+0000 7fbed0ff9700 1 -- 172.21.15.31:0/2636314304 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fbec4050bb0 con 0x7fbed40691b0 2024-08-17T02:25:22.183 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:22.184 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.182+0000 7fbed9e64700 1 -- 172.21.15.31:0/2636314304 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbeb4060860 msgr2=0x7fbeb4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.182+0000 7fbed9e64700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbeb4060860 0x7fbeb4062d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0093f0 tx=0x7fbebc017000 comp rx=0 tx=0).stop 2024-08-17T02:25:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.182+0000 7fbed9e64700 1 -- 172.21.15.31:0/2636314304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed40691b0 msgr2=0x7fbed41708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.182+0000 7fbed9e64700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed40691b0 0x7fbed41708e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbec400ec80 tx=0x7fbec40091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.182+0000 7fbed9e64700 1 -- 172.21.15.31:0/2636314304 shutdown_connections 2024-08-17T02:25:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.182+0000 7fbed9e64700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fbeb4060860 0x7fbeb4062d10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.182+0000 7fbed9e64700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbed4161e80 0x7fbed41430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.182+0000 7fbed9e64700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbed415d8b0 0x7fbed40a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.182+0000 7fbed9e64700 1 --2- 172.21.15.31:0/2636314304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbed40691b0 0x7fbed41708e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.186+0000 7fbed9e64700 1 -- 172.21.15.31:0/2636314304 >> 172.21.15.31:0/2636314304 conn(0x7fbed4067400 msgr2=0x7fbed406eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.186+0000 7fbed9e64700 1 -- 172.21.15.31:0/2636314304 shutdown_connections 2024-08-17T02:25:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.186+0000 7fbed9e64700 1 -- 172.21.15.31:0/2636314304 wait complete. 2024-08-17T02:25:22.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:24:43.691230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:24:45.035480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:22.199 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:22.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9ddb5c700 1 Processor -- start 2024-08-17T02:25:22.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9ddb5c700 1 -- start start 2024-08-17T02:25:22.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9ddb5c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8068aa0 0x7fd9d8068e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9ddb5c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd9d8159fd0 0x7fd9d80af290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9ddb5c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d815cc00 con 0x7fd9d80cb010 2024-08-17T02:25:22.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9ddb5c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d8150510 con 0x7fd9d8159fd0 2024-08-17T02:25:22.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9ddb5c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80cb400 con 0x7fd9d8068aa0 2024-08-17T02:25:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9dcb5a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8068aa0 0x7fd9d8068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9dd35b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd9d8159fd0 0x7fd9d80af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9dcb5a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8068aa0 0x7fd9d8068e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:48264/0 (socket says 172.21.15.31:48264) 2024-08-17T02:25:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9dd35b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd9d8159fd0 0x7fd9d80af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36880/0 (socket says 172.21.15.31:36880) 2024-08-17T02:25:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9dcb5a700 1 -- 172.21.15.31:0/1755718758 learned_addr learned my addr 172.21.15.31:0/1755718758 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.310+0000 7fd9d7fff700 1 --1- 172.21.15.31:0/1755718758 >> v1:172.21.15.92:6789/0 conn(0x7fd9d80cb010 0x7fd9d80aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:33662/0 (socket says 172.21.15.31:33662) 2024-08-17T02:25:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9dcb5a700 1 -- 172.21.15.31:0/1755718758 >> v2:172.21.15.92:3300/0 conn(0x7fd9d8159fd0 msgr2=0x7fd9d80af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9dcb5a700 1 --2- 172.21.15.31:0/1755718758 >> v2:172.21.15.92:3300/0 conn(0x7fd9d8159fd0 0x7fd9d80af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9dcb5a700 1 -- 172.21.15.31:0/1755718758 >> v1:172.21.15.92:6789/0 conn(0x7fd9d80cb010 legacy=0x7fd9d80aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9dcb5a700 1 -- 172.21.15.31:0/1755718758 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d815ce50 con 0x7fd9d8068aa0 2024-08-17T02:25:22.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9dd35b700 1 --2- 172.21.15.31:0/1755718758 >> v2:172.21.15.92:3300/0 conn(0x7fd9d8159fd0 0x7fd9d80af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:22.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9dcb5a700 1 --2- 172.21.15.31:0/1755718758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8068aa0 0x7fd9d8068e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0099b0 tx=0x7fd9cc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36503137bc5e9d33 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9d77fe700 1 -- 172.21.15.31:0/1755718758 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc009ea0 con 0x7fd9d8068aa0 2024-08-17T02:25:22.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9d77fe700 1 -- 172.21.15.31:0/1755718758 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc00b860 con 0x7fd9d8068aa0 2024-08-17T02:25:22.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9d77fe700 1 -- 172.21.15.31:0/1755718758 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00bc00 con 0x7fd9d8068aa0 2024-08-17T02:25:22.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/1755718758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8068aa0 msgr2=0x7fd9d8068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9ddb5c700 1 --2- 172.21.15.31:0/1755718758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8068aa0 0x7fd9d8068e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0099b0 tx=0x7fd9cc009250 comp rx=0 tx=0).stop 2024-08-17T02:25:22.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/1755718758 shutdown_connections 2024-08-17T02:25:22.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9ddb5c700 1 --2- 172.21.15.31:0/1755718758 >> v2:172.21.15.92:3300/0 conn(0x7fd9d8159fd0 0x7fd9d80af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9ddb5c700 1 --2- 172.21.15.31:0/1755718758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8068aa0 0x7fd9d8068e70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/1755718758 >> 172.21.15.31:0/1755718758 conn(0x7fd9d80d0090 msgr2=0x7fd9d80d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/1755718758 shutdown_connections 2024-08-17T02:25:22.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.314+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/1755718758 wait complete. 2024-08-17T02:25:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9ddb5c700 1 Processor -- start 2024-08-17T02:25:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9ddb5c700 1 -- start start 2024-08-17T02:25:22.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9ddb5c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9d8068aa0 0x7fd9d80ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9ddb5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d80cb010 0x7fd9d8169cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9ddb5c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8159fd0 0x7fd9d813b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9ddb5c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d816a230 con 0x7fd9d80cb010 2024-08-17T02:25:22.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9ddb5c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d816c830 con 0x7fd9d8068aa0 2024-08-17T02:25:22.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9ddb5c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d816d0d0 con 0x7fd9d8159fd0 2024-08-17T02:25:22.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9d7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d80cb010 0x7fd9d8169cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9d7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d80cb010 0x7fd9d8169cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36758/0 (socket says 172.21.15.31:36758) 2024-08-17T02:25:22.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9d7fff700 1 -- 172.21.15.31:0/2815872745 learned_addr learned my addr 172.21.15.31:0/2815872745 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:22.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9dcb5a700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9d8068aa0 0x7fd9d80ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9dd35b700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8159fd0 0x7fd9d813b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9d7fff700 1 -- 172.21.15.31:0/2815872745 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8159fd0 msgr2=0x7fd9d813b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9d7fff700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8159fd0 0x7fd9d813b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9d7fff700 1 -- 172.21.15.31:0/2815872745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9d8068aa0 msgr2=0x7fd9d80ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9d7fff700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9d8068aa0 0x7fd9d80ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9d7fff700 1 -- 172.21.15.31:0/2815872745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d0009a20 con 0x7fd9d80cb010 2024-08-17T02:25:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9d7fff700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d80cb010 0x7fd9d8169cf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400c7f0 tx=0x7fd9c4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9d4ff9700 1 -- 172.21.15.31:0/2815872745 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4005a70 con 0x7fd9d80cb010 2024-08-17T02:25:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/2815872745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc0094f0 con 0x7fd9d80cb010 2024-08-17T02:25:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.318+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/2815872745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d816ca80 con 0x7fd9d80cb010 2024-08-17T02:25:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.322+0000 7fd9d4ff9700 1 -- 172.21.15.31:0/2815872745 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c4005de0 con 0x7fd9d80cb010 2024-08-17T02:25:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.322+0000 7fd9d4ff9700 1 -- 172.21.15.31:0/2815872745 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40070d0 con 0x7fd9d80cb010 2024-08-17T02:25:22.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.322+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/2815872745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b80052b0 con 0x7fd9d80cb010 2024-08-17T02:25:22.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.322+0000 7fd9d4ff9700 1 -- 172.21.15.31:0/2815872745 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd9c4007500 con 0x7fd9d80cb010 2024-08-17T02:25:22.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.322+0000 7fd9d4ff9700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd9bc060860 0x7fd9bc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.322+0000 7fd9dcb5a700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd9bc060860 0x7fd9bc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.322+0000 7fd9d4ff9700 1 -- 172.21.15.31:0/2815872745 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9c407be50 con 0x7fd9d80cb010 2024-08-17T02:25:22.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.326+0000 7fd9dcb5a700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd9bc060860 0x7fd9bc062d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0099b0 tx=0x7fd9cc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.334+0000 7fd9d4ff9700 1 -- 172.21.15.31:0/2815872745 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd9c404a480 con 0x7fd9d80cb010 2024-08-17T02:25:22.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.494+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/2815872745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9b8005ae0 con 0x7fd9d80cb010 2024-08-17T02:25:22.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9d4ff9700 1 -- 172.21.15.31:0/2815872745 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9c4017070 con 0x7fd9d80cb010 2024-08-17T02:25:22.499 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:25:22.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/2815872745 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd9bc060860 msgr2=0x7fd9bc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd9bc060860 0x7fd9bc062d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0099b0 tx=0x7fd9cc017000 comp rx=0 tx=0).stop 2024-08-17T02:25:22.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/2815872745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d80cb010 msgr2=0x7fd9d8169cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d80cb010 0x7fd9d8169cf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd9c400c7f0 tx=0x7fd9c4007f70 comp rx=0 tx=0).stop 2024-08-17T02:25:22.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/2815872745 shutdown_connections 2024-08-17T02:25:22.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd9bc060860 0x7fd9bc062d10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd9d8159fd0 0x7fd9d813b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9d80cb010 0x7fd9d8169cf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 --2- 172.21.15.31:0/2815872745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9d8068aa0 0x7fd9d80ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/2815872745 >> 172.21.15.31:0/2815872745 conn(0x7fd9d80d0090 msgr2=0x7fd9d80c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/2815872745 shutdown_connections 2024-08-17T02:25:22.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.498+0000 7fd9ddb5c700 1 -- 172.21.15.31:0/2815872745 wait complete. 2024-08-17T02:25:22.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:22.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.626+0000 7feeabee1700 1 Processor -- start 2024-08-17T02:25:22.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.626+0000 7feeabee1700 1 -- start start 2024-08-17T02:25:22.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4155f30 0x7feea40c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feea4159d00 0x7feea415a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea4069da0 con 0x7feea4156300 2024-08-17T02:25:22.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea415a680 con 0x7feea4159d00 2024-08-17T02:25:22.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea40aef60 con 0x7feea4155f30 2024-08-17T02:25:22.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeaa47e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feea4159d00 0x7feea415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeaa47e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feea4159d00 0x7feea415a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36772/0 (socket says 172.21.15.31:36772) 2024-08-17T02:25:22.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeaa47e700 1 -- 172.21.15.31:0/1913807400 learned_addr learned my addr 172.21.15.31:0/1913807400 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:22.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feea9c7d700 1 --2- 172.21.15.31:0/1913807400 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4155f30 0x7feea40c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeaa47e700 1 -- 172.21.15.31:0/1913807400 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4155f30 msgr2=0x7feea40c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:22.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeaa47e700 1 --2- 172.21.15.31:0/1913807400 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4155f30 0x7feea40c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeaa47e700 1 -- 172.21.15.31:0/1913807400 >> v1:172.21.15.92:6789/0 conn(0x7feea4156300 legacy=0x7feea4069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeaa47e700 1 -- 172.21.15.31:0/1913807400 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40af240 con 0x7feea4159d00 2024-08-17T02:25:22.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feea9c7d700 1 --2- 172.21.15.31:0/1913807400 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4155f30 0x7feea40c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:22.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeaa47e700 1 --2- 172.21.15.31:0/1913807400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4159d00 0x7feea415a140 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009f20 tx=0x7fee9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f78676d95c2af8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feea8c7b700 1 -- 172.21.15.31:0/1913807400 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00e070 con 0x7feea4159d00 2024-08-17T02:25:22.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feea8c7b700 1 -- 172.21.15.31:0/1913807400 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00ba80 con 0x7feea4159d00 2024-08-17T02:25:22.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feea8c7b700 1 -- 172.21.15.31:0/1913807400 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c0092e0 con 0x7feea4159d00 2024-08-17T02:25:22.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 -- 172.21.15.31:0/1913807400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4159d00 msgr2=0x7feea415a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 --2- 172.21.15.31:0/1913807400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4159d00 0x7feea415a140 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009f20 tx=0x7fee9c009840 comp rx=0 tx=0).stop 2024-08-17T02:25:22.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 -- 172.21.15.31:0/1913807400 shutdown_connections 2024-08-17T02:25:22.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 --2- 172.21.15.31:0/1913807400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4159d00 0x7feea415a140 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 --2- 172.21.15.31:0/1913807400 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4155f30 0x7feea40c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 -- 172.21.15.31:0/1913807400 >> 172.21.15.31:0/1913807400 conn(0x7feea4067e40 msgr2=0x7feea4068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 -- 172.21.15.31:0/1913807400 shutdown_connections 2024-08-17T02:25:22.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.630+0000 7feeabee1700 1 -- 172.21.15.31:0/1913807400 wait complete. 2024-08-17T02:25:22.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feeabee1700 1 Processor -- start 2024-08-17T02:25:22.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feeabee1700 1 -- start start 2024-08-17T02:25:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feeabee1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4155f30 0x7feea4141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feeabee1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feea4156300 0x7feea4151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feeabee1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4159d00 0x7feea4151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feeabee1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea4158900 con 0x7feea4155f30 2024-08-17T02:25:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feeabee1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea4158be0 con 0x7feea4156300 2024-08-17T02:25:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feeabee1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea4158ec0 con 0x7feea4159d00 2024-08-17T02:25:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feea9c7d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4155f30 0x7feea4141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feea9c7d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4155f30 0x7feea4141900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36782/0 (socket says 172.21.15.31:36782) 2024-08-17T02:25:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feea9c7d700 1 -- 172.21.15.31:0/1160039781 learned_addr learned my addr 172.21.15.31:0/1160039781 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feeaa47e700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4159d00 0x7feea4151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feea947c700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feea4156300 0x7feea4151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feea9c7d700 1 -- 172.21.15.31:0/1160039781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4159d00 msgr2=0x7feea4151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feea9c7d700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4159d00 0x7feea4151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feea9c7d700 1 -- 172.21.15.31:0/1160039781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feea4156300 msgr2=0x7feea4151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feea9c7d700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feea4156300 0x7feea4151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.634+0000 7feea9c7d700 1 -- 172.21.15.31:0/1160039781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c009ae0 con 0x7feea4155f30 2024-08-17T02:25:22.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.638+0000 7feea9c7d700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4155f30 0x7feea4141900 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feea000e8d0 tx=0x7feea0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.638+0000 7fee95ffb700 1 -- 172.21.15.31:0/1160039781 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0013410 con 0x7feea4155f30 2024-08-17T02:25:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.638+0000 7fee95ffb700 1 -- 172.21.15.31:0/1160039781 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0013570 con 0x7feea4155f30 2024-08-17T02:25:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.638+0000 7feeabee1700 1 -- 172.21.15.31:0/1160039781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea41591a0 con 0x7feea4155f30 2024-08-17T02:25:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.638+0000 7fee95ffb700 1 -- 172.21.15.31:0/1160039781 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0013910 con 0x7feea4155f30 2024-08-17T02:25:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.638+0000 7feeabee1700 1 -- 172.21.15.31:0/1160039781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea41599a0 con 0x7feea4155f30 2024-08-17T02:25:22.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.638+0000 7feeabee1700 1 -- 172.21.15.31:0/1160039781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea40712b0 con 0x7feea4155f30 2024-08-17T02:25:22.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.638+0000 7fee95ffb700 1 -- 172.21.15.31:0/1160039781 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7feea0013d40 con 0x7feea4155f30 2024-08-17T02:25:22.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.642+0000 7fee95ffb700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee88060860 0x7fee88062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.642+0000 7fee95ffb700 1 -- 172.21.15.31:0/1160039781 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feea007c840 con 0x7feea4155f30 2024-08-17T02:25:22.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.642+0000 7feea947c700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee88060860 0x7fee88062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.642+0000 7feea947c700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee88060860 0x7fee88062d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feea40acbd0 tx=0x7fee98007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.646+0000 7fee95ffb700 1 -- 172.21.15.31:0/1160039781 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7feea004cc90 con 0x7feea4155f30 2024-08-17T02:25:22.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.810+0000 7feeabee1700 1 -- 172.21.15.31:0/1160039781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feea4068d60 con 0x7feea4155f30 2024-08-17T02:25:22.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.810+0000 7fee95ffb700 1 -- 172.21.15.31:0/1160039781 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7feea0020020 con 0x7feea4155f30 2024-08-17T02:25:22.812 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:25:22.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.810+0000 7feeabee1700 1 -- 172.21.15.31:0/1160039781 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee88060860 msgr2=0x7fee88062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.810+0000 7feeabee1700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee88060860 0x7fee88062d10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feea40acbd0 tx=0x7fee98007e80 comp rx=0 tx=0).stop 2024-08-17T02:25:22.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.810+0000 7feeabee1700 1 -- 172.21.15.31:0/1160039781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4155f30 msgr2=0x7feea4141900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.810+0000 7feeabee1700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4155f30 0x7feea4141900 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feea000e8d0 tx=0x7feea0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:22.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.814+0000 7feeabee1700 1 -- 172.21.15.31:0/1160039781 shutdown_connections 2024-08-17T02:25:22.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.814+0000 7feeabee1700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee88060860 0x7fee88062d10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.814+0000 7feeabee1700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feea4159d00 0x7feea4151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.814+0000 7feeabee1700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feea4156300 0x7feea4151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.814+0000 7feeabee1700 1 --2- 172.21.15.31:0/1160039781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4155f30 0x7feea4141900 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.814+0000 7feeabee1700 1 -- 172.21.15.31:0/1160039781 >> 172.21.15.31:0/1160039781 conn(0x7feea4067e40 msgr2=0x7feea41501f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.814+0000 7feeabee1700 1 -- 172.21.15.31:0/1160039781 shutdown_connections 2024-08-17T02:25:22.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.814+0000 7feeabee1700 1 -- 172.21.15.31:0/1160039781 wait complete. 2024-08-17T02:25:22.826 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:22.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.942+0000 7f9201012700 1 Processor -- start 2024-08-17T02:25:22.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.942+0000 7f9201012700 1 -- start start 2024-08-17T02:25:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f9201012700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91fc142810 0x7f91fc0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f9201012700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc15cdf0 0x7f91fc0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f9201012700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc06c320 con 0x7f91fc142be0 2024-08-17T02:25:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f9201012700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc06b430 con 0x7f91fc142810 2024-08-17T02:25:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f9201012700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc06b710 con 0x7f91fc15cdf0 2024-08-17T02:25:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91fb7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f91fc142be0 0x7f91fc068b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52636/0 (socket says 172.21.15.31:52636) 2024-08-17T02:25:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91fb7fe700 1 -- 172.21.15.31:0/2144329907 learned_addr learned my addr 172.21.15.31:0/2144329907 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91fbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91fc142810 0x7f91fc0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f9200811700 1 --2- 172.21.15.31:0/2144329907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc15cdf0 0x7f91fc0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91faffd700 1 -- 172.21.15.31:0/2144329907 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815211993 0 0) 0x7f91fc06c320 con 0x7f91fc142be0 2024-08-17T02:25:22.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91faffd700 1 -- 172.21.15.31:0/2144329907 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e8003570 con 0x7f91fc142be0 2024-08-17T02:25:22.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91fbfff700 1 -- 172.21.15.31:0/2144329907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc15cdf0 msgr2=0x7f91fc0adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91fbfff700 1 --2- 172.21.15.31:0/2144329907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc15cdf0 0x7f91fc0adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91fbfff700 1 -- 172.21.15.31:0/2144329907 >> v1:172.21.15.31:6789/0 conn(0x7f91fc142be0 legacy=0x7f91fc068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91fbfff700 1 -- 172.21.15.31:0/2144329907 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc06b9f0 con 0x7f91fc142810 2024-08-17T02:25:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91fbfff700 1 --2- 172.21.15.31:0/2144329907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc142810 0x7f91fc0ad700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0098e0 tx=0x7f91ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72b3d8112fb935d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91faffd700 1 -- 172.21.15.31:0/2144329907 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec011630 con 0x7f91fc142810 2024-08-17T02:25:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91faffd700 1 -- 172.21.15.31:0/2144329907 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec011790 con 0x7f91fc142810 2024-08-17T02:25:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.946+0000 7f91faffd700 1 -- 172.21.15.31:0/2144329907 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec011b30 con 0x7f91fc142810 2024-08-17T02:25:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 -- 172.21.15.31:0/2144329907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc142810 msgr2=0x7f91fc0ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 --2- 172.21.15.31:0/2144329907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc142810 0x7f91fc0ad700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0098e0 tx=0x7f91ec0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 -- 172.21.15.31:0/2144329907 shutdown_connections 2024-08-17T02:25:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 --2- 172.21.15.31:0/2144329907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc15cdf0 0x7f91fc0adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 --2- 172.21.15.31:0/2144329907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc142810 0x7f91fc0ad700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 -- 172.21.15.31:0/2144329907 >> 172.21.15.31:0/2144329907 conn(0x7f91fc0b33c0 msgr2=0x7f91fc0b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:22.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 -- 172.21.15.31:0/2144329907 shutdown_connections 2024-08-17T02:25:22.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 -- 172.21.15.31:0/2144329907 wait complete. 2024-08-17T02:25:22.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 Processor -- start 2024-08-17T02:25:22.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 -- start start 2024-08-17T02:25:22.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc142810 0x7f91fc15b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91fc142be0 0x7f91fc1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc15cdf0 0x7f91fc13d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc169d00 con 0x7f91fc15cdf0 2024-08-17T02:25:22.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0c9b00 con 0x7f91fc142be0 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9201012700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc0c7600 con 0x7f91fc142810 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9200811700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc15cdf0 0x7f91fc13d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9200811700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc15cdf0 0x7f91fc13d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36806/0 (socket says 172.21.15.31:36806) 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9200811700 1 -- 172.21.15.31:0/1632023139 learned_addr learned my addr 172.21.15.31:0/1632023139 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f91fbfff700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc142810 0x7f91fc15b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f91fb7fe700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91fc142be0 0x7f91fc1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f91fbfff700 1 -- 172.21.15.31:0/1632023139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91fc142be0 msgr2=0x7f91fc1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f91fbfff700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91fc142be0 0x7f91fc1575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f91fbfff700 1 -- 172.21.15.31:0/1632023139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc15cdf0 msgr2=0x7f91fc13d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f91fbfff700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc15cdf0 0x7f91fc13d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f91fbfff700 1 -- 172.21.15.31:0/1632023139 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec009420 con 0x7f91fc142810 2024-08-17T02:25:22.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f9200811700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc15cdf0 0x7f91fc13d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:22.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.950+0000 7f91fbfff700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc142810 0x7f91fc15b460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91ec016000 tx=0x7f91ec017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f91f3fff700 1 -- 172.21.15.31:0/1632023139 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec000d10 con 0x7f91fc142810 2024-08-17T02:25:22.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f91f3fff700 1 -- 172.21.15.31:0/1632023139 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec011b10 con 0x7f91fc142810 2024-08-17T02:25:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f9201012700 1 -- 172.21.15.31:0/1632023139 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc0c78e0 con 0x7f91fc142810 2024-08-17T02:25:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f91f3fff700 1 -- 172.21.15.31:0/1632023139 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec025660 con 0x7f91fc142810 2024-08-17T02:25:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f9201012700 1 -- 172.21.15.31:0/1632023139 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc0c7ea0 con 0x7f91fc142810 2024-08-17T02:25:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f91f3fff700 1 -- 172.21.15.31:0/1632023139 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f91ec02e450 con 0x7f91fc142810 2024-08-17T02:25:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f9201012700 1 -- 172.21.15.31:0/1632023139 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc0712b0 con 0x7f91fc142810 2024-08-17T02:25:22.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f91f3fff700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91dc060860 0x7f91dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:22.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f91fb7fe700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91dc060860 0x7f91dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:22.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f91f3fff700 1 -- 172.21.15.31:0/1632023139 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91ec07e270 con 0x7f91fc142810 2024-08-17T02:25:22.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.954+0000 7f91fb7fe700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91dc060860 0x7f91dc062d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0ca510 tx=0x7f91e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:22.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:22.966+0000 7f91f3fff700 1 -- 172.21.15.31:0/1632023139 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f91ec04e6c0 con 0x7f91fc142810 2024-08-17T02:25:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.130+0000 7f9201012700 1 -- 172.21.15.31:0/1632023139 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91fc06ec00 con 0x7f91fc142810 2024-08-17T02:25:23.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f91f3fff700 1 -- 172.21.15.31:0/1632023139 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91ec051ce0 con 0x7f91fc142810 2024-08-17T02:25:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-08-17T02:25:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 -- 172.21.15.31:0/1632023139 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91dc060860 msgr2=0x7f91dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91dc060860 0x7f91dc062d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0ca510 tx=0x7f91e4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 -- 172.21.15.31:0/1632023139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc142810 msgr2=0x7f91fc15b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc142810 0x7f91fc15b460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91ec016000 tx=0x7f91ec017000 comp rx=0 tx=0).stop 2024-08-17T02:25:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 -- 172.21.15.31:0/1632023139 shutdown_connections 2024-08-17T02:25:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f91dc060860 0x7f91dc062d10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91fc15cdf0 0x7f91fc13d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91fc142be0 0x7f91fc1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 --2- 172.21.15.31:0/1632023139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91fc142810 0x7f91fc15b460 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 -- 172.21.15.31:0/1632023139 >> 172.21.15.31:0/1632023139 conn(0x7f91fc0b33c0 msgr2=0x7f91fc0ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 -- 172.21.15.31:0/1632023139 shutdown_connections 2024-08-17T02:25:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.134+0000 7f9201012700 1 -- 172.21.15.31:0/1632023139 wait complete. 2024-08-17T02:25:23.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:23.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d626c700 1 Processor -- start 2024-08-17T02:25:23.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d626c700 1 -- start start 2024-08-17T02:25:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d626c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f69d00ad6f0 0x7f69d00adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d626c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69d015b740 0x7f69d015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d626c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d015b2b0 con 0x7f69d015ce20 2024-08-17T02:25:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d626c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d00ae410 con 0x7f69d00ad6f0 2024-08-17T02:25:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d626c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d015aca0 con 0x7f69d015b740 2024-08-17T02:25:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d4a69700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f69d00ad6f0 0x7f69d00adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d4a69700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f69d00ad6f0 0x7f69d00adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36820/0 (socket says 172.21.15.31:36820) 2024-08-17T02:25:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d4a69700 1 -- 172.21.15.31:0/2755280926 learned_addr learned my addr 172.21.15.31:0/2755280926 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d526a700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f69d015ce20 0x7f69d015d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52652/0 (socket says 172.21.15.31:52652) 2024-08-17T02:25:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d5a6b700 1 --2- 172.21.15.31:0/2755280926 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69d015b740 0x7f69d015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d4a69700 1 -- 172.21.15.31:0/2755280926 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69d015b740 msgr2=0x7f69d015bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d4a69700 1 --2- 172.21.15.31:0/2755280926 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69d015b740 0x7f69d015bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d4a69700 1 -- 172.21.15.31:0/2755280926 >> v1:172.21.15.31:6789/0 conn(0x7f69d015ce20 legacy=0x7f69d015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d4a69700 1 -- 172.21.15.31:0/2755280926 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d00ae6b0 con 0x7f69d00ad6f0 2024-08-17T02:25:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69c7fff700 1 -- 172.21.15.31:0/2755280926 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19692464 0 0) 0x7f69d015b2b0 con 0x7f69d015ce20 2024-08-17T02:25:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69d4a69700 1 --2- 172.21.15.31:0/2755280926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 0x7f69d00adb10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f69c00099b0 tx=0x7f69c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb61276ae144f9eb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69c7fff700 1 -- 172.21.15.31:0/2755280926 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c0009ea0 con 0x7f69d00ad6f0 2024-08-17T02:25:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69c7fff700 1 -- 172.21.15.31:0/2755280926 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c000b860 con 0x7f69d00ad6f0 2024-08-17T02:25:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.250+0000 7f69c7fff700 1 -- 172.21.15.31:0/2755280926 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c000bc00 con 0x7f69d00ad6f0 2024-08-17T02:25:23.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- 172.21.15.31:0/2755280926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 msgr2=0x7f69d00adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 --2- 172.21.15.31:0/2755280926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 0x7f69d00adb10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f69c00099b0 tx=0x7f69c0009250 comp rx=0 tx=0).stop 2024-08-17T02:25:23.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- 172.21.15.31:0/2755280926 shutdown_connections 2024-08-17T02:25:23.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 --2- 172.21.15.31:0/2755280926 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69d015b740 0x7f69d015bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 --2- 172.21.15.31:0/2755280926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 0x7f69d00adb10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- 172.21.15.31:0/2755280926 >> 172.21.15.31:0/2755280926 conn(0x7f69d0089cb0 msgr2=0x7f69d00995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- 172.21.15.31:0/2755280926 shutdown_connections 2024-08-17T02:25:23.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- 172.21.15.31:0/2755280926 wait complete. 2024-08-17T02:25:23.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 Processor -- start 2024-08-17T02:25:23.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- start start 2024-08-17T02:25:23.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 0x7f69d0153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69d015b740 0x7f69d01578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69d015ce20 0x7f69d00afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d00cdd50 con 0x7f69d00ad6f0 2024-08-17T02:25:23.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0158a30 con 0x7f69d015ce20 2024-08-17T02:25:23.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d0158190 con 0x7f69d015b740 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d526a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 0x7f69d0153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d526a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 0x7f69d0153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36828/0 (socket says 172.21.15.31:36828) 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d526a700 1 -- 172.21.15.31:0/3208296912 learned_addr learned my addr 172.21.15.31:0/3208296912 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d4a69700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69d015b740 0x7f69d01578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d5a6b700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69d015ce20 0x7f69d00afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d526a700 1 -- 172.21.15.31:0/3208296912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69d015b740 msgr2=0x7f69d01578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d526a700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69d015b740 0x7f69d01578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d526a700 1 -- 172.21.15.31:0/3208296912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69d015ce20 msgr2=0x7f69d00afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d526a700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69d015ce20 0x7f69d00afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d526a700 1 -- 172.21.15.31:0/3208296912 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c00094f0 con 0x7f69d00ad6f0 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d526a700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 0x7f69d0153430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00c5b0 tx=0x7f69cc001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69c57fa700 1 -- 172.21.15.31:0/3208296912 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc005a70 con 0x7f69d00ad6f0 2024-08-17T02:25:23.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69c57fa700 1 -- 172.21.15.31:0/3208296912 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc005bd0 con 0x7f69d00ad6f0 2024-08-17T02:25:23.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- 172.21.15.31:0/3208296912 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d0158470 con 0x7f69d00ad6f0 2024-08-17T02:25:23.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69c57fa700 1 -- 172.21.15.31:0/3208296912 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0070d0 con 0x7f69d00ad6f0 2024-08-17T02:25:23.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.254+0000 7f69d626c700 1 -- 172.21.15.31:0/3208296912 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d0169960 con 0x7f69d00ad6f0 2024-08-17T02:25:23.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.258+0000 7f69c57fa700 1 -- 172.21.15.31:0/3208296912 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f69cc007480 con 0x7f69d00ad6f0 2024-08-17T02:25:23.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.258+0000 7f69d626c700 1 -- 172.21.15.31:0/3208296912 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d00cdb20 con 0x7f69d00ad6f0 2024-08-17T02:25:23.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.258+0000 7f69c57fa700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f69b4060860 0x7f69b4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.258+0000 7f69c57fa700 1 -- 172.21.15.31:0/3208296912 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69cc07c120 con 0x7f69d00ad6f0 2024-08-17T02:25:23.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.258+0000 7f69d4a69700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f69b4060860 0x7f69b4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.258+0000 7f69d4a69700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f69b4060860 0x7f69b4062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f69c00099b0 tx=0x7f69c0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.266+0000 7f69c57fa700 1 -- 172.21.15.31:0/3208296912 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f69d00cdb20 con 0x7f69d00ad6f0 2024-08-17T02:25:23.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.462+0000 7f69d626c700 1 -- 172.21.15.31:0/3208296912 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69d00cdb20 con 0x7f69d00ad6f0 2024-08-17T02:25:23.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69c57fa700 1 -- 172.21.15.31:0/3208296912 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f69d00cdb20 con 0x7f69d00ad6f0 2024-08-17T02:25:23.467 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:23.467 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2641277078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2641277078},{"type":"v1","addr":"172.21.15.92:6835","nonce":2641277078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2478493982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2478493982},{"type":"v1","addr":"172.21.15.92:6833","nonce":2478493982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/3915393252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3915393252},{"type":"v1","addr":"172.21.15.31:6836","nonce":3915393252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:46.040941+0000","modified":"2024-08-17T02:24:48.689838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6837/2360104768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":2360104768},{"type":"v1","addr":"172.21.15.31:6837","nonce":2360104768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:23.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 -- 172.21.15.31:0/3208296912 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f69b4060860 msgr2=0x7f69b4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f69b4060860 0x7f69b4062d10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f69c00099b0 tx=0x7f69c0017000 comp rx=0 tx=0).stop 2024-08-17T02:25:23.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 -- 172.21.15.31:0/3208296912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 msgr2=0x7f69d0153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 0x7f69d0153430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00c5b0 tx=0x7f69cc001040 comp rx=0 tx=0).stop 2024-08-17T02:25:23.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 -- 172.21.15.31:0/3208296912 shutdown_connections 2024-08-17T02:25:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f69b4060860 0x7f69b4062d10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69d015ce20 0x7f69d00afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69d015b740 0x7f69d01578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 --2- 172.21.15.31:0/3208296912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69d00ad6f0 0x7f69d0153430 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 -- 172.21.15.31:0/3208296912 >> 172.21.15.31:0/3208296912 conn(0x7f69d0089cb0 msgr2=0x7f69d00b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 -- 172.21.15.31:0/3208296912 shutdown_connections 2024-08-17T02:25:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.466+0000 7f69d626c700 1 -- 172.21.15.31:0/3208296912 wait complete. 2024-08-17T02:25:23.470 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-08-17T02:25:23.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.590+0000 7fc06f59e700 1 Processor -- start 2024-08-17T02:25:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.590+0000 7fc06f59e700 1 -- start start 2024-08-17T02:25:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.590+0000 7fc06f59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0700acb80 0x7fc070140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.590+0000 7fc06f59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0700ab690 con 0x7fc070140780 2024-08-17T02:25:23.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.590+0000 7fc06f59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0700caa00 con 0x7fc0700b16f0 2024-08-17T02:25:23.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.590+0000 7fc06f59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0700cace0 con 0x7fc0700acb80 2024-08-17T02:25:23.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.590+0000 7fc06ed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0700acb80 0x7fc070140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.590+0000 7fc06e59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc070140780 0x7fc0700b0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52664/0 (socket says 172.21.15.31:52664) 2024-08-17T02:25:23.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.590+0000 7fc06e59c700 1 -- 172.21.15.31:0/1769304978 learned_addr learned my addr 172.21.15.31:0/1769304978 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:23.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570074496 0 0) 0x7fc0700caa00 con 0x7fc0700b16f0 2024-08-17T02:25:23.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc05c003570 con 0x7fc0700b16f0 2024-08-17T02:25:23.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924718694 0 0) 0x7fc0700ab690 con 0x7fc070140780 2024-08-17T02:25:23.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0700caa00 con 0x7fc070140780 2024-08-17T02:25:23.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 681668876 0 0) 0x7fc0700caa00 con 0x7fc070140780 2024-08-17T02:25:23.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 >> v2:172.21.15.31:3300/0 conn(0x7fc0700acb80 msgr2=0x7fc070140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:23.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 --2- 172.21.15.31:0/1769304978 >> v2:172.21.15.31:3300/0 conn(0x7fc0700acb80 0x7fc070140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 >> v1:172.21.15.92:6789/0 conn(0x7fc0700b16f0 legacy=0x7fc0700c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700cafc0 con 0x7fc070140780 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7fc060001470 con 0x7fc070140780 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 >> v1:172.21.15.31:6789/0 conn(0x7fc070140780 legacy=0x7fc0700b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc05c004c50 0x7fc05c005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc05c0037b0 0x7fc05c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c004160 0x7fc05c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700cace0 con 0x7fc05c004c50 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c00c0b0 con 0x7fc05c004160 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c00c270 con 0x7fc05c0037b0 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06e59c700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc05c004c50 0x7fc05c005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06dd9b700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc05c0037b0 0x7fc05c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06ed9d700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c004160 0x7fc05c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06e59c700 1 -- 172.21.15.31:0/1769304978 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc05c0037b0 msgr2=0x7fc05c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:23.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06e59c700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc05c0037b0 0x7fc05c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06e59c700 1 -- 172.21.15.31:0/1769304978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c004160 msgr2=0x7fc05c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06e59c700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c004160 0x7fc05c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06e59c700 1 -- 172.21.15.31:0/1769304978 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700caa00 con 0x7fc05c004c50 2024-08-17T02:25:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06ed9d700 1 -- 172.21.15.31:0/1769304978 reap_dead start 2024-08-17T02:25:23.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06e59c700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc05c004c50 0x7fc05c005040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c2d0 tx=0x7fc0700ab820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95fce12bc2867e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06000cb60 con 0x7fc05c004c50 2024-08-17T02:25:23.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06000cce0 con 0x7fc05c004c50 2024-08-17T02:25:23.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06d59a700 1 -- 172.21.15.31:0/1769304978 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060005b70 con 0x7fc05c004c50 2024-08-17T02:25:23.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06f59e700 1 -- 172.21.15.31:0/1769304978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc05c004c50 msgr2=0x7fc05c005040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06f59e700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc05c004c50 0x7fc05c005040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c2d0 tx=0x7fc0700ab820 comp rx=0 tx=0).stop 2024-08-17T02:25:23.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06f59e700 1 -- 172.21.15.31:0/1769304978 shutdown_connections 2024-08-17T02:25:23.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06f59e700 1 --2- 172.21.15.31:0/1769304978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc05c004c50 0x7fc05c005040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06f59e700 1 -- 172.21.15.31:0/1769304978 >> 172.21.15.31:0/1769304978 conn(0x7fc070067400 msgr2=0x7fc070067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06f59e700 1 -- 172.21.15.31:0/1769304978 shutdown_connections 2024-08-17T02:25:23.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.594+0000 7fc06f59e700 1 -- 172.21.15.31:0/1769304978 wait complete. 2024-08-17T02:25:23.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.598+0000 7fc06f59e700 1 Processor -- start 2024-08-17T02:25:23.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.598+0000 7fc06f59e700 1 -- start start 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.598+0000 7fc06f59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c004c50 0x7fc070153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.598+0000 7fc06f59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc070158550 0x7fc07013ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.598+0000 7fc06f59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc07013f340 0x7fc070165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.598+0000 7fc06f59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc070166590 con 0x7fc070158550 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.598+0000 7fc06f59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07013f7b0 con 0x7fc05c004c50 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.598+0000 7fc06f59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc070153bd0 con 0x7fc07013f340 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.598+0000 7fc06dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc070158550 0x7fc07013ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06dd9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc070158550 0x7fc07013ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36872/0 (socket says 172.21.15.31:36872) 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06dd9b700 1 -- 172.21.15.31:0/1446821849 learned_addr learned my addr 172.21.15.31:0/1446821849 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06e59c700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c004c50 0x7fc070153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06ed9d700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc07013f340 0x7fc070165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06dd9b700 1 -- 172.21.15.31:0/1446821849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc07013f340 msgr2=0x7fc070165560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06dd9b700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc07013f340 0x7fc070165560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06dd9b700 1 -- 172.21.15.31:0/1446821849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c004c50 msgr2=0x7fc070153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06dd9b700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c004c50 0x7fc070153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06dd9b700 1 -- 172.21.15.31:0/1446821849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0701662b0 con 0x7fc070158550 2024-08-17T02:25:23.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06dd9b700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc070158550 0x7fc07013ee00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc05800ec10 tx=0x7fc0580017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc0667fc700 1 -- 172.21.15.31:0/1446821849 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05800c8b0 con 0x7fc070158550 2024-08-17T02:25:23.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc0667fc700 1 -- 172.21.15.31:0/1446821849 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05800ca30 con 0x7fc070158550 2024-08-17T02:25:23.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06f59e700 1 -- 172.21.15.31:0/1446821849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc070157a70 con 0x7fc070158550 2024-08-17T02:25:23.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc0667fc700 1 -- 172.21.15.31:0/1446821849 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05800cdf0 con 0x7fc070158550 2024-08-17T02:25:23.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.602+0000 7fc06f59e700 1 -- 172.21.15.31:0/1446821849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc070158030 con 0x7fc070158550 2024-08-17T02:25:23.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.606+0000 7fc06f59e700 1 -- 172.21.15.31:0/1446821849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0701578d0 con 0x7fc070158550 2024-08-17T02:25:23.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.606+0000 7fc0667fc700 1 -- 172.21.15.31:0/1446821849 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc058014690 con 0x7fc070158550 2024-08-17T02:25:23.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.606+0000 7fc0667fc700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc050060860 0x7fc050062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.606+0000 7fc0667fc700 1 -- 172.21.15.31:0/1446821849 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc05807d150 con 0x7fc070158550 2024-08-17T02:25:23.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.606+0000 7fc06e59c700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc050060860 0x7fc050062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.606+0000 7fc06e59c700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc050060860 0x7fc050062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc060015040 tx=0x7fc060012000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.614+0000 7fc0667fc700 1 -- 172.21.15.31:0/1446821849 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc0701578d0 con 0x7fc070158550 2024-08-17T02:25:23.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 -- 172.21.15.31:0/1446821849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0701578d0 con 0x7fc070158550 2024-08-17T02:25:23.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc0667fc700 1 -- 172.21.15.31:0/1446821849 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fc0701578d0 con 0x7fc070158550 2024-08-17T02:25:23.787 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:23.787 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:23.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 -- 172.21.15.31:0/1446821849 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc050060860 msgr2=0x7fc050062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc050060860 0x7fc050062d10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc060015040 tx=0x7fc060012000 comp rx=0 tx=0).stop 2024-08-17T02:25:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 -- 172.21.15.31:0/1446821849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc070158550 msgr2=0x7fc07013ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc070158550 0x7fc07013ee00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc05800ec10 tx=0x7fc0580017f0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 -- 172.21.15.31:0/1446821849 shutdown_connections 2024-08-17T02:25:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc050060860 0x7fc050062d10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc07013f340 0x7fc070165560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc070158550 0x7fc07013ee00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 --2- 172.21.15.31:0/1446821849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc05c004c50 0x7fc070153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 -- 172.21.15.31:0/1446821849 >> 172.21.15.31:0/1446821849 conn(0x7fc070067400 msgr2=0x7fc070155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 -- 172.21.15.31:0/1446821849 shutdown_connections 2024-08-17T02:25:23.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.786+0000 7fc06f59e700 1 -- 172.21.15.31:0/1446821849 wait complete. 2024-08-17T02:25:23.802 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:25:23.802 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:23.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.910+0000 7f75a5a36700 1 Processor -- start 2024-08-17T02:25:23.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.910+0000 7f75a5a36700 1 -- start start 2024-08-17T02:25:23.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75a0155fe0 0x7f75a0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f75a0069690 0x7f75a00af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a00cbb30 con 0x7f75a01563b0 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a015ad30 con 0x7f75a0069690 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a015a490 con 0x7f75a0155fe0 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5235700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f75a0069690 0x7f75a00af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5235700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f75a0069690 0x7f75a00af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36882/0 (socket says 172.21.15.31:36882) 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5235700 1 -- 172.21.15.31:0/746826967 learned_addr learned my addr 172.21.15.31:0/746826967 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a4a34700 1 --2- 172.21.15.31:0/746826967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75a0155fe0 0x7f75a0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5235700 1 -- 172.21.15.31:0/746826967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75a0155fe0 msgr2=0x7f75a0159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5235700 1 --2- 172.21.15.31:0/746826967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75a0155fe0 0x7f75a0159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5235700 1 -- 172.21.15.31:0/746826967 >> v1:172.21.15.92:6789/0 conn(0x7f75a01563b0 legacy=0x7f75a0068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5235700 1 -- 172.21.15.31:0/746826967 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a015a770 con 0x7f75a0069690 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5235700 1 --2- 172.21.15.31:0/746826967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 0x7f75a00af320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7598009f20 tx=0x7f7598009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb50e72a8be7819 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f759f7fe700 1 -- 172.21.15.31:0/746826967 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800e070 con 0x7f75a0069690 2024-08-17T02:25:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f759f7fe700 1 -- 172.21.15.31:0/746826967 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759800ba80 con 0x7f75a0069690 2024-08-17T02:25:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 -- 172.21.15.31:0/746826967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 msgr2=0x7f75a00af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 --2- 172.21.15.31:0/746826967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 0x7f75a00af320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7598009f20 tx=0x7f7598009840 comp rx=0 tx=0).stop 2024-08-17T02:25:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 -- 172.21.15.31:0/746826967 shutdown_connections 2024-08-17T02:25:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 --2- 172.21.15.31:0/746826967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 0x7f75a00af320 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 --2- 172.21.15.31:0/746826967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75a0155fe0 0x7f75a0159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 -- 172.21.15.31:0/746826967 >> 172.21.15.31:0/746826967 conn(0x7f75a0067400 msgr2=0x7f75a0067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 -- 172.21.15.31:0/746826967 shutdown_connections 2024-08-17T02:25:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.914+0000 7f75a5a36700 1 -- 172.21.15.31:0/746826967 wait complete. 2024-08-17T02:25:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.918+0000 7f75a5a36700 1 Processor -- start 2024-08-17T02:25:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.918+0000 7f75a5a36700 1 -- start start 2024-08-17T02:25:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.918+0000 7f75a5a36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 0x7f75a016a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.918+0000 7f75a5a36700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75a0155fe0 0x7f75a00abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.918+0000 7f75a5a36700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75a01563b0 0x7f75a01671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.918+0000 7f75a5a36700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a014a6b0 con 0x7f75a0069690 2024-08-17T02:25:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a5a36700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a016b020 con 0x7f75a01563b0 2024-08-17T02:25:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a5a36700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a016b300 con 0x7f75a0155fe0 2024-08-17T02:25:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a4a34700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 0x7f75a016a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a4a34700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 0x7f75a016a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36894/0 (socket says 172.21.15.31:36894) 2024-08-17T02:25:23.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a4a34700 1 -- 172.21.15.31:0/1101151891 learned_addr learned my addr 172.21.15.31:0/1101151891 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f759ffff700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75a0155fe0 0x7f75a00abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a5235700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75a01563b0 0x7f75a01671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a4a34700 1 -- 172.21.15.31:0/1101151891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75a0155fe0 msgr2=0x7f75a00abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a4a34700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75a0155fe0 0x7f75a00abb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a4a34700 1 -- 172.21.15.31:0/1101151891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75a01563b0 msgr2=0x7f75a01671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a4a34700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75a01563b0 0x7f75a01671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a4a34700 1 -- 172.21.15.31:0/1101151891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7598009ae0 con 0x7f75a0069690 2024-08-17T02:25:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a4a34700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 0x7f75a016a7d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f759400d890 tx=0x7f7594008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f759cff9700 1 -- 172.21.15.31:0/1101151891 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75940125f0 con 0x7f75a0069690 2024-08-17T02:25:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f759cff9700 1 -- 172.21.15.31:0/1101151891 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7594012750 con 0x7f75a0069690 2024-08-17T02:25:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a5a36700 1 -- 172.21.15.31:0/1101151891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a016b5e0 con 0x7f75a0069690 2024-08-17T02:25:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f759cff9700 1 -- 172.21.15.31:0/1101151891 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594012af0 con 0x7f75a0069690 2024-08-17T02:25:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a5a36700 1 -- 172.21.15.31:0/1101151891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a016ad10 con 0x7f75a0069690 2024-08-17T02:25:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f75a5a36700 1 -- 172.21.15.31:0/1101151891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a00712b0 con 0x7f75a0069690 2024-08-17T02:25:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.922+0000 7f759cff9700 1 -- 172.21.15.31:0/1101151891 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f759401e460 con 0x7f75a0069690 2024-08-17T02:25:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.926+0000 7f759cff9700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f758c060860 0x7f758c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.926+0000 7f759cff9700 1 -- 172.21.15.31:0/1101151891 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f759407d130 con 0x7f75a0069690 2024-08-17T02:25:23.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.926+0000 7f759ffff700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f758c060860 0x7f758c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.926+0000 7f759ffff700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f758c060860 0x7f758c062d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f75a0150240 tx=0x7f7590007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:23.934+0000 7f759cff9700 1 -- 172.21.15.31:0/1101151891 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f759404d580 con 0x7f75a0069690 2024-08-17T02:25:24.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 -- 172.21.15.31:0/1101151891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75a0068d60 con 0x7f75a0069690 2024-08-17T02:25:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f759cff9700 1 -- 172.21.15.31:0/1101151891 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f7594050ba0 con 0x7f75a0069690 2024-08-17T02:25:24.135 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:24.136 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2641277078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2641277078},{"type":"v1","addr":"172.21.15.92:6835","nonce":2641277078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2478493982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2478493982},{"type":"v1","addr":"172.21.15.92:6833","nonce":2478493982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/3915393252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3915393252},{"type":"v1","addr":"172.21.15.31:6836","nonce":3915393252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:46.040941+0000","modified":"2024-08-17T02:24:48.689838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6837/2360104768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":2360104768},{"type":"v1","addr":"172.21.15.31:6837","nonce":2360104768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 -- 172.21.15.31:0/1101151891 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f758c060860 msgr2=0x7f758c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f758c060860 0x7f758c062d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f75a0150240 tx=0x7f7590007ec0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 -- 172.21.15.31:0/1101151891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 msgr2=0x7f75a016a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 0x7f75a016a7d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f759400d890 tx=0x7f7594008040 comp rx=0 tx=0).stop 2024-08-17T02:25:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 -- 172.21.15.31:0/1101151891 shutdown_connections 2024-08-17T02:25:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f758c060860 0x7f758c062d10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75a01563b0 0x7f75a01671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75a0155fe0 0x7f75a00abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 --2- 172.21.15.31:0/1101151891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f75a0069690 0x7f75a016a7d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 -- 172.21.15.31:0/1101151891 >> 172.21.15.31:0/1101151891 conn(0x7f75a0067400 msgr2=0x7f75a0152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 -- 172.21.15.31:0/1101151891 shutdown_connections 2024-08-17T02:25:24.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.134+0000 7f75a5a36700 1 -- 172.21.15.31:0/1101151891 wait complete. 2024-08-17T02:25:24.139 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-08-17T02:25:24.150 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:24.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 Processor -- start 2024-08-17T02:25:24.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 -- start start 2024-08-17T02:25:24.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f86e4156370 0x7f86e4156740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86e40b0830 0x7f86e40acc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40b1e20 con 0x7f86e40b0c80 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e4156c80 con 0x7f86e40b0830 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e414cbf0 con 0x7f86e4156370 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e1d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86e40b0830 0x7f86e40acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e1d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86e40b0830 0x7f86e40acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36908/0 (socket says 172.21.15.31:36908) 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e1d9b700 1 -- 172.21.15.31:0/2168362419 learned_addr learned my addr 172.21.15.31:0/2168362419 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e259c700 1 --2- 172.21.15.31:0/2168362419 >> v2:172.21.15.92:3300/0 conn(0x7f86e4156370 0x7f86e4156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e1d9b700 1 -- 172.21.15.31:0/2168362419 >> v2:172.21.15.92:3300/0 conn(0x7f86e4156370 msgr2=0x7f86e4156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e1d9b700 1 --2- 172.21.15.31:0/2168362419 >> v2:172.21.15.92:3300/0 conn(0x7f86e4156370 0x7f86e4156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e1d9b700 1 -- 172.21.15.31:0/2168362419 >> v1:172.21.15.92:6789/0 conn(0x7f86e40b0c80 legacy=0x7f86e4063060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e1d9b700 1 -- 172.21.15.31:0/2168362419 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40b1210 con 0x7f86e40b0830 2024-08-17T02:25:24.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e1d9b700 1 --2- 172.21.15.31:0/2168362419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0830 0x7f86e40acc90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f86d40099e0 tx=0x7f86d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba4c714cf87d0b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e159a700 1 -- 172.21.15.31:0/2168362419 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d400b7e0 con 0x7f86e40b0830 2024-08-17T02:25:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e159a700 1 -- 172.21.15.31:0/2168362419 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d400b940 con 0x7f86e40b0830 2024-08-17T02:25:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e159a700 1 -- 172.21.15.31:0/2168362419 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d400bce0 con 0x7f86e40b0830 2024-08-17T02:25:24.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 -- 172.21.15.31:0/2168362419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0830 msgr2=0x7f86e40acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 --2- 172.21.15.31:0/2168362419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0830 0x7f86e40acc90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f86d40099e0 tx=0x7f86d4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:24.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 -- 172.21.15.31:0/2168362419 shutdown_connections 2024-08-17T02:25:24.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 --2- 172.21.15.31:0/2168362419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0830 0x7f86e40acc90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 --2- 172.21.15.31:0/2168362419 >> v2:172.21.15.92:3300/0 conn(0x7f86e4156370 0x7f86e4156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 -- 172.21.15.31:0/2168362419 >> 172.21.15.31:0/2168362419 conn(0x7f86e40cc5d0 msgr2=0x7f86e40cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 -- 172.21.15.31:0/2168362419 shutdown_connections 2024-08-17T02:25:24.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.258+0000 7f86e359e700 1 -- 172.21.15.31:0/2168362419 wait complete. 2024-08-17T02:25:24.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e359e700 1 Processor -- start 2024-08-17T02:25:24.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e359e700 1 -- start start 2024-08-17T02:25:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e40b0830 0x7f86e4145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0c80 0x7f86e40ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e359e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4156370 0x7f86e4142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40cb0b0 con 0x7f86e40b0c80 2024-08-17T02:25:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e359e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4143d40 con 0x7f86e4156370 2024-08-17T02:25:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e359e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40caaf0 con 0x7f86e40b0830 2024-08-17T02:25:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e1d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0c80 0x7f86e40ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e1d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0c80 0x7f86e40ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36918/0 (socket says 172.21.15.31:36918) 2024-08-17T02:25:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e1d9b700 1 -- 172.21.15.31:0/2050544920 learned_addr learned my addr 172.21.15.31:0/2050544920 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e259c700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e40b0830 0x7f86e4145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.262+0000 7f86e2d9d700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4156370 0x7f86e4142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86e1d9b700 1 -- 172.21.15.31:0/2050544920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e40b0830 msgr2=0x7f86e4145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86e1d9b700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e40b0830 0x7f86e4145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86e1d9b700 1 -- 172.21.15.31:0/2050544920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4156370 msgr2=0x7f86e4142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86e1d9b700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4156370 0x7f86e4142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86e1d9b700 1 -- 172.21.15.31:0/2050544920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40094f0 con 0x7f86e40b0c80 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86e1d9b700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0c80 0x7f86e40ca0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f86d40030c0 tx=0x7f86d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86d27fc700 1 -- 172.21.15.31:0/2050544920 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4011e40 con 0x7f86e40b0c80 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86d27fc700 1 -- 172.21.15.31:0/2050544920 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d401c460 con 0x7f86e40b0c80 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86e359e700 1 -- 172.21.15.31:0/2050544920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e40cadd0 con 0x7f86e40b0c80 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86d27fc700 1 -- 172.21.15.31:0/2050544920 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d401c820 con 0x7f86e40b0c80 2024-08-17T02:25:24.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86e359e700 1 -- 172.21.15.31:0/2050544920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e41465c0 con 0x7f86e40b0c80 2024-08-17T02:25:24.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86d27fc700 1 -- 172.21.15.31:0/2050544920 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f86d401cb90 con 0x7f86e40b0c80 2024-08-17T02:25:24.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86e359e700 1 -- 172.21.15.31:0/2050544920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e4143830 con 0x7f86e40b0c80 2024-08-17T02:25:24.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86d27fc700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f86c4060860 0x7f86c4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86d27fc700 1 -- 172.21.15.31:0/2050544920 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86d407f050 con 0x7f86e40b0c80 2024-08-17T02:25:24.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.266+0000 7f86e259c700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f86c4060860 0x7f86c4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.270+0000 7f86e259c700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f86c4060860 0x7f86c4062d10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f86d8006fd0 tx=0x7f86d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.274+0000 7f86d27fc700 1 -- 172.21.15.31:0/2050544920 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f86e4143830 con 0x7f86e40b0c80 2024-08-17T02:25:24.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.478+0000 7f86e359e700 1 -- 172.21.15.31:0/2050544920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86e4143830 con 0x7f86e40b0c80 2024-08-17T02:25:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.478+0000 7f86d27fc700 1 -- 172.21.15.31:0/2050544920 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f86e4143830 con 0x7f86e40b0c80 2024-08-17T02:25:24.481 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:24.481 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2641277078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2641277078},{"type":"v1","addr":"172.21.15.92:6835","nonce":2641277078}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2478493982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2478493982},{"type":"v1","addr":"172.21.15.92:6833","nonce":2478493982}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/3915393252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3915393252},{"type":"v1","addr":"172.21.15.31:6836","nonce":3915393252}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:24:46.040941+0000","modified":"2024-08-17T02:24:48.689838+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6837/2360104768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":2360104768},{"type":"v1","addr":"172.21.15.31:6837","nonce":2360104768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 -- 172.21.15.31:0/2050544920 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f86c4060860 msgr2=0x7f86c4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f86c4060860 0x7f86c4062d10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f86d8006fd0 tx=0x7f86d8008040 comp rx=0 tx=0).stop 2024-08-17T02:25:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 -- 172.21.15.31:0/2050544920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0c80 msgr2=0x7f86e40ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0c80 0x7f86e40ca0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f86d40030c0 tx=0x7f86d4016000 comp rx=0 tx=0).stop 2024-08-17T02:25:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 -- 172.21.15.31:0/2050544920 shutdown_connections 2024-08-17T02:25:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f86c4060860 0x7f86c4062d10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e4156370 0x7f86e4142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86e40b0c80 0x7f86e40ca0a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 --2- 172.21.15.31:0/2050544920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e40b0830 0x7f86e4145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 -- 172.21.15.31:0/2050544920 >> 172.21.15.31:0/2050544920 conn(0x7f86e40cc5d0 msgr2=0x7f86e406f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 -- 172.21.15.31:0/2050544920 shutdown_connections 2024-08-17T02:25:24.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.482+0000 7f86e359e700 1 -- 172.21.15.31:0/2050544920 wait complete. 2024-08-17T02:25:24.485 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-08-17T02:25:24.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:24.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.602+0000 7f989b59e700 1 Processor -- start 2024-08-17T02:25:24.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.602+0000 7f989b59e700 1 -- start start 2024-08-17T02:25:24.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.602+0000 7f989b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f989c0b2650 0x7f989c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.602+0000 7f989b59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c067c70 0x7f989c0ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.602+0000 7f989b59e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f989c0cb2e0 0x7f989c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.602+0000 7f989b59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c0cc420 con 0x7f989c0b2650 2024-08-17T02:25:24.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.602+0000 7f989b59e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c0cb810 con 0x7f989c0cb2e0 2024-08-17T02:25:24.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.602+0000 7f989b59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0cbaf0 con 0x7f989c067c70 2024-08-17T02:25:24.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f989c0b2650 0x7f989c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f9899d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c067c70 0x7f989c0ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f9899d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c067c70 0x7f989c0ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:48352/0 (socket says 172.21.15.31:48352) 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989a59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f989c0b2650 0x7f989c0cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36930/0 (socket says 172.21.15.31:36930) 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f9899d9b700 1 -- 172.21.15.31:0/2706641376 learned_addr learned my addr 172.21.15.31:0/2706641376 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989ad9d700 1 --2- 172.21.15.31:0/2706641376 >> v2:172.21.15.92:3300/0 conn(0x7f989c0cb2e0 0x7f989c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989a59c700 1 -- 172.21.15.31:0/2706641376 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c067c70 msgr2=0x7f989c0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989a59c700 1 --2- 172.21.15.31:0/2706641376 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c067c70 0x7f989c0ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989a59c700 1 -- 172.21.15.31:0/2706641376 >> v2:172.21.15.92:3300/0 conn(0x7f989c0cb2e0 msgr2=0x7f989c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989a59c700 1 --2- 172.21.15.31:0/2706641376 >> v2:172.21.15.92:3300/0 conn(0x7f989c0cb2e0 0x7f989c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989a59c700 1 -- 172.21.15.31:0/2706641376 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c0cbdd0 con 0x7f989c0b2650 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989a59c700 1 --2- 172.21.15.31:0/2706641376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 0x7f989c0cada0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f989c0897a0 tx=0x7f98840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8382d1d9f536d1c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989959a700 1 -- 172.21.15.31:0/2706641376 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884011630 con 0x7f989c0b2650 2024-08-17T02:25:24.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989959a700 1 -- 172.21.15.31:0/2706641376 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98840117b0 con 0x7f989c0b2650 2024-08-17T02:25:24.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989959a700 1 -- 172.21.15.31:0/2706641376 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884011b70 con 0x7f989c0b2650 2024-08-17T02:25:24.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989b59e700 1 -- 172.21.15.31:0/2706641376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 msgr2=0x7f989c0cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989b59e700 1 --2- 172.21.15.31:0/2706641376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 0x7f989c0cada0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f989c0897a0 tx=0x7f98840091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989b59e700 1 -- 172.21.15.31:0/2706641376 shutdown_connections 2024-08-17T02:25:24.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989b59e700 1 --2- 172.21.15.31:0/2706641376 >> v2:172.21.15.92:3300/0 conn(0x7f989c0cb2e0 0x7f989c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989b59e700 1 --2- 172.21.15.31:0/2706641376 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c067c70 0x7f989c0ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989b59e700 1 --2- 172.21.15.31:0/2706641376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 0x7f989c0cada0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989b59e700 1 -- 172.21.15.31:0/2706641376 >> 172.21.15.31:0/2706641376 conn(0x7f989c089d50 msgr2=0x7f989c099670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989b59e700 1 -- 172.21.15.31:0/2706641376 shutdown_connections 2024-08-17T02:25:24.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.606+0000 7f989b59e700 1 -- 172.21.15.31:0/2706641376 wait complete. 2024-08-17T02:25:24.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f989b59e700 1 Processor -- start 2024-08-17T02:25:24.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f989b59e700 1 -- start start 2024-08-17T02:25:24.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f989b59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f989c067c70 0x7f989c0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f989b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 0x7f989c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f989b59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c0cb2e0 0x7f989c0c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f989b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c15b0d0 con 0x7f989c0b2650 2024-08-17T02:25:24.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f989b59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c16d2f0 con 0x7f989c067c70 2024-08-17T02:25:24.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f989b59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c16d5d0 con 0x7f989c0cb2e0 2024-08-17T02:25:24.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f9899d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 0x7f989c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f9899d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 0x7f989c150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36940/0 (socket says 172.21.15.31:36940) 2024-08-17T02:25:24.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f9899d9b700 1 -- 172.21.15.31:0/4105181734 learned_addr learned my addr 172.21.15.31:0/4105181734 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:24.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f989a59c700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f989c067c70 0x7f989c0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f989ad9d700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c0cb2e0 0x7f989c0c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f9899d9b700 1 -- 172.21.15.31:0/4105181734 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c0cb2e0 msgr2=0x7f989c0c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f9899d9b700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c0cb2e0 0x7f989c0c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f9899d9b700 1 -- 172.21.15.31:0/4105181734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f989c067c70 msgr2=0x7f989c0c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f9899d9b700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f989c067c70 0x7f989c0c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f9899d9b700 1 -- 172.21.15.31:0/4105181734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9884009420 con 0x7f989c0b2650 2024-08-17T02:25:24.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.610+0000 7f9899d9b700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 0x7f989c150ba0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f988c009df0 tx=0x7f988c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f98927fc700 1 -- 172.21.15.31:0/4105181734 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c00c890 con 0x7f989c0b2650 2024-08-17T02:25:24.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f98927fc700 1 -- 172.21.15.31:0/4105181734 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c00f040 con 0x7f989c0b2650 2024-08-17T02:25:24.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f989b59e700 1 -- 172.21.15.31:0/4105181734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c16d8b0 con 0x7f989c0b2650 2024-08-17T02:25:24.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f98927fc700 1 -- 172.21.15.31:0/4105181734 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c00cc20 con 0x7f989c0b2650 2024-08-17T02:25:24.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f989b59e700 1 -- 172.21.15.31:0/4105181734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c0c73e0 con 0x7f989c0b2650 2024-08-17T02:25:24.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f989b59e700 1 -- 172.21.15.31:0/4105181734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989c15af30 con 0x7f989c0b2650 2024-08-17T02:25:24.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f98927fc700 1 -- 172.21.15.31:0/4105181734 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f988c014650 con 0x7f989c0b2650 2024-08-17T02:25:24.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f98927fc700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f987c060890 0x7f987c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f98927fc700 1 -- 172.21.15.31:0/4105181734 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f988c07d130 con 0x7f989c0b2650 2024-08-17T02:25:24.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f989a59c700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f987c060890 0x7f987c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.614+0000 7f989a59c700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f987c060890 0x7f987c062d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f989c0897a0 tx=0x7f9884017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.622+0000 7f98927fc700 1 -- 172.21.15.31:0/4105181734 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f989c15af30 con 0x7f989c0b2650 2024-08-17T02:25:24.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.790+0000 7f989b59e700 1 -- 172.21.15.31:0/4105181734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f989c0b2a90 con 0x7f989c0b2650 2024-08-17T02:25:24.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f98927fc700 1 -- 172.21.15.31:0/4105181734 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f989c0b2a90 con 0x7f989c0b2650 2024-08-17T02:25:24.794 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:24.795 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:24:47.681221+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:24:43.691230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:24:45.035480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 -- 172.21.15.31:0/4105181734 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f987c060890 msgr2=0x7f987c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f987c060890 0x7f987c062d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f989c0897a0 tx=0x7f9884017000 comp rx=0 tx=0).stop 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 -- 172.21.15.31:0/4105181734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 msgr2=0x7f989c150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 0x7f989c150ba0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f988c009df0 tx=0x7f988c00b040 comp rx=0 tx=0).stop 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 -- 172.21.15.31:0/4105181734 shutdown_connections 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f987c060890 0x7f987c062d40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f989c0cb2e0 0x7f989c0c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f989c0b2650 0x7f989c150ba0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 --2- 172.21.15.31:0/4105181734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f989c067c70 0x7f989c0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 -- 172.21.15.31:0/4105181734 >> 172.21.15.31:0/4105181734 conn(0x7f989c089d50 msgr2=0x7f989c0b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 -- 172.21.15.31:0/4105181734 shutdown_connections 2024-08-17T02:25:24.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.794+0000 7f989b59e700 1 -- 172.21.15.31:0/4105181734 wait complete. 2024-08-17T02:25:24.810 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:25:24.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.922+0000 7f64eb1ff700 1 Processor -- start 2024-08-17T02:25:24.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.922+0000 7f64eb1ff700 1 -- start start 2024-08-17T02:25:24.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.922+0000 7f64eb1ff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64e4157230 0x7f64e40ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.922+0000 7f64eb1ff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64e4157600 0x7f64e40aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.922+0000 7f64eb1ff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e40abe90 con 0x7f64e40aad10 2024-08-17T02:25:24.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.922+0000 7f64eb1ff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e40ab280 con 0x7f64e4157600 2024-08-17T02:25:24.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.922+0000 7f64eb1ff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40ab560 con 0x7f64e4157230 2024-08-17T02:25:24.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.922+0000 7f64e99fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64e4157600 0x7f64e40aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.922+0000 7f64e99fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64e4157600 0x7f64e40aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36954/0 (socket says 172.21.15.31:36954) 2024-08-17T02:25:24.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.922+0000 7f64e99fc700 1 -- 172.21.15.31:0/2042935195 learned_addr learned my addr 172.21.15.31:0/2042935195 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:24.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64ea1fd700 1 --2- 172.21.15.31:0/2042935195 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64e4157230 0x7f64e40ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64e99fc700 1 -- 172.21.15.31:0/2042935195 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64e4157230 msgr2=0x7f64e40ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64e99fc700 1 --2- 172.21.15.31:0/2042935195 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64e4157230 0x7f64e40ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64e99fc700 1 -- 172.21.15.31:0/2042935195 >> v1:172.21.15.31:6789/0 conn(0x7f64e40aad10 legacy=0x7f64e40b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64e99fc700 1 -- 172.21.15.31:0/2042935195 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e40ab840 con 0x7f64e4157600 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64e91fb700 1 -- 172.21.15.31:0/2042935195 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113703439 0 0) 0x7f64e40abe90 con 0x7f64e40aad10 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64e99fc700 1 --2- 172.21.15.31:0/2042935195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157600 0x7f64e40aeba0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f64e00099b0 tx=0x7f64e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad06c3e0fa3380b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64e91fb700 1 -- 172.21.15.31:0/2042935195 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000b8f0 con 0x7f64e4157600 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64e91fb700 1 -- 172.21.15.31:0/2042935195 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e000ba50 con 0x7f64e4157600 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64e91fb700 1 -- 172.21.15.31:0/2042935195 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000bdf0 con 0x7f64e4157600 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64eb1ff700 1 -- 172.21.15.31:0/2042935195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157600 msgr2=0x7f64e40aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64eb1ff700 1 --2- 172.21.15.31:0/2042935195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157600 0x7f64e40aeba0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f64e00099b0 tx=0x7f64e0009250 comp rx=0 tx=0).stop 2024-08-17T02:25:24.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64eb1ff700 1 -- 172.21.15.31:0/2042935195 shutdown_connections 2024-08-17T02:25:24.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64eb1ff700 1 --2- 172.21.15.31:0/2042935195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157600 0x7f64e40aeba0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64eb1ff700 1 --2- 172.21.15.31:0/2042935195 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64e4157230 0x7f64e40ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64eb1ff700 1 -- 172.21.15.31:0/2042935195 >> 172.21.15.31:0/2042935195 conn(0x7f64e40cdfc0 msgr2=0x7f64e40ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64eb1ff700 1 -- 172.21.15.31:0/2042935195 shutdown_connections 2024-08-17T02:25:24.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.926+0000 7f64eb1ff700 1 -- 172.21.15.31:0/2042935195 wait complete. 2024-08-17T02:25:24.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64eb1ff700 1 Processor -- start 2024-08-17T02:25:24.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64eb1ff700 1 -- start start 2024-08-17T02:25:24.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64eb1ff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64e40aad10 0x7f64e4144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64eb1ff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157230 0x7f64e409a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64eb1ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64e4157600 0x7f64e409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64eb1ff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e409bc80 con 0x7f64e4157230 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64eb1ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e409b070 con 0x7f64e4157600 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64eb1ff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e409b350 con 0x7f64e40aad10 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64e99fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157230 0x7f64e409a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64e99fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157230 0x7f64e409a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36958/0 (socket says 172.21.15.31:36958) 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64e99fc700 1 -- 172.21.15.31:0/899105988 learned_addr learned my addr 172.21.15.31:0/899105988 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64ea1fd700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64e40aad10 0x7f64e4144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64ea9fe700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64e4157600 0x7f64e409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64e99fc700 1 -- 172.21.15.31:0/899105988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64e40aad10 msgr2=0x7f64e4144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64e99fc700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64e40aad10 0x7f64e4144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64e99fc700 1 -- 172.21.15.31:0/899105988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64e4157600 msgr2=0x7f64e409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64e99fc700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64e4157600 0x7f64e409aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.930+0000 7f64e99fc700 1 -- 172.21.15.31:0/899105988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e00094f0 con 0x7f64e4157230 2024-08-17T02:25:24.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64e99fc700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157230 0x7f64e409a520 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f64e406fb80 tx=0x7f64e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64da7fc700 1 -- 172.21.15.31:0/899105988 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0011e00 con 0x7f64e4157230 2024-08-17T02:25:24.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64da7fc700 1 -- 172.21.15.31:0/899105988 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e0024440 con 0x7f64e4157230 2024-08-17T02:25:24.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64da7fc700 1 -- 172.21.15.31:0/899105988 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0024800 con 0x7f64e4157230 2024-08-17T02:25:24.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64eb1ff700 1 -- 172.21.15.31:0/899105988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e409b630 con 0x7f64e4157230 2024-08-17T02:25:24.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64eb1ff700 1 -- 172.21.15.31:0/899105988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e4158600 con 0x7f64e4157230 2024-08-17T02:25:24.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64da7fc700 1 -- 172.21.15.31:0/899105988 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f64e001a420 con 0x7f64e4157230 2024-08-17T02:25:24.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64eb1ff700 1 -- 172.21.15.31:0/899105988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e415a050 con 0x7f64e4157230 2024-08-17T02:25:24.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64da7fc700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f64c8060860 0x7f64c8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64da7fc700 1 -- 172.21.15.31:0/899105988 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f64e007e8a0 con 0x7f64e4157230 2024-08-17T02:25:24.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.934+0000 7f64ea1fd700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f64c8060860 0x7f64c8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.938+0000 7f64ea1fd700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f64c8060860 0x7f64c8062d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f64d4006fd0 tx=0x7f64d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:24.942+0000 7f64da7fc700 1 -- 172.21.15.31:0/899105988 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f64e004ec50 con 0x7f64e4157230 2024-08-17T02:25:25.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.146+0000 7f64eb1ff700 1 -- 172.21.15.31:0/899105988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f64e40712b0 con 0x7f64e4157230 2024-08-17T02:25:25.148 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-08-17T02:25:25.146+0000 7fb5491b8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:25:25.154 INFO:tasks.ceph.mds.c.smithi031.stderr: -2323> 2024-08-17T02:24:50.190+0000 7f8467524700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:25:25.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.154+0000 7f64da7fc700 1 -- 172.21.15.31:0/899105988 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f64e002a090 con 0x7f64e4157230 2024-08-17T02:25:25.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 -- 172.21.15.31:0/899105988 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f64c8060860 msgr2=0x7f64c8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f64c8060860 0x7f64c8062d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f64d4006fd0 tx=0x7f64d4008040 comp rx=0 tx=0).stop 2024-08-17T02:25:25.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 -- 172.21.15.31:0/899105988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157230 msgr2=0x7f64e409a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157230 0x7f64e409a520 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f64e406fb80 tx=0x7f64e0017000 comp rx=0 tx=0).stop 2024-08-17T02:25:25.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 -- 172.21.15.31:0/899105988 shutdown_connections 2024-08-17T02:25:25.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f64c8060860 0x7f64c8062d10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64e4157600 0x7f64e409aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64e4157230 0x7f64e409a520 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 --2- 172.21.15.31:0/899105988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f64e40aad10 0x7f64e4144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 -- 172.21.15.31:0/899105988 >> 172.21.15.31:0/899105988 conn(0x7f64e40cdfc0 msgr2=0x7f64e40ac220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 -- 172.21.15.31:0/899105988 shutdown_connections 2024-08-17T02:25:25.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.158+0000 7f64eb1ff700 1 -- 172.21.15.31:0/899105988 wait complete. 2024-08-17T02:25:25.161 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:25:25.176 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:25:25.184 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-08-17T02:25:25.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905d49d700 1 Processor -- start 2024-08-17T02:25:25.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905d49d700 1 -- start start 2024-08-17T02:25:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905d49d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9058159cb0 0x7f90581604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905d49d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9058155e90 con 0x7f9058159130 2024-08-17T02:25:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905d49d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9058156150 con 0x7f90581553b0 2024-08-17T02:25:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905d49d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9058156430 con 0x7f9058159cb0 2024-08-17T02:25:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f90577fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9058159130 0x7f90581595a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52698/0 (socket says 172.21.15.31:52698) 2024-08-17T02:25:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f90577fe700 1 -- 172.21.15.31:0/2581408887 learned_addr learned my addr 172.21.15.31:0/2581408887 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:25.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905cc9c700 1 --2- 172.21.15.31:0/2581408887 >> v2:172.21.15.92:3300/0 conn(0x7f9058159cb0 0x7f90581604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f9056ffd700 1 -- 172.21.15.31:0/2581408887 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325457018 0 0) 0x7f9058155e90 con 0x7f9058159130 2024-08-17T02:25:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f9056ffd700 1 -- 172.21.15.31:0/2581408887 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9040003570 con 0x7f9058159130 2024-08-17T02:25:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905cc9c700 1 -- 172.21.15.31:0/2581408887 >> v1:172.21.15.92:6789/0 conn(0x7f90581553b0 legacy=0x7f9058155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905cc9c700 1 -- 172.21.15.31:0/2581408887 >> v1:172.21.15.31:6789/0 conn(0x7f9058159130 legacy=0x7f90581595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905cc9c700 1 -- 172.21.15.31:0/2581408887 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9058156710 con 0x7f9058159cb0 2024-08-17T02:25:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f905cc9c700 1 --2- 172.21.15.31:0/2581408887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9058159cb0 0x7f90581604b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f905000aa90 tx=0x7f905000a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c04c5edaaaa6f9a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f9056ffd700 1 -- 172.21.15.31:0/2581408887 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905000c970 con 0x7f9058159cb0 2024-08-17T02:25:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f9056ffd700 1 -- 172.21.15.31:0/2581408887 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905000cad0 con 0x7f9058159cb0 2024-08-17T02:25:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.282+0000 7f9056ffd700 1 -- 172.21.15.31:0/2581408887 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905000ce70 con 0x7f9058159cb0 2024-08-17T02:25:25.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 -- 172.21.15.31:0/2581408887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9058159cb0 msgr2=0x7f90581604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 --2- 172.21.15.31:0/2581408887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9058159cb0 0x7f90581604b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f905000aa90 tx=0x7f905000a330 comp rx=0 tx=0).stop 2024-08-17T02:25:25.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 -- 172.21.15.31:0/2581408887 shutdown_connections 2024-08-17T02:25:25.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 --2- 172.21.15.31:0/2581408887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9058159cb0 0x7f90581604b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 -- 172.21.15.31:0/2581408887 >> 172.21.15.31:0/2581408887 conn(0x7f905806bbb0 msgr2=0x7f90580b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 -- 172.21.15.31:0/2581408887 shutdown_connections 2024-08-17T02:25:25.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 -- 172.21.15.31:0/2581408887 wait complete. 2024-08-17T02:25:25.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 Processor -- start 2024-08-17T02:25:25.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 -- start start 2024-08-17T02:25:25.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90581553b0 0x7f9058141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9058159130 0x7f90580c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9058159cb0 0x7f90580c2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905816a390 con 0x7f9058159130 2024-08-17T02:25:25.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90580b06c0 con 0x7f9058159cb0 2024-08-17T02:25:25.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905d49d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90580b09a0 con 0x7f90581553b0 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f90577fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9058159130 0x7f90580c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f90577fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9058159130 0x7f90580c1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36974/0 (socket says 172.21.15.31:36974) 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f90577fe700 1 -- 172.21.15.31:0/3102420852 learned_addr learned my addr 172.21.15.31:0/3102420852 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f9057fff700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90581553b0 0x7f9058141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.286+0000 7f905cc9c700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9058159cb0 0x7f90580c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f90577fe700 1 -- 172.21.15.31:0/3102420852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90581553b0 msgr2=0x7f9058141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f90577fe700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90581553b0 0x7f9058141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f90577fe700 1 -- 172.21.15.31:0/3102420852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9058159cb0 msgr2=0x7f90580c2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f90577fe700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9058159cb0 0x7f90580c2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f90577fe700 1 -- 172.21.15.31:0/3102420852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905000a5d0 con 0x7f9058159130 2024-08-17T02:25:25.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f90577fe700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9058159130 0x7f90580c1b20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f904800cd30 tx=0x7f9048001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f903ffff700 1 -- 172.21.15.31:0/3102420852 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904800ce90 con 0x7f9058159130 2024-08-17T02:25:25.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f903ffff700 1 -- 172.21.15.31:0/3102420852 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904800aac0 con 0x7f9058159130 2024-08-17T02:25:25.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f905d49d700 1 -- 172.21.15.31:0/3102420852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90580b0c80 con 0x7f9058159130 2024-08-17T02:25:25.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f903ffff700 1 -- 172.21.15.31:0/3102420852 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904800aea0 con 0x7f9058159130 2024-08-17T02:25:25.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f905d49d700 1 -- 172.21.15.31:0/3102420852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90580af950 con 0x7f9058159130 2024-08-17T02:25:25.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f905d49d700 1 -- 172.21.15.31:0/3102420852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905816a540 con 0x7f9058159130 2024-08-17T02:25:25.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f903ffff700 1 -- 172.21.15.31:0/3102420852 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9048007300 con 0x7f9058159130 2024-08-17T02:25:25.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.290+0000 7f903ffff700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9044060860 0x7f9044062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.294+0000 7f903ffff700 1 -- 172.21.15.31:0/3102420852 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f904807cf90 con 0x7f9058159130 2024-08-17T02:25:25.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.294+0000 7f9057fff700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9044060860 0x7f9044062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.294+0000 7f9057fff700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9044060860 0x7f9044062d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f905816c690 tx=0x7f904c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.298+0000 7f903ffff700 1 -- 172.21.15.31:0/3102420852 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f905816a540 con 0x7f9058159130 2024-08-17T02:25:25.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:25.502+0000 7f905d49d700 1 -- 172.21.15.31:0/3102420852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f90580712b0 con 0x7f9058159130 2024-08-17T02:25:26.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.170+0000 7f903ffff700 1 -- 172.21.15.31:0/3102420852 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f904804d410 con 0x7f9058159130 2024-08-17T02:25:26.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.174+0000 7f905d49d700 1 -- 172.21.15.31:0/3102420852 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9044060860 msgr2=0x7f9044062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.174+0000 7f905d49d700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9044060860 0x7f9044062d10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f905816c690 tx=0x7f904c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:26.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.174+0000 7f905d49d700 1 -- 172.21.15.31:0/3102420852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9058159130 msgr2=0x7f90580c1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.174+0000 7f905d49d700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9058159130 0x7f90580c1b20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f904800cd30 tx=0x7f9048001b10 comp rx=0 tx=0).stop 2024-08-17T02:25:26.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.174+0000 7f905d49d700 1 -- 172.21.15.31:0/3102420852 shutdown_connections 2024-08-17T02:25:26.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.174+0000 7f905d49d700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9044060860 0x7f9044062d10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.174+0000 7f905d49d700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9058159cb0 0x7f90580c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.174+0000 7f905d49d700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9058159130 0x7f90580c1b20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.174+0000 7f905d49d700 1 --2- 172.21.15.31:0/3102420852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90581553b0 0x7f9058141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.174+0000 7f905d49d700 1 -- 172.21.15.31:0/3102420852 >> 172.21.15.31:0/3102420852 conn(0x7f905806bbb0 msgr2=0x7f90581595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.178+0000 7f905d49d700 1 -- 172.21.15.31:0/3102420852 shutdown_connections 2024-08-17T02:25:26.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.178+0000 7f905d49d700 1 -- 172.21.15.31:0/3102420852 wait complete. 2024-08-17T02:25:26.190 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:25:26.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a6337700 1 Processor -- start 2024-08-17T02:25:26.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a6337700 1 -- start start 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a6337700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 0x7f17a0068e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a6337700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17a00cb010 0x7f17a0159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a6337700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a015a510 con 0x7f17a00aeb80 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a6337700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a0150510 con 0x7f17a00cb010 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a6337700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a015cc00 con 0x7f17a0068aa0 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a4b34700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17a00cb010 0x7f17a0159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a4b34700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17a00cb010 0x7f17a0159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36986/0 (socket says 172.21.15.31:36986) 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a4b34700 1 -- 172.21.15.31:0/3356346171 learned_addr learned my addr 172.21.15.31:0/3356346171 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a5335700 1 --2- 172.21.15.31:0/3356346171 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 0x7f17a0068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a4b34700 1 -- 172.21.15.31:0/3356346171 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 msgr2=0x7f17a0068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a4b34700 1 --2- 172.21.15.31:0/3356346171 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 0x7f17a0068e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a4b34700 1 -- 172.21.15.31:0/3356346171 >> v1:172.21.15.92:6789/0 conn(0x7f17a00aeb80 legacy=0x7f17a00aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a4b34700 1 -- 172.21.15.31:0/3356346171 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a00cb400 con 0x7f17a00cb010 2024-08-17T02:25:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a5335700 1 --2- 172.21.15.31:0/3356346171 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 0x7f17a0068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f17a4b34700 1 --2- 172.21.15.31:0/3356346171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 0x7f17a0159fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f17940099b0 tx=0x7f1794009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a7d0ecb06dc9c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f1793fff700 1 -- 172.21.15.31:0/3356346171 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179400b860 con 0x7f17a00cb010 2024-08-17T02:25:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f1793fff700 1 -- 172.21.15.31:0/3356346171 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179400b9c0 con 0x7f17a00cb010 2024-08-17T02:25:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.310+0000 7f1793fff700 1 -- 172.21.15.31:0/3356346171 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179400bd60 con 0x7f17a00cb010 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.314+0000 7f17a6337700 1 -- 172.21.15.31:0/3356346171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 msgr2=0x7f17a0159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.314+0000 7f17a6337700 1 --2- 172.21.15.31:0/3356346171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 0x7f17a0159fd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f17940099b0 tx=0x7f1794009250 comp rx=0 tx=0).stop 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.314+0000 7f17a6337700 1 -- 172.21.15.31:0/3356346171 shutdown_connections 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.314+0000 7f17a6337700 1 --2- 172.21.15.31:0/3356346171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 0x7f17a0159fd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.314+0000 7f17a6337700 1 --2- 172.21.15.31:0/3356346171 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 0x7f17a0068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.314+0000 7f17a6337700 1 -- 172.21.15.31:0/3356346171 >> 172.21.15.31:0/3356346171 conn(0x7f17a00d0090 msgr2=0x7f17a00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.314+0000 7f17a6337700 1 -- 172.21.15.31:0/3356346171 shutdown_connections 2024-08-17T02:25:26.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.314+0000 7f17a6337700 1 -- 172.21.15.31:0/3356346171 wait complete. 2024-08-17T02:25:26.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.314+0000 7f17a6337700 1 Processor -- start 2024-08-17T02:25:26.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.314+0000 7f17a6337700 1 -- start start 2024-08-17T02:25:26.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a6337700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 0x7f17a0169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a6337700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17a00aeb80 0x7f17a016a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a6337700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 0x7f17a00aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a6337700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00b12b0 con 0x7f17a00cb010 2024-08-17T02:25:26.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a6337700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00b0980 con 0x7f17a00aeb80 2024-08-17T02:25:26.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a6337700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00b0c60 con 0x7f17a0068aa0 2024-08-17T02:25:26.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a5b36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 0x7f17a00aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a5335700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 0x7f17a0169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a5b36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 0x7f17a00aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36988/0 (socket says 172.21.15.31:36988) 2024-08-17T02:25:26.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a4b34700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17a00aeb80 0x7f17a016a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a5b36700 1 -- 172.21.15.31:0/1914865021 learned_addr learned my addr 172.21.15.31:0/1914865021 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:26.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a5b36700 1 -- 172.21.15.31:0/1914865021 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 msgr2=0x7f17a0169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a5b36700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 0x7f17a0169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a5b36700 1 -- 172.21.15.31:0/1914865021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17a00aeb80 msgr2=0x7f17a016a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a5b36700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17a00aeb80 0x7f17a016a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a5b36700 1 -- 172.21.15.31:0/1914865021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940094f0 con 0x7f17a00cb010 2024-08-17T02:25:26.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a5b36700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 0x7f17a00aef50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f179800c8e0 tx=0x7f1798001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17917fa700 1 -- 172.21.15.31:0/1914865021 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798012630 con 0x7f17a00cb010 2024-08-17T02:25:26.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17917fa700 1 -- 172.21.15.31:0/1914865021 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798012790 con 0x7f17a00cb010 2024-08-17T02:25:26.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a6337700 1 -- 172.21.15.31:0/1914865021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a00b0f40 con 0x7f17a00cb010 2024-08-17T02:25:26.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17917fa700 1 -- 172.21.15.31:0/1914865021 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798012b50 con 0x7f17a00cb010 2024-08-17T02:25:26.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.318+0000 7f17a6337700 1 -- 172.21.15.31:0/1914865021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a00ca350 con 0x7f17a00cb010 2024-08-17T02:25:26.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.322+0000 7f17a6337700 1 -- 172.21.15.31:0/1914865021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a00b1420 con 0x7f17a00cb010 2024-08-17T02:25:26.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.322+0000 7f17917fa700 1 -- 172.21.15.31:0/1914865021 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f179801a3a0 con 0x7f17a00cb010 2024-08-17T02:25:26.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.322+0000 7f17917fa700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1784060860 0x7f1784062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.322+0000 7f17917fa700 1 -- 172.21.15.31:0/1914865021 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f179807cce0 con 0x7f17a00cb010 2024-08-17T02:25:26.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.322+0000 7f17a5335700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1784060860 0x7f1784062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.322+0000 7f17a5335700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1784060860 0x7f1784062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17a015b6e0 tx=0x7f179c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.326+0000 7f17917fa700 1 -- 172.21.15.31:0/1914865021 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f179804d080 con 0x7f17a00cb010 2024-08-17T02:25:26.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:26.490+0000 7f17a6337700 1 -- 172.21.15.31:0/1914865021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f17a015a510 con 0x7f17a00cb010 2024-08-17T02:25:27.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.166+0000 7f17917fa700 1 -- 172.21.15.31:0/1914865021 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f17a015a510 con 0x7f17a00cb010 2024-08-17T02:25:27.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.170+0000 7f17a6337700 1 -- 172.21.15.31:0/1914865021 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1784060860 msgr2=0x7f1784062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.170+0000 7f17a6337700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1784060860 0x7f1784062d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17a015b6e0 tx=0x7f179c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:27.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.170+0000 7f17a6337700 1 -- 172.21.15.31:0/1914865021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 msgr2=0x7f17a00aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.170+0000 7f17a6337700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 0x7f17a00aef50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f179800c8e0 tx=0x7f1798001710 comp rx=0 tx=0).stop 2024-08-17T02:25:27.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.170+0000 7f17a6337700 1 -- 172.21.15.31:0/1914865021 shutdown_connections 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.170+0000 7f17a6337700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1784060860 0x7f1784062d10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.170+0000 7f17a6337700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17a00cb010 0x7f17a00aef50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.170+0000 7f17a6337700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17a00aeb80 0x7f17a016a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.170+0000 7f17a6337700 1 --2- 172.21.15.31:0/1914865021 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17a0068aa0 0x7f17a0169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.174+0000 7f17a6337700 1 -- 172.21.15.31:0/1914865021 >> 172.21.15.31:0/1914865021 conn(0x7f17a00d0090 msgr2=0x7f17a014fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.174+0000 7f17a6337700 1 -- 172.21.15.31:0/1914865021 shutdown_connections 2024-08-17T02:25:27.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.174+0000 7f17a6337700 1 -- 172.21.15.31:0/1914865021 wait complete. 2024-08-17T02:25:27.177 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:25:27.191 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:25:27.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11ffff700 1 Processor -- start 2024-08-17T02:25:27.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11ffff700 1 -- start start 2024-08-17T02:25:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb120147010 0x7fb1200ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb12015db40 0x7fb12015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11ffff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1200ade10 con 0x7fb120069ec0 2024-08-17T02:25:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11ffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1200ae7e0 con 0x7fb12015db40 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11ffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1200ad800 con 0x7fb120147010 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb120147010 0x7fb1200ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb12015db40 0x7fb12015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11f7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fb120069ec0 0x7fb12015ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:33712/0 (socket says 172.21.15.31:33712) 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.306+0000 7fb11f7fe700 1 -- 172.21.15.31:0/3346523844 learned_addr learned my addr 172.21.15.31:0/3346523844 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11e7fc700 1 -- 172.21.15.31:0/3346523844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb120147010 msgr2=0x7fb1200ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11dffb700 1 -- 172.21.15.31:0/3346523844 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998540126 0 0) 0x7fb1200ade10 con 0x7fb120069ec0 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11e7fc700 1 --2- 172.21.15.31:0/3346523844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb120147010 0x7fb1200ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11e7fc700 1 -- 172.21.15.31:0/3346523844 >> v1:172.21.15.92:6789/0 conn(0x7fb120069ec0 legacy=0x7fb12015ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11e7fc700 1 -- 172.21.15.31:0/3346523844 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1201473e0 con 0x7fb12015db40 2024-08-17T02:25:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11effd700 1 --2- 172.21.15.31:0/3346523844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb120147010 0x7fb1200ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:27.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11e7fc700 1 --2- 172.21.15.31:0/3346523844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12015db40 0x7fb12015df90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb1100098e0 tx=0x7fb1100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689c5f5d4201db6e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11dffb700 1 -- 172.21.15.31:0/3346523844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb110009e80 con 0x7fb12015db40 2024-08-17T02:25:27.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11dffb700 1 -- 172.21.15.31:0/3346523844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11000b860 con 0x7fb12015db40 2024-08-17T02:25:27.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11dffb700 1 -- 172.21.15.31:0/3346523844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11000bbe0 con 0x7fb12015db40 2024-08-17T02:25:27.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11ffff700 1 -- 172.21.15.31:0/3346523844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12015db40 msgr2=0x7fb12015df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11ffff700 1 --2- 172.21.15.31:0/3346523844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12015db40 0x7fb12015df90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb1100098e0 tx=0x7fb1100091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11ffff700 1 -- 172.21.15.31:0/3346523844 shutdown_connections 2024-08-17T02:25:27.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11ffff700 1 --2- 172.21.15.31:0/3346523844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12015db40 0x7fb12015df90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11ffff700 1 --2- 172.21.15.31:0/3346523844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb120147010 0x7fb1200ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11ffff700 1 -- 172.21.15.31:0/3346523844 >> 172.21.15.31:0/3346523844 conn(0x7fb120067e90 msgr2=0x7fb1200cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11ffff700 1 -- 172.21.15.31:0/3346523844 shutdown_connections 2024-08-17T02:25:27.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11ffff700 1 -- 172.21.15.31:0/3346523844 wait complete. 2024-08-17T02:25:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11ffff700 1 Processor -- start 2024-08-17T02:25:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.310+0000 7fb11ffff700 1 -- start start 2024-08-17T02:25:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb120069ec0 0x7fb1200a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120147010 0x7fb12015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb12015db40 0x7fb1200a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1200a6b00 con 0x7fb120069ec0 2024-08-17T02:25:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11ffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1200a5ef0 con 0x7fb120147010 2024-08-17T02:25:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11ffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1200a61d0 con 0x7fb12015db40 2024-08-17T02:25:27.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb120069ec0 0x7fb1200a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb120069ec0 0x7fb1200a6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37008/0 (socket says 172.21.15.31:37008) 2024-08-17T02:25:27.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11effd700 1 -- 172.21.15.31:0/2243908415 learned_addr learned my addr 172.21.15.31:0/2243908415 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:27.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11f7fe700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb12015db40 0x7fb1200a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11e7fc700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120147010 0x7fb12015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11effd700 1 -- 172.21.15.31:0/2243908415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb12015db40 msgr2=0x7fb1200a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11effd700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb12015db40 0x7fb1200a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11effd700 1 -- 172.21.15.31:0/2243908415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120147010 msgr2=0x7fb12015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11effd700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120147010 0x7fb12015cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11effd700 1 -- 172.21.15.31:0/2243908415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb110009420 con 0x7fb120069ec0 2024-08-17T02:25:27.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11effd700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb120069ec0 0x7fb1200a6f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb11800d1d0 tx=0x7fb118009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb106ffd700 1 -- 172.21.15.31:0/2243908415 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800dd10 con 0x7fb120069ec0 2024-08-17T02:25:27.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb106ffd700 1 -- 172.21.15.31:0/2243908415 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11800f040 con 0x7fb120069ec0 2024-08-17T02:25:27.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb106ffd700 1 -- 172.21.15.31:0/2243908415 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb118015670 con 0x7fb120069ec0 2024-08-17T02:25:27.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11ffff700 1 -- 172.21.15.31:0/2243908415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1200a64b0 con 0x7fb120069ec0 2024-08-17T02:25:27.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11ffff700 1 -- 172.21.15.31:0/2243908415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12015d4c0 con 0x7fb120069ec0 2024-08-17T02:25:27.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb11ffff700 1 -- 172.21.15.31:0/2243908415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1200712b0 con 0x7fb120069ec0 2024-08-17T02:25:27.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb106ffd700 1 -- 172.21.15.31:0/2243908415 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb118015a60 con 0x7fb120069ec0 2024-08-17T02:25:27.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.314+0000 7fb106ffd700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb10c060890 0x7fb10c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.318+0000 7fb106ffd700 1 -- 172.21.15.31:0/2243908415 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5440+0+0 (secure 0 0 0) 0x7fb11807ce00 con 0x7fb120069ec0 2024-08-17T02:25:27.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.318+0000 7fb11e7fc700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb10c060890 0x7fb10c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.318+0000 7fb11e7fc700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb10c060890 0x7fb10c062d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb1100091e0 tx=0x7fb110017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.322+0000 7fb106ffd700 1 -- 172.21.15.31:0/2243908415 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb11804d410 con 0x7fb120069ec0 2024-08-17T02:25:27.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:27.478+0000 7fb11ffff700 1 -- 172.21.15.31:0/2243908415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb12006f3c0 con 0x7fb120069ec0 2024-08-17T02:25:28.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.178+0000 7fb106ffd700 1 -- 172.21.15.31:0/2243908415 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb11801a0d0 con 0x7fb120069ec0 2024-08-17T02:25:28.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 -- 172.21.15.31:0/2243908415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb10c060890 msgr2=0x7fb10c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb10c060890 0x7fb10c062d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb1100091e0 tx=0x7fb110017000 comp rx=0 tx=0).stop 2024-08-17T02:25:28.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 -- 172.21.15.31:0/2243908415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb120069ec0 msgr2=0x7fb1200a6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb120069ec0 0x7fb1200a6f90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb11800d1d0 tx=0x7fb118009a90 comp rx=0 tx=0).stop 2024-08-17T02:25:28.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 -- 172.21.15.31:0/2243908415 shutdown_connections 2024-08-17T02:25:28.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb10c060890 0x7fb10c062d40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb12015db40 0x7fb1200a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb120147010 0x7fb12015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 --2- 172.21.15.31:0/2243908415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb120069ec0 0x7fb1200a6f90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 -- 172.21.15.31:0/2243908415 >> 172.21.15.31:0/2243908415 conn(0x7fb120067e90 msgr2=0x7fb12015fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 -- 172.21.15.31:0/2243908415 shutdown_connections 2024-08-17T02:25:28.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:28.182+0000 7fb11ffff700 1 -- 172.21.15.31:0/2243908415 wait complete. 2024-08-17T02:25:28.184 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-08-17T02:25:28.199 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:25:28.199 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:25:28.200 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:25:28.200 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:28.200 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:25:28.200 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:25:28.200 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:25:28.200 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:28.201 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:25:28.201 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:25:28.201 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:25:28.201 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:28.201 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:25:28.201 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:25:28.201 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:25:28.201 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:28.214 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:25:28.214 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:25:28.217 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:25:28.217 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:25:28.217 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:25:28.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:25:28.220 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:25:28.220 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:28.263 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:25:28.263 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:28.264 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:25:28.264 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:28.290 INFO:tasks.ceph.mds.d.smithi092.stdout:starting mds.d at 2024-08-17T02:25:28.344 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-08-17T02:25:28.344 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-08-17T02:25:29.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-08-17T02:25:34.216 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:25:34.217 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:25:34.219 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:25:34.220 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:34.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:25:34.298 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2024-08-17T02:25:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.334+0000 7f15abfff700 1 Processor -- start 2024-08-17T02:25:34.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.334+0000 7f15abfff700 1 -- start start 2024-08-17T02:25:34.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.334+0000 7f15abfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f15ac15d2f0 0x7f15ac068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f15ac15d6c0 0x7f15ac15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac069460 con 0x7f15ac158f70 2024-08-17T02:25:34.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac06a2b0 con 0x7f15ac15d6c0 2024-08-17T02:25:34.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac0696a0 con 0x7f15ac15d2f0 2024-08-17T02:25:34.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15aa7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f15ac15d6c0 0x7f15ac15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15ab7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f15ac158f70 0x7f15ac1593f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60912/0 (socket says 172.21.15.31:60912) 2024-08-17T02:25:34.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15ab7fe700 1 -- 172.21.15.31:0/3515251531 learned_addr learned my addr 172.21.15.31:0/3515251531 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:34.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15aaffd700 1 --2- 172.21.15.31:0/3515251531 >> v2:172.21.15.92:3300/0 conn(0x7f15ac15d2f0 0x7f15ac068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15a9ffb700 1 -- 172.21.15.31:0/3515251531 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654085867 0 0) 0x7f15a4001490 con 0x7f15ac158f70 2024-08-17T02:25:34.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15a9ffb700 1 -- 172.21.15.31:0/3515251531 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1594003570 con 0x7f15ac158f70 2024-08-17T02:25:34.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15aa7fc700 1 -- 172.21.15.31:0/3515251531 >> v2:172.21.15.92:3300/0 conn(0x7f15ac15d2f0 msgr2=0x7f15ac068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:34.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15aa7fc700 1 --2- 172.21.15.31:0/3515251531 >> v2:172.21.15.92:3300/0 conn(0x7f15ac15d2f0 0x7f15ac068f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15aa7fc700 1 -- 172.21.15.31:0/3515251531 >> v1:172.21.15.31:6789/0 conn(0x7f15ac158f70 legacy=0x7f15ac1593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15aa7fc700 1 -- 172.21.15.31:0/3515251531 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac069980 con 0x7f15ac15d6c0 2024-08-17T02:25:34.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15aa7fc700 1 --2- 172.21.15.31:0/3515251531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac15d6c0 0x7f15ac15dac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0ceb80 tx=0x7f15a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700af6767f4b9ced server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15a9ffb700 1 -- 172.21.15.31:0/3515251531 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0011630 con 0x7f15ac15d6c0 2024-08-17T02:25:34.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15a9ffb700 1 -- 172.21.15.31:0/3515251531 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a00117b0 con 0x7f15ac15d6c0 2024-08-17T02:25:34.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15a9ffb700 1 -- 172.21.15.31:0/3515251531 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0011b70 con 0x7f15ac15d6c0 2024-08-17T02:25:34.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 -- 172.21.15.31:0/3515251531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac15d6c0 msgr2=0x7f15ac15dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 --2- 172.21.15.31:0/3515251531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac15d6c0 0x7f15ac15dac0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0ceb80 tx=0x7f15a00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 -- 172.21.15.31:0/3515251531 shutdown_connections 2024-08-17T02:25:34.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 --2- 172.21.15.31:0/3515251531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac15d6c0 0x7f15ac15dac0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 --2- 172.21.15.31:0/3515251531 >> v2:172.21.15.92:3300/0 conn(0x7f15ac15d2f0 0x7f15ac068f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 -- 172.21.15.31:0/3515251531 >> 172.21.15.31:0/3515251531 conn(0x7f15ac0cdfc0 msgr2=0x7f15ac0ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:34.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 -- 172.21.15.31:0/3515251531 shutdown_connections 2024-08-17T02:25:34.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.338+0000 7f15abfff700 1 -- 172.21.15.31:0/3515251531 wait complete. 2024-08-17T02:25:34.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15abfff700 1 Processor -- start 2024-08-17T02:25:34.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15abfff700 1 -- start start 2024-08-17T02:25:34.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15abfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac158f70 0x7f15ac152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15abfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15ac15d2f0 0x7f15ac15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15abfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15ac15d6c0 0x7f15ac15b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15abfff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac159b60 con 0x7f15ac158f70 2024-08-17T02:25:34.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15abfff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac159e40 con 0x7f15ac15d2f0 2024-08-17T02:25:34.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15abfff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac15a120 con 0x7f15ac15d6c0 2024-08-17T02:25:34.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15aaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac158f70 0x7f15ac152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15aaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac158f70 0x7f15ac152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36630/0 (socket says 172.21.15.31:36630) 2024-08-17T02:25:34.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15aaffd700 1 -- 172.21.15.31:0/2122271700 learned_addr learned my addr 172.21.15.31:0/2122271700 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:34.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15ab7fe700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15ac15d6c0 0x7f15ac15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15aa7fc700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15ac15d2f0 0x7f15ac15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15aaffd700 1 -- 172.21.15.31:0/2122271700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15ac15d6c0 msgr2=0x7f15ac15b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15aaffd700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15ac15d6c0 0x7f15ac15b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15aaffd700 1 -- 172.21.15.31:0/2122271700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15ac15d2f0 msgr2=0x7f15ac15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:34.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15aaffd700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15ac15d2f0 0x7f15ac15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:34.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15aaffd700 1 -- 172.21.15.31:0/2122271700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a0009420 con 0x7f15ac158f70 2024-08-17T02:25:34.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.342+0000 7f15aa7fc700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15ac15d2f0 0x7f15ac15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:34.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.346+0000 7f15aaffd700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac158f70 0x7f15ac152d20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f159c00ec80 tx=0x7f159c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.346+0000 7f1592ffd700 1 -- 172.21.15.31:0/2122271700 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00c850 con 0x7f15ac158f70 2024-08-17T02:25:34.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.346+0000 7f1592ffd700 1 -- 172.21.15.31:0/2122271700 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c00c9b0 con 0x7f15ac158f70 2024-08-17T02:25:34.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.346+0000 7f15abfff700 1 -- 172.21.15.31:0/2122271700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac15a400 con 0x7f15ac158f70 2024-08-17T02:25:34.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.346+0000 7f1592ffd700 1 -- 172.21.15.31:0/2122271700 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00cd50 con 0x7f15ac158f70 2024-08-17T02:25:34.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.346+0000 7f15abfff700 1 -- 172.21.15.31:0/2122271700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac153260 con 0x7f15ac158f70 2024-08-17T02:25:34.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.346+0000 7f15abfff700 1 -- 172.21.15.31:0/2122271700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac0712b0 con 0x7f15ac158f70 2024-08-17T02:25:34.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.346+0000 7f1592ffd700 1 -- 172.21.15.31:0/2122271700 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f159c013680 con 0x7f15ac158f70 2024-08-17T02:25:34.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.350+0000 7f1592ffd700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1598060860 0x7f1598062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:34.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.350+0000 7f1592ffd700 1 -- 172.21.15.31:0/2122271700 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f159c07cb80 con 0x7f15ac158f70 2024-08-17T02:25:34.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.350+0000 7f15aa7fc700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1598060860 0x7f1598062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:34.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.350+0000 7f15aa7fc700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1598060860 0x7f1598062d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0ceb80 tx=0x7f15a0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:34.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.358+0000 7f1592ffd700 1 -- 172.21.15.31:0/2122271700 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f159c04d230 con 0x7f15ac158f70 2024-08-17T02:25:34.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:34.534+0000 7f15abfff700 1 -- 172.21.15.31:0/2122271700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f15ac0b0890 con 0x7f15ac158f70 2024-08-17T02:25:36.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.210+0000 7f1592ffd700 1 -- 172.21.15.31:0/2122271700 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f159c050850 con 0x7f15ac158f70 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 -- 172.21.15.31:0/2122271700 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1598060860 msgr2=0x7f1598062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1598060860 0x7f1598062d10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0ceb80 tx=0x7f15a0017000 comp rx=0 tx=0).stop 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 -- 172.21.15.31:0/2122271700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac158f70 msgr2=0x7f15ac152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac158f70 0x7f15ac152d20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f159c00ec80 tx=0x7f159c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 -- 172.21.15.31:0/2122271700 shutdown_connections 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1598060860 0x7f1598062d10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15ac15d6c0 0x7f15ac15b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15ac15d2f0 0x7f15ac15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 --2- 172.21.15.31:0/2122271700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15ac158f70 0x7f15ac152d20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 -- 172.21.15.31:0/2122271700 >> 172.21.15.31:0/2122271700 conn(0x7f15ac0cdfc0 msgr2=0x7f15ac068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 -- 172.21.15.31:0/2122271700 shutdown_connections 2024-08-17T02:25:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.214+0000 7f15abfff700 1 -- 172.21.15.31:0/2122271700 wait complete. 2024-08-17T02:25:36.217 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-08-17T02:25:36.234 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:25:36.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.342+0000 7fa03469b700 1 Processor -- start 2024-08-17T02:25:36.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.342+0000 7fa03469b700 1 -- start start 2024-08-17T02:25:36.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa03469b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa02c155d60 0x7fa02c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa03469b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c0adf70 con 0x7fa02c0cc150 2024-08-17T02:25:36.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa03469b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02c0ad360 con 0x7fa02c068c20 2024-08-17T02:25:36.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa03469b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa02c0ad640 con 0x7fa02c155d60 2024-08-17T02:25:36.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa031c36700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa02c0cc150 0x7fa02c068510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60928/0 (socket says 172.21.15.31:60928) 2024-08-17T02:25:36.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa031c36700 1 -- 172.21.15.31:0/1970641842 learned_addr learned my addr 172.21.15.31:0/1970641842 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:36.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa032437700 1 --2- 172.21.15.31:0/1970641842 >> v2:172.21.15.92:3300/0 conn(0x7fa02c155d60 0x7fa02c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa031435700 1 -- 172.21.15.31:0/1970641842 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177052233 0 0) 0x7fa02c0adf70 con 0x7fa02c0cc150 2024-08-17T02:25:36.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa031435700 1 -- 172.21.15.31:0/1970641842 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa018003570 con 0x7fa02c0cc150 2024-08-17T02:25:36.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa032437700 1 -- 172.21.15.31:0/1970641842 >> v1:172.21.15.92:6789/0 conn(0x7fa02c068c20 legacy=0x7fa02c0ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa032437700 1 -- 172.21.15.31:0/1970641842 >> v1:172.21.15.31:6789/0 conn(0x7fa02c0cc150 legacy=0x7fa02c068510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa032437700 1 -- 172.21.15.31:0/1970641842 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c0ad920 con 0x7fa02c155d60 2024-08-17T02:25:36.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa032437700 1 --2- 172.21.15.31:0/1970641842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa02c155d60 0x7fa02c0cbc10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa0280098e0 tx=0x7fa0280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf6b6020c73d7e14 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.346+0000 7fa031435700 1 -- 172.21.15.31:0/1970641842 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800b640 con 0x7fa02c155d60 2024-08-17T02:25:36.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa031435700 1 -- 172.21.15.31:0/1970641842 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02800b7a0 con 0x7fa02c155d60 2024-08-17T02:25:36.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa031435700 1 -- 172.21.15.31:0/1970641842 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800bb40 con 0x7fa02c155d60 2024-08-17T02:25:36.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa03469b700 1 -- 172.21.15.31:0/1970641842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa02c155d60 msgr2=0x7fa02c0cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa03469b700 1 --2- 172.21.15.31:0/1970641842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa02c155d60 0x7fa02c0cbc10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa0280098e0 tx=0x7fa0280091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa03469b700 1 -- 172.21.15.31:0/1970641842 shutdown_connections 2024-08-17T02:25:36.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa03469b700 1 --2- 172.21.15.31:0/1970641842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa02c155d60 0x7fa02c0cbc10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa03469b700 1 -- 172.21.15.31:0/1970641842 >> 172.21.15.31:0/1970641842 conn(0x7fa02c06a280 msgr2=0x7fa02c06a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa03469b700 1 -- 172.21.15.31:0/1970641842 shutdown_connections 2024-08-17T02:25:36.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa03469b700 1 -- 172.21.15.31:0/1970641842 wait complete. 2024-08-17T02:25:36.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa03469b700 1 Processor -- start 2024-08-17T02:25:36.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.350+0000 7fa03469b700 1 -- start start 2024-08-17T02:25:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa03469b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa02c068c20 0x7fa02c1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa03469b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa02c0cc150 0x7fa02c156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa03469b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa02c155d60 0x7fa02c067400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa03469b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0b0eb0 con 0x7fa02c0cc150 2024-08-17T02:25:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa03469b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0b0580 con 0x7fa02c155d60 2024-08-17T02:25:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa03469b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0b0860 con 0x7fa02c068c20 2024-08-17T02:25:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa031c36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa02c0cc150 0x7fa02c156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa031c36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa02c0cc150 0x7fa02c156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36636/0 (socket says 172.21.15.31:36636) 2024-08-17T02:25:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa031c36700 1 -- 172.21.15.31:0/3578108292 learned_addr learned my addr 172.21.15.31:0/3578108292 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:36.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa032437700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa02c068c20 0x7fa02c1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa032c38700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa02c155d60 0x7fa02c067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa031c36700 1 -- 172.21.15.31:0/3578108292 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa02c068c20 msgr2=0x7fa02c1469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa031c36700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa02c068c20 0x7fa02c1469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa031c36700 1 -- 172.21.15.31:0/3578108292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa02c155d60 msgr2=0x7fa02c067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa031c36700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa02c155d60 0x7fa02c067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa031c36700 1 -- 172.21.15.31:0/3578108292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028009420 con 0x7fa02c0cc150 2024-08-17T02:25:36.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa031c36700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa02c0cc150 0x7fa02c156b70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00c7c0 tx=0x7fa01c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa0227fc700 1 -- 172.21.15.31:0/3578108292 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c005c00 con 0x7fa02c0cc150 2024-08-17T02:25:36.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa0227fc700 1 -- 172.21.15.31:0/3578108292 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c005d60 con 0x7fa02c0cc150 2024-08-17T02:25:36.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa0227fc700 1 -- 172.21.15.31:0/3578108292 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c007320 con 0x7fa02c0cc150 2024-08-17T02:25:36.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa03469b700 1 -- 172.21.15.31:0/3578108292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c0b0b40 con 0x7fa02c0cc150 2024-08-17T02:25:36.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa03469b700 1 -- 172.21.15.31:0/3578108292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c14d8a0 con 0x7fa02c0cc150 2024-08-17T02:25:36.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.354+0000 7fa03469b700 1 -- 172.21.15.31:0/3578108292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02c0b1020 con 0x7fa02c0cc150 2024-08-17T02:25:36.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.358+0000 7fa0227fc700 1 -- 172.21.15.31:0/3578108292 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa01c01b3b0 con 0x7fa02c0cc150 2024-08-17T02:25:36.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.358+0000 7fa0227fc700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa010060860 0x7fa010062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.358+0000 7fa032437700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa010060860 0x7fa010062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.358+0000 7fa0227fc700 1 -- 172.21.15.31:0/3578108292 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa01c07bd00 con 0x7fa02c0cc150 2024-08-17T02:25:36.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.358+0000 7fa032437700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa010060860 0x7fa010062d10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa0280093f0 tx=0x7fa028017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.366+0000 7fa0227fc700 1 -- 172.21.15.31:0/3578108292 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa01c04c4a0 con 0x7fa02c0cc150 2024-08-17T02:25:36.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-08-17T02:25:36.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.594+0000 7fa03469b700 1 -- 172.21.15.31:0/3578108292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa02c0712b0 con 0x7fa02c0cc150 2024-08-17T02:25:36.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa0227fc700 1 -- 172.21.15.31:0/3578108292 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa01c017090 con 0x7fa02c0cc150 2024-08-17T02:25:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:36.598 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:25:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-08-17T02:25:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-08-17T02:25:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBmWsYMGBAATuy2FpUkK2KxduW8Ss15Ew==", 2024-08-17T02:25:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBmdz5eIhAAIX9WzIMJQK+oQfgcIiCPAw==", 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-08-17T02:25:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBmSiBpHhAAe6wj5RSG5BzeoNLwxs8hDQ==", 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBmU22hJRAAy0czxaNfvgw2oO+PQSfi2w==", 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-08-17T02:25:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCzCcBmy2j1GhAA7SQ4FAeLG3CKvTdDXDXqmw==", 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQC2CcBmS7DNHRAAPAE9sAb9hGJF2pEUGleQOA==", 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-08-17T02:25:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQC5CcBmbUhMIxAAHsmidO5AJbVxgrnp8Pa0Tw==", 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQC8CcBmkFruJxAANR31+LcnQAWTyA6Xz/4wdg==", 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQDCCcBmJzdFCBAAGYzwxSr+uFkycYmCO9H1Pw==", 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-08-17T02:25:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQDFCcBmQpeNCxAA0jiOZAn1WvIvEiX7nIb5LQ==", 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-08-17T02:25:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQDICcBmm5eWEBAAbghTwfKgRZ2vkFhUuffiwQ==", 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQDLCcBmoV+EERAAO1fzLsabhnmBHbCS9TSPgg==", 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-08-17T02:25:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBmkNFbKxAAUXw0M96BRSK47th2kqPs5g==", 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBm+dvEMxAAgUs6zUZ802bVKnD6o1gGSw==", 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBmSX7JMBAAhGE8RPlAIA/i5rrP4YULYw==", 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBm9dVrNhAAfCIckPpsaS81diZ5rsWs4g==", 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-08-17T02:25:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBmGhYLCBAAo59NhlMNAws6NN6XRE7bAA==", 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQDVCcBm5JZkExAAHi1S7yxf8NlFKMKnGmQEhg==", 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQDVCcBmBrFkExAASY7xziO1upUi07jiyWq6gw==", 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQDVCcBmuspkExAAQGoMfWl/Vy22M1eI2H6Xdw==", 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQDVCcBmD+JkExAAP7B6j6ZeIOijyyPgIjrE9Q==", 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQDVCcBm8/hkExAABsO4Pm5OfRZIE9zzWtcqGw==", 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQDVCcBmmRBlExAAyb0DG1jwWMtj0NiPwpT80w==", 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBm7xxMFRAAoNMMJCQJfZ1I1yaoX4HdxQ==", 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-08-17T02:25:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCwCcBmNYpcEhAAT7JRqXXk0qrxOAI+G3Twpw==", 2024-08-17T02:25:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-08-17T02:25:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-08-17T02:25:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-08-17T02:25:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-08-17T02:25:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-08-17T02:25:36.615 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 -- 172.21.15.31:0/3578108292 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa010060860 msgr2=0x7fa010062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa010060860 0x7fa010062d10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa0280093f0 tx=0x7fa028017000 comp rx=0 tx=0).stop 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 -- 172.21.15.31:0/3578108292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa02c0cc150 msgr2=0x7fa02c156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa02c0cc150 0x7fa02c156b70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00c7c0 tx=0x7fa01c007dd0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 -- 172.21.15.31:0/3578108292 shutdown_connections 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa010060860 0x7fa010062d10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa02c155d60 0x7fa02c067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa02c0cc150 0x7fa02c156b70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 --2- 172.21.15.31:0/3578108292 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa02c068c20 0x7fa02c1469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 -- 172.21.15.31:0/3578108292 >> 172.21.15.31:0/3578108292 conn(0x7fa02c06a280 msgr2=0x7fa02c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 -- 172.21.15.31:0/3578108292 shutdown_connections 2024-08-17T02:25:36.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.598+0000 7fa03469b700 1 -- 172.21.15.31:0/3578108292 wait complete. 2024-08-17T02:25:36.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:25:36.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.726+0000 7f13f94ea700 1 Processor -- start 2024-08-17T02:25:36.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.726+0000 7f13f94ea700 1 -- start start 2024-08-17T02:25:36.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f94ea700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f13f40b12b0 0x7f13f40c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f94ea700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13f40ca070 0x7f13f406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f94ea700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f40cb1b0 con 0x7f13f4156fd0 2024-08-17T02:25:36.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f94ea700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f40ca5a0 con 0x7f13f40b12b0 2024-08-17T02:25:36.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f94ea700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40ca880 con 0x7f13f40ca070 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13ebfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f13f40b12b0 0x7f13f40c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f37fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13f40ca070 0x7f13f406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f2ffd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f13f4156fd0 0x7f13f40cb640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:58156/0 (socket says 172.21.15.31:58156) 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f2ffd700 1 -- 172.21.15.31:0/4102316455 learned_addr learned my addr 172.21.15.31:0/4102316455 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13ebfff700 1 -- 172.21.15.31:0/4102316455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13f40ca070 msgr2=0x7f13f406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13ebfff700 1 --2- 172.21.15.31:0/4102316455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13f40ca070 0x7f13f406a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13ebfff700 1 -- 172.21.15.31:0/4102316455 >> v1:172.21.15.92:6789/0 conn(0x7f13f4156fd0 legacy=0x7f13f40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f27fc700 1 -- 172.21.15.31:0/4102316455 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163434378 0 0) 0x7f13f40cb1b0 con 0x7f13f4156fd0 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13ebfff700 1 -- 172.21.15.31:0/4102316455 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f40cab60 con 0x7f13f40b12b0 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13ebfff700 1 --2- 172.21.15.31:0/4102316455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13f40b12b0 0x7f13f40c9b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0098e0 tx=0x7f13dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9d23a6caaae2ad7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f27fc700 1 -- 172.21.15.31:0/4102316455 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc00b640 con 0x7f13f40b12b0 2024-08-17T02:25:36.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f27fc700 1 -- 172.21.15.31:0/4102316455 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc00b7a0 con 0x7f13f40b12b0 2024-08-17T02:25:36.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f27fc700 1 -- 172.21.15.31:0/4102316455 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc00bb40 con 0x7f13f40b12b0 2024-08-17T02:25:36.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f94ea700 1 -- 172.21.15.31:0/4102316455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13f40b12b0 msgr2=0x7f13f40c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.730+0000 7f13f94ea700 1 --2- 172.21.15.31:0/4102316455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13f40b12b0 0x7f13f40c9b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0098e0 tx=0x7f13dc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 -- 172.21.15.31:0/4102316455 shutdown_connections 2024-08-17T02:25:36.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 --2- 172.21.15.31:0/4102316455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13f40ca070 0x7f13f406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 --2- 172.21.15.31:0/4102316455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13f40b12b0 0x7f13f40c9b30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 -- 172.21.15.31:0/4102316455 >> 172.21.15.31:0/4102316455 conn(0x7f13f40cbe50 msgr2=0x7f13f40cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 -- 172.21.15.31:0/4102316455 shutdown_connections 2024-08-17T02:25:36.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 -- 172.21.15.31:0/4102316455 wait complete. 2024-08-17T02:25:36.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 Processor -- start 2024-08-17T02:25:36.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 -- start start 2024-08-17T02:25:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13f40b12b0 0x7f13f414b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f40ca070 0x7f13f4147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13f4156fd0 0x7f13f4150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4147f80 con 0x7f13f40ca070 2024-08-17T02:25:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40c7510 con 0x7f13f40b12b0 2024-08-17T02:25:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13f94ea700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f40c77f0 con 0x7f13f4156fd0 2024-08-17T02:25:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.734+0000 7f13ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f40ca070 0x7f13f4147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f40ca070 0x7f13f4147a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36648/0 (socket says 172.21.15.31:36648) 2024-08-17T02:25:36.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13ebfff700 1 -- 172.21.15.31:0/3134135483 learned_addr learned my addr 172.21.15.31:0/3134135483 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:36.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13f2ffd700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13f40b12b0 0x7f13f414b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13f37fe700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13f4156fd0 0x7f13f4150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13ebfff700 1 -- 172.21.15.31:0/3134135483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13f4156fd0 msgr2=0x7f13f4150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13ebfff700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13f4156fd0 0x7f13f4150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13ebfff700 1 -- 172.21.15.31:0/3134135483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13f40b12b0 msgr2=0x7f13f414b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13ebfff700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13f40b12b0 0x7f13f414b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13ebfff700 1 -- 172.21.15.31:0/3134135483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc009420 con 0x7f13f40ca070 2024-08-17T02:25:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13f2ffd700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13f40b12b0 0x7f13f414b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13ebfff700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f40ca070 0x7f13f4147a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f13f406c560 tx=0x7f13dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13eaffd700 1 -- 172.21.15.31:0/3134135483 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc00bb20 con 0x7f13f40ca070 2024-08-17T02:25:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13eaffd700 1 -- 172.21.15.31:0/3134135483 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc000c90 con 0x7f13f40ca070 2024-08-17T02:25:36.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13eaffd700 1 -- 172.21.15.31:0/3134135483 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc011650 con 0x7f13f40ca070 2024-08-17T02:25:36.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13f94ea700 1 -- 172.21.15.31:0/3134135483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f40c7ad0 con 0x7f13f40ca070 2024-08-17T02:25:36.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13f94ea700 1 -- 172.21.15.31:0/3134135483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f40c70a0 con 0x7f13f40ca070 2024-08-17T02:25:36.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.738+0000 7f13f94ea700 1 -- 172.21.15.31:0/3134135483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f414ecb0 con 0x7f13f40ca070 2024-08-17T02:25:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.742+0000 7f13eaffd700 1 -- 172.21.15.31:0/3134135483 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f13dc011a00 con 0x7f13f40ca070 2024-08-17T02:25:36.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.742+0000 7f13eaffd700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f13d4060860 0x7f13d4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.742+0000 7f13eaffd700 1 -- 172.21.15.31:0/3134135483 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f13dc07de30 con 0x7f13f40ca070 2024-08-17T02:25:36.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.742+0000 7f13f2ffd700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f13d4060860 0x7f13d4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.742+0000 7f13f2ffd700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f13d4060860 0x7f13d4062d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f13e40016f0 tx=0x7f13e4007f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.746+0000 7f13eaffd700 1 -- 172.21.15.31:0/3134135483 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f13f414ecb0 con 0x7f13f40ca070 2024-08-17T02:25:36.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.970+0000 7f13f94ea700 1 -- 172.21.15.31:0/3134135483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f13f414ecb0 con 0x7f13f40ca070 2024-08-17T02:25:36.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13eaffd700 1 -- 172.21.15.31:0/3134135483 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f13f414ecb0 con 0x7f13f40ca070 2024-08-17T02:25:36.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 -- 172.21.15.31:0/3134135483 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f13d4060860 msgr2=0x7f13d4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f13d4060860 0x7f13d4062d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f13e40016f0 tx=0x7f13e4007f50 comp rx=0 tx=0).stop 2024-08-17T02:25:36.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 -- 172.21.15.31:0/3134135483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f40ca070 msgr2=0x7f13f4147a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f40ca070 0x7f13f4147a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f13f406c560 tx=0x7f13dc017000 comp rx=0 tx=0).stop 2024-08-17T02:25:36.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 -- 172.21.15.31:0/3134135483 shutdown_connections 2024-08-17T02:25:36.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f13d4060860 0x7f13d4062d10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13f4156fd0 0x7f13f4150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f40ca070 0x7f13f4147a40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 --2- 172.21.15.31:0/3134135483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13f40b12b0 0x7f13f414b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 -- 172.21.15.31:0/3134135483 >> 172.21.15.31:0/3134135483 conn(0x7f13f40cbe50 msgr2=0x7f13f4154920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 -- 172.21.15.31:0/3134135483 shutdown_connections 2024-08-17T02:25:36.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:36.978+0000 7f13f94ea700 1 -- 172.21.15.31:0/3134135483 wait complete. 2024-08-17T02:25:36.995 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:25:37.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.102+0000 7fe28b10e700 1 Processor -- start 2024-08-17T02:25:37.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.102+0000 7fe28b10e700 1 -- start start 2024-08-17T02:25:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28b10e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 0x7fe284159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28b10e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe284159a10 con 0x7fe284155590 2024-08-17T02:25:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28b10e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2840af010 con 0x7fe284068ad0 2024-08-17T02:25:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28b10e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840aee20 con 0x7fe28406e310 2024-08-17T02:25:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28a10c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe284155590 0x7fe2840ae710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60932/0 (socket says 172.21.15.31:60932) 2024-08-17T02:25:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28a10c700 1 -- 172.21.15.31:0/2522172518 learned_addr learned my addr 172.21.15.31:0/2522172518 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28a90d700 1 --2- 172.21.15.31:0/2522172518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 0x7fe284159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28910a700 1 -- 172.21.15.31:0/2522172518 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572161815 0 0) 0x7fe284159a10 con 0x7fe284155590 2024-08-17T02:25:37.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28910a700 1 -- 172.21.15.31:0/2522172518 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe270003570 con 0x7fe284155590 2024-08-17T02:25:37.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28910a700 1 -- 172.21.15.31:0/2522172518 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821018452 0 0) 0x7fe2840af010 con 0x7fe284068ad0 2024-08-17T02:25:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28910a700 1 -- 172.21.15.31:0/2522172518 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe284159a10 con 0x7fe284068ad0 2024-08-17T02:25:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28910a700 1 -- 172.21.15.31:0/2522172518 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3550179061 0 0) 0x7fe270003570 con 0x7fe284155590 2024-08-17T02:25:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28a90d700 1 -- 172.21.15.31:0/2522172518 >> v1:172.21.15.92:6789/0 conn(0x7fe284068ad0 legacy=0x7fe28406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28a90d700 1 -- 172.21.15.31:0/2522172518 >> v1:172.21.15.31:6789/0 conn(0x7fe284155590 legacy=0x7fe2840ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28a90d700 1 -- 172.21.15.31:0/2522172518 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840af2f0 con 0x7fe28406e310 2024-08-17T02:25:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28a90d700 1 --2- 172.21.15.31:0/2522172518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 0x7fe284159ea0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009e90 tx=0x7fe27c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b467c5874029f4e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28910a700 1 -- 172.21.15.31:0/2522172518 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00e070 con 0x7fe28406e310 2024-08-17T02:25:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28910a700 1 -- 172.21.15.31:0/2522172518 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c00b870 con 0x7fe28406e310 2024-08-17T02:25:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.106+0000 7fe28910a700 1 -- 172.21.15.31:0/2522172518 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280001470 con 0x7fe28406e310 2024-08-17T02:25:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.110+0000 7fe28b10e700 1 -- 172.21.15.31:0/2522172518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 msgr2=0x7fe284159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.110+0000 7fe28b10e700 1 --2- 172.21.15.31:0/2522172518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 0x7fe284159ea0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009e90 tx=0x7fe27c009780 comp rx=0 tx=0).stop 2024-08-17T02:25:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.110+0000 7fe28b10e700 1 -- 172.21.15.31:0/2522172518 shutdown_connections 2024-08-17T02:25:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.110+0000 7fe28b10e700 1 --2- 172.21.15.31:0/2522172518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 0x7fe284159ea0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.110+0000 7fe28b10e700 1 -- 172.21.15.31:0/2522172518 >> 172.21.15.31:0/2522172518 conn(0x7fe2840c9210 msgr2=0x7fe2840c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.110+0000 7fe28b10e700 1 -- 172.21.15.31:0/2522172518 shutdown_connections 2024-08-17T02:25:37.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.110+0000 7fe28b10e700 1 -- 172.21.15.31:0/2522172518 wait complete. 2024-08-17T02:25:37.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.110+0000 7fe28b10e700 1 Processor -- start 2024-08-17T02:25:37.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.110+0000 7fe28b10e700 1 -- start start 2024-08-17T02:25:37.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28b10e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe284068ad0 0x7fe284149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28b10e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 0x7fe284149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28b10e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe284155590 0x7fe284158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28b10e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe284158190 con 0x7fe284068ad0 2024-08-17T02:25:37.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28b10e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28414a400 con 0x7fe284155590 2024-08-17T02:25:37.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28b10e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28414a6a0 con 0x7fe28406e310 2024-08-17T02:25:37.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28a10c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe284068ad0 0x7fe284149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28a10c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe284068ad0 0x7fe284149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36660/0 (socket says 172.21.15.31:36660) 2024-08-17T02:25:37.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28a10c700 1 -- 172.21.15.31:0/1730036434 learned_addr learned my addr 172.21.15.31:0/1730036434 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:37.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28a90d700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe284155590 0x7fe284158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28990b700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 0x7fe284149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28a10c700 1 -- 172.21.15.31:0/1730036434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 msgr2=0x7fe284149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28a10c700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 0x7fe284149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28a10c700 1 -- 172.21.15.31:0/1730036434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe284155590 msgr2=0x7fe284158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28a10c700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe284155590 0x7fe284158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28a10c700 1 -- 172.21.15.31:0/1730036434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c009a20 con 0x7fe284068ad0 2024-08-17T02:25:37.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28a10c700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe284068ad0 0x7fe284149330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe28000cb70 tx=0x7fe280001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe27a7fc700 1 -- 172.21.15.31:0/1730036434 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280007150 con 0x7fe284068ad0 2024-08-17T02:25:37.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe27a7fc700 1 -- 172.21.15.31:0/1730036434 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2800072b0 con 0x7fe284068ad0 2024-08-17T02:25:37.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28b10e700 1 -- 172.21.15.31:0/1730036434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe284158400 con 0x7fe284068ad0 2024-08-17T02:25:37.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe27a7fc700 1 -- 172.21.15.31:0/1730036434 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280007670 con 0x7fe284068ad0 2024-08-17T02:25:37.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.114+0000 7fe28b10e700 1 -- 172.21.15.31:0/1730036434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe284159140 con 0x7fe284068ad0 2024-08-17T02:25:37.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.118+0000 7fe28b10e700 1 -- 172.21.15.31:0/1730036434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe284158900 con 0x7fe284068ad0 2024-08-17T02:25:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.118+0000 7fe27a7fc700 1 -- 172.21.15.31:0/1730036434 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe280004a40 con 0x7fe284068ad0 2024-08-17T02:25:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.118+0000 7fe27a7fc700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe268060860 0x7fe268062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.118+0000 7fe27a7fc700 1 -- 172.21.15.31:0/1730036434 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe28007bea0 con 0x7fe284068ad0 2024-08-17T02:25:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.118+0000 7fe28990b700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe268060860 0x7fe268062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.118+0000 7fe28990b700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe268060860 0x7fe268062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe284169990 tx=0x7fe274009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.130+0000 7fe27a7fc700 1 -- 172.21.15.31:0/1730036434 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe2800500b0 con 0x7fe284068ad0 2024-08-17T02:25:37.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.358+0000 7fe28b10e700 1 -- 172.21.15.31:0/1730036434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe2840712b0 con 0x7fe284068ad0 2024-08-17T02:25:37.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.366+0000 7fe27a7fc700 1 -- 172.21.15.31:0/1730036434 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe2800180a0 con 0x7fe284068ad0 2024-08-17T02:25:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 -- 172.21.15.31:0/1730036434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe268060860 msgr2=0x7fe268062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe268060860 0x7fe268062d10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe284169990 tx=0x7fe274009040 comp rx=0 tx=0).stop 2024-08-17T02:25:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 -- 172.21.15.31:0/1730036434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe284068ad0 msgr2=0x7fe284149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe284068ad0 0x7fe284149330 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe28000cb70 tx=0x7fe280001ab0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 -- 172.21.15.31:0/1730036434 shutdown_connections 2024-08-17T02:25:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe268060860 0x7fe268062d10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe284155590 0x7fe284158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe28406e310 0x7fe284149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 --2- 172.21.15.31:0/1730036434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe284068ad0 0x7fe284149330 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 -- 172.21.15.31:0/1730036434 >> 172.21.15.31:0/1730036434 conn(0x7fe2840c9210 msgr2=0x7fe2840c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 -- 172.21.15.31:0/1730036434 shutdown_connections 2024-08-17T02:25:37.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.370+0000 7fe28b10e700 1 -- 172.21.15.31:0/1730036434 wait complete. 2024-08-17T02:25:37.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:25:37.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d6e82700 1 Processor -- start 2024-08-17T02:25:37.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d6e82700 1 -- start start 2024-08-17T02:25:37.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d6e82700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35d0159060 0x7f35d015cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d6e82700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159430 0x7f35d015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d6e82700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00cec90 con 0x7f35d00ad330 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d6e82700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d00d0c80 con 0x7f35d0159060 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d6e82700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00d0f20 con 0x7f35d0159430 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d4c1e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35d0159060 0x7f35d015cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35cffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f35d00ad330 0x7f35d00cf120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60936/0 (socket says 172.21.15.31:60936) 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35cffff700 1 -- 172.21.15.31:0/3589943742 learned_addr learned my addr 172.21.15.31:0/3589943742 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d541f700 1 --2- 172.21.15.31:0/3589943742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159430 0x7f35d015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d4c1e700 1 -- 172.21.15.31:0/3589943742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159430 msgr2=0x7f35d015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d4c1e700 1 --2- 172.21.15.31:0/3589943742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159430 0x7f35d015d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d4c1e700 1 -- 172.21.15.31:0/3589943742 >> v1:172.21.15.31:6789/0 conn(0x7f35d00ad330 legacy=0x7f35d00cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d4c1e700 1 -- 172.21.15.31:0/3589943742 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00ce920 con 0x7f35d0159060 2024-08-17T02:25:37.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35d4c1e700 1 --2- 172.21.15.31:0/3589943742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159060 0x7f35d015cea0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f35c00098e0 tx=0x7f35c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6923b284a8ad1be4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35cf7fe700 1 -- 172.21.15.31:0/3589943742 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0009e80 con 0x7f35d0159060 2024-08-17T02:25:37.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35cf7fe700 1 -- 172.21.15.31:0/3589943742 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c000b860 con 0x7f35d0159060 2024-08-17T02:25:37.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.490+0000 7f35cf7fe700 1 -- 172.21.15.31:0/3589943742 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c000bbe0 con 0x7f35d0159060 2024-08-17T02:25:37.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 -- 172.21.15.31:0/3589943742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159060 msgr2=0x7f35d015cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 --2- 172.21.15.31:0/3589943742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159060 0x7f35d015cea0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f35c00098e0 tx=0x7f35c00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 -- 172.21.15.31:0/3589943742 shutdown_connections 2024-08-17T02:25:37.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 --2- 172.21.15.31:0/3589943742 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159430 0x7f35d015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 --2- 172.21.15.31:0/3589943742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159060 0x7f35d015cea0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 -- 172.21.15.31:0/3589943742 >> 172.21.15.31:0/3589943742 conn(0x7f35d0067b90 msgr2=0x7f35d00d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 -- 172.21.15.31:0/3589943742 shutdown_connections 2024-08-17T02:25:37.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 -- 172.21.15.31:0/3589943742 wait complete. 2024-08-17T02:25:37.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 Processor -- start 2024-08-17T02:25:37.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 -- start start 2024-08-17T02:25:37.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.494+0000 7f35d6e82700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d00ad330 0x7f35d0157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d6e82700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159060 0x7f35d00c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d6e82700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159430 0x7f35d00c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d6e82700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00b2430 con 0x7f35d0159430 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d6e82700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00c6560 con 0x7f35d00ad330 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d6e82700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00afcf0 con 0x7f35d0159060 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d541f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159430 0x7f35d00c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d541f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159430 0x7f35d00c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36688/0 (socket says 172.21.15.31:36688) 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d541f700 1 -- 172.21.15.31:0/2774856944 learned_addr learned my addr 172.21.15.31:0/2774856944 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35cffff700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159060 0x7f35d00c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d4c1e700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d00ad330 0x7f35d0157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d541f700 1 -- 172.21.15.31:0/2774856944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159060 msgr2=0x7f35d00c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d541f700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159060 0x7f35d00c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d541f700 1 -- 172.21.15.31:0/2774856944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d00ad330 msgr2=0x7f35d0157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d541f700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d00ad330 0x7f35d0157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d541f700 1 -- 172.21.15.31:0/2774856944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0009420 con 0x7f35d0159430 2024-08-17T02:25:37.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35cffff700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159060 0x7f35d00c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:37.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d541f700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159430 0x7f35d00c56d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f35c800d890 tx=0x7f35c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35ccff9700 1 -- 172.21.15.31:0/2774856944 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c80125f0 con 0x7f35d0159430 2024-08-17T02:25:37.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35ccff9700 1 -- 172.21.15.31:0/2774856944 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c8012770 con 0x7f35d0159430 2024-08-17T02:25:37.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d6e82700 1 -- 172.21.15.31:0/2774856944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d0158360 con 0x7f35d0159430 2024-08-17T02:25:37.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35ccff9700 1 -- 172.21.15.31:0/2774856944 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8012b30 con 0x7f35d0159430 2024-08-17T02:25:37.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d6e82700 1 -- 172.21.15.31:0/2774856944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d00c5fa0 con 0x7f35d0159430 2024-08-17T02:25:37.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.498+0000 7f35d6e82700 1 -- 172.21.15.31:0/2774856944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d00712b0 con 0x7f35d0159430 2024-08-17T02:25:37.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.502+0000 7f35ccff9700 1 -- 172.21.15.31:0/2774856944 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f35c8013480 con 0x7f35d0159430 2024-08-17T02:25:37.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.502+0000 7f35ccff9700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f35b0060890 0x7f35b0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.502+0000 7f35ccff9700 1 -- 172.21.15.31:0/2774856944 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f35c807cb00 con 0x7f35d0159430 2024-08-17T02:25:37.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.502+0000 7f35d4c1e700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f35b0060890 0x7f35b0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.502+0000 7f35d4c1e700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f35b0060890 0x7f35b0062d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35c00091e0 tx=0x7f35c0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.510+0000 7f35ccff9700 1 -- 172.21.15.31:0/2774856944 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f35c804d2a0 con 0x7f35d0159430 2024-08-17T02:25:37.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.738+0000 7f35d6e82700 1 -- 172.21.15.31:0/2774856944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f35d015d700 con 0x7f35d0159430 2024-08-17T02:25:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.742+0000 7f35ccff9700 1 -- 172.21.15.31:0/2774856944 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f35c80508c0 con 0x7f35d0159430 2024-08-17T02:25:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 -- 172.21.15.31:0/2774856944 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f35b0060890 msgr2=0x7f35b0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f35b0060890 0x7f35b0062d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35c00091e0 tx=0x7f35c0017000 comp rx=0 tx=0).stop 2024-08-17T02:25:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 -- 172.21.15.31:0/2774856944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159430 msgr2=0x7f35d00c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159430 0x7f35d00c56d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f35c800d890 tx=0x7f35c8008040 comp rx=0 tx=0).stop 2024-08-17T02:25:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 -- 172.21.15.31:0/2774856944 shutdown_connections 2024-08-17T02:25:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f35b0060890 0x7f35b0062d40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35d0159430 0x7f35d00c56d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35d0159060 0x7f35d00c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 --2- 172.21.15.31:0/2774856944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35d00ad330 0x7f35d0157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 -- 172.21.15.31:0/2774856944 >> 172.21.15.31:0/2774856944 conn(0x7f35d0067b90 msgr2=0x7f35d015ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 -- 172.21.15.31:0/2774856944 shutdown_connections 2024-08-17T02:25:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.746+0000 7f35d6e82700 1 -- 172.21.15.31:0/2774856944 wait complete. 2024-08-17T02:25:37.760 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:25:37.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.870+0000 7f7c5fc60700 1 Processor -- start 2024-08-17T02:25:37.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.870+0000 7f7c5fc60700 1 -- start start 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.870+0000 7f7c5fc60700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7c5815d5b0 0x7f7c5815d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5fc60700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5806f2b0 con 0x7f7c580c9810 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5fc60700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5806e3c0 con 0x7f7c58067b10 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5fc60700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5806e6a0 con 0x7f7c5815d5b0 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5d9fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7c5815d5b0 0x7f7c5815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5d1fb700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7c580c9810 0x7f7c58067400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60950/0 (socket says 172.21.15.31:60950) 2024-08-17T02:25:37.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5d1fb700 1 -- 172.21.15.31:0/4020749367 learned_addr learned my addr 172.21.15.31:0/4020749367 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5c9fa700 1 -- 172.21.15.31:0/4020749367 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044331768 0 0) 0x7f7c5806f2b0 con 0x7f7c580c9810 2024-08-17T02:25:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5c9fa700 1 -- 172.21.15.31:0/4020749367 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c40003570 con 0x7f7c580c9810 2024-08-17T02:25:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5d9fc700 1 -- 172.21.15.31:0/4020749367 >> v1:172.21.15.92:6789/0 conn(0x7f7c58067b10 legacy=0x7f7c580c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5c9fa700 1 -- 172.21.15.31:0/4020749367 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531448744 0 0) 0x7f7c5806e3c0 con 0x7f7c58067b10 2024-08-17T02:25:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5d9fc700 1 -- 172.21.15.31:0/4020749367 >> v1:172.21.15.31:6789/0 conn(0x7f7c580c9810 legacy=0x7f7c58067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5d9fc700 1 -- 172.21.15.31:0/4020749367 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5806e980 con 0x7f7c5815d5b0 2024-08-17T02:25:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5d9fc700 1 --2- 172.21.15.31:0/4020749367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 0x7f7c5815d980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7c480098e0 tx=0x7f7c480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c864fb1499af6f78 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5c9fa700 1 -- 172.21.15.31:0/4020749367 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800b640 con 0x7f7c5815d5b0 2024-08-17T02:25:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5c9fa700 1 -- 172.21.15.31:0/4020749367 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800b7a0 con 0x7f7c5815d5b0 2024-08-17T02:25:37.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5c9fa700 1 -- 172.21.15.31:0/4020749367 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800bb40 con 0x7f7c5815d5b0 2024-08-17T02:25:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4020749367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 msgr2=0x7f7c5815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5fc60700 1 --2- 172.21.15.31:0/4020749367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 0x7f7c5815d980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7c480098e0 tx=0x7f7c480091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4020749367 shutdown_connections 2024-08-17T02:25:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5fc60700 1 --2- 172.21.15.31:0/4020749367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 0x7f7c5815d980 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4020749367 >> 172.21.15.31:0/4020749367 conn(0x7f7c5806bba0 msgr2=0x7f7c58068510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:37.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4020749367 shutdown_connections 2024-08-17T02:25:37.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.874+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4020749367 wait complete. 2024-08-17T02:25:37.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5fc60700 1 Processor -- start 2024-08-17T02:25:37.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5fc60700 1 -- start start 2024-08-17T02:25:37.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5fc60700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7c58067b10 0x7f7c58156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5fc60700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c580c9810 0x7f7c581565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5fc60700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 0x7f7c580ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5fc60700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580a7840 con 0x7f7c5815d5b0 2024-08-17T02:25:37.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5fc60700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580a80e0 con 0x7f7c580c9810 2024-08-17T02:25:37.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5fc60700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580aaaf0 con 0x7f7c58067b10 2024-08-17T02:25:37.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5e1fd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 0x7f7c580ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5e1fd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 0x7f7c580ade90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36712/0 (socket says 172.21.15.31:36712) 2024-08-17T02:25:37.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5d9fc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7c58067b10 0x7f7c58156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5e1fd700 1 -- 172.21.15.31:0/4069673950 learned_addr learned my addr 172.21.15.31:0/4069673950 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:37.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5d1fb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c580c9810 0x7f7c581565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5e1fd700 1 -- 172.21.15.31:0/4069673950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7c58067b10 msgr2=0x7f7c58156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5e1fd700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7c58067b10 0x7f7c58156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5e1fd700 1 -- 172.21.15.31:0/4069673950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c580c9810 msgr2=0x7f7c581565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5e1fd700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c580c9810 0x7f7c581565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5e1fd700 1 -- 172.21.15.31:0/4069673950 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c48009420 con 0x7f7c5815d5b0 2024-08-17T02:25:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.878+0000 7f7c5e1fd700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 0x7f7c580ade90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000c540 tx=0x7f7c50007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.882+0000 7f7c4dffb700 1 -- 172.21.15.31:0/4069673950 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50011590 con 0x7f7c5815d5b0 2024-08-17T02:25:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.882+0000 7f7c4dffb700 1 -- 172.21.15.31:0/4069673950 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c500116f0 con 0x7f7c5815d5b0 2024-08-17T02:25:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.882+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4069673950 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c580a7a90 con 0x7f7c5815d5b0 2024-08-17T02:25:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.882+0000 7f7c4dffb700 1 -- 172.21.15.31:0/4069673950 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c50011ab0 con 0x7f7c5815d5b0 2024-08-17T02:25:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.882+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4069673950 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c58157390 con 0x7f7c5815d5b0 2024-08-17T02:25:37.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.882+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4069673950 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c580712b0 con 0x7f7c5815d5b0 2024-08-17T02:25:37.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.882+0000 7f7c4dffb700 1 -- 172.21.15.31:0/4069673950 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f7c5001b3b0 con 0x7f7c5815d5b0 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.886+0000 7f7c4dffb700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7c44060860 0x7f7c44062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.886+0000 7f7c5d9fc700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7c44060860 0x7f7c44062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.886+0000 7f7c4dffb700 1 -- 172.21.15.31:0/4069673950 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7c5007bc70 con 0x7f7c5815d5b0 2024-08-17T02:25:37.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.886+0000 7f7c5d9fc700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7c44060860 0x7f7c44062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7c480093f0 tx=0x7f7c48017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:37.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:37.890+0000 7f7c4dffb700 1 -- 172.21.15.31:0/4069673950 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7c5004c370 con 0x7f7c5815d5b0 2024-08-17T02:25:38.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.114+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4069673950 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7c580a8220 con 0x7f7c5815d5b0 2024-08-17T02:25:38.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c4dffb700 1 -- 172.21.15.31:0/4069673950 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7c500170a0 con 0x7f7c5815d5b0 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4069673950 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7c44060860 msgr2=0x7f7c44062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7c44060860 0x7f7c44062d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7c480093f0 tx=0x7f7c48017000 comp rx=0 tx=0).stop 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4069673950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 msgr2=0x7f7c580ade90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 0x7f7c580ade90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000c540 tx=0x7f7c50007f30 comp rx=0 tx=0).stop 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4069673950 shutdown_connections 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7c44060860 0x7f7c44062d10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c5815d5b0 0x7f7c580ade90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c580c9810 0x7f7c581565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 --2- 172.21.15.31:0/4069673950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7c58067b10 0x7f7c58156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4069673950 >> 172.21.15.31:0/4069673950 conn(0x7f7c5806bba0 msgr2=0x7f7c581593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4069673950 shutdown_connections 2024-08-17T02:25:38.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.122+0000 7f7c5fc60700 1 -- 172.21.15.31:0/4069673950 wait complete. 2024-08-17T02:25:38.139 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:25:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.246+0000 7fe6e93eb700 1 Processor -- start 2024-08-17T02:25:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.246+0000 7fe6e93eb700 1 -- start start 2024-08-17T02:25:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e93eb700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe6e415aa00 0x7fe6e40ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e93eb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40ca820 con 0x7fe6e4067630 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e93eb700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40b1920 con 0x7fe6e4067a00 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e93eb700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e40b2780 con 0x7fe6e415aa00 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe6e4067630 0x7fe6e40aea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60962/0 (socket says 172.21.15.31:60962) 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e3fff700 1 -- 172.21.15.31:0/3523524382 learned_addr learned my addr 172.21.15.31:0/3523524382 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e8bea700 1 --2- 172.21.15.31:0/3523524382 >> v2:172.21.15.92:3300/0 conn(0x7fe6e415aa00 0x7fe6e40ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e2ffd700 1 -- 172.21.15.31:0/3523524382 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819537586 0 0) 0x7fe6e40ca820 con 0x7fe6e4067630 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e2ffd700 1 -- 172.21.15.31:0/3523524382 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6cc003570 con 0x7fe6e4067630 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e2ffd700 1 -- 172.21.15.31:0/3523524382 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217636146 0 0) 0x7fe6e40b1920 con 0x7fe6e4067a00 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e2ffd700 1 -- 172.21.15.31:0/3523524382 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e40ca820 con 0x7fe6e4067a00 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e8bea700 1 -- 172.21.15.31:0/3523524382 >> v1:172.21.15.92:6789/0 conn(0x7fe6e4067a00 legacy=0x7fe6e415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e8bea700 1 -- 172.21.15.31:0/3523524382 >> v1:172.21.15.31:6789/0 conn(0x7fe6e4067630 legacy=0x7fe6e40aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e8bea700 1 -- 172.21.15.31:0/3523524382 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40b1b70 con 0x7fe6e415aa00 2024-08-17T02:25:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e8bea700 1 --2- 172.21.15.31:0/3523524382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e415aa00 0x7fe6e40ca2e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009e60 tx=0x7fe6dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cc27b595556d386 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e2ffd700 1 -- 172.21.15.31:0/3523524382 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00e070 con 0x7fe6e415aa00 2024-08-17T02:25:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e2ffd700 1 -- 172.21.15.31:0/3523524382 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc00bab0 con 0x7fe6e415aa00 2024-08-17T02:25:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e2ffd700 1 -- 172.21.15.31:0/3523524382 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00be70 con 0x7fe6e415aa00 2024-08-17T02:25:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e93eb700 1 -- 172.21.15.31:0/3523524382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e415aa00 msgr2=0x7fe6e40ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.250+0000 7fe6e93eb700 1 --2- 172.21.15.31:0/3523524382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e415aa00 0x7fe6e40ca2e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009e60 tx=0x7fe6dc009780 comp rx=0 tx=0).stop 2024-08-17T02:25:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 -- 172.21.15.31:0/3523524382 shutdown_connections 2024-08-17T02:25:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 --2- 172.21.15.31:0/3523524382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e415aa00 0x7fe6e40ca2e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 -- 172.21.15.31:0/3523524382 >> 172.21.15.31:0/3523524382 conn(0x7fe6e40cd060 msgr2=0x7fe6e40ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 -- 172.21.15.31:0/3523524382 shutdown_connections 2024-08-17T02:25:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 -- 172.21.15.31:0/3523524382 wait complete. 2024-08-17T02:25:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 Processor -- start 2024-08-17T02:25:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 -- start start 2024-08-17T02:25:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e4067630 0x7fe6e40aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6e4067a00 0x7fe6e4153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6e415aa00 0x7fe6e4148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40b10f0 con 0x7fe6e415aa00 2024-08-17T02:25:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40b04e0 con 0x7fe6e4067630 2024-08-17T02:25:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e93eb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40b07c0 con 0x7fe6e4067a00 2024-08-17T02:25:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e8bea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6e415aa00 0x7fe6e4148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e8bea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6e415aa00 0x7fe6e4148460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36724/0 (socket says 172.21.15.31:36724) 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e4067630 0x7fe6e40aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e8bea700 1 -- 172.21.15.31:0/1886183774 learned_addr learned my addr 172.21.15.31:0/1886183774 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e37fe700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6e4067a00 0x7fe6e4153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e8bea700 1 -- 172.21.15.31:0/1886183774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6e4067a00 msgr2=0x7fe6e4153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e8bea700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6e4067a00 0x7fe6e4153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e8bea700 1 -- 172.21.15.31:0/1886183774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e4067630 msgr2=0x7fe6e40aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e8bea700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e4067630 0x7fe6e40aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e8bea700 1 -- 172.21.15.31:0/1886183774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc009a20 con 0x7fe6e415aa00 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e37fe700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6e4067a00 0x7fe6e4153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.254+0000 7fe6e8bea700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6e415aa00 0x7fe6e4148460 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4066b20 tx=0x7fe6dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6cbfff700 1 -- 172.21.15.31:0/1886183774 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc012e60 con 0x7fe6e415aa00 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6cbfff700 1 -- 172.21.15.31:0/1886183774 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc026480 con 0x7fe6e415aa00 2024-08-17T02:25:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6e93eb700 1 -- 172.21.15.31:0/1886183774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e40b0aa0 con 0x7fe6e415aa00 2024-08-17T02:25:38.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6cbfff700 1 -- 172.21.15.31:0/1886183774 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc026820 con 0x7fe6e415aa00 2024-08-17T02:25:38.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6e93eb700 1 -- 172.21.15.31:0/1886183774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e4153680 con 0x7fe6e415aa00 2024-08-17T02:25:38.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6e93eb700 1 -- 172.21.15.31:0/1886183774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e40b12a0 con 0x7fe6e415aa00 2024-08-17T02:25:38.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6cbfff700 1 -- 172.21.15.31:0/1886183774 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe6dc01c400 con 0x7fe6e415aa00 2024-08-17T02:25:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6cbfff700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe6d0060860 0x7fe6d0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6e3fff700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe6d0060860 0x7fe6d0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6cbfff700 1 -- 172.21.15.31:0/1886183774 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe6dc07e7a0 con 0x7fe6e415aa00 2024-08-17T02:25:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.258+0000 7fe6e3fff700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe6d0060860 0x7fe6d0062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4007fd0 tx=0x7fe6d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.266+0000 7fe6cbfff700 1 -- 172.21.15.31:0/1886183774 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe6dc04ef40 con 0x7fe6e415aa00 2024-08-17T02:25:38.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.482+0000 7fe6e93eb700 1 -- 172.21.15.31:0/1886183774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe6e40712b0 con 0x7fe6e415aa00 2024-08-17T02:25:38.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.490+0000 7fe6cbfff700 1 -- 172.21.15.31:0/1886183774 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe6dc052560 con 0x7fe6e415aa00 2024-08-17T02:25:38.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 -- 172.21.15.31:0/1886183774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe6d0060860 msgr2=0x7fe6d0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe6d0060860 0x7fe6d0062d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4007fd0 tx=0x7fe6d4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:38.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 -- 172.21.15.31:0/1886183774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6e415aa00 msgr2=0x7fe6e4148460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6e415aa00 0x7fe6e4148460 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4066b20 tx=0x7fe6dc019000 comp rx=0 tx=0).stop 2024-08-17T02:25:38.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 -- 172.21.15.31:0/1886183774 shutdown_connections 2024-08-17T02:25:38.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe6d0060860 0x7fe6d0062d10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6e415aa00 0x7fe6e4148460 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6e4067a00 0x7fe6e4153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 --2- 172.21.15.31:0/1886183774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6e4067630 0x7fe6e40aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 -- 172.21.15.31:0/1886183774 >> 172.21.15.31:0/1886183774 conn(0x7fe6e40cd060 msgr2=0x7fe6e4069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 -- 172.21.15.31:0/1886183774 shutdown_connections 2024-08-17T02:25:38.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.494+0000 7fe6e93eb700 1 -- 172.21.15.31:0/1886183774 wait complete. 2024-08-17T02:25:38.511 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:25:38.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.614+0000 7fb176e32700 1 Processor -- start 2024-08-17T02:25:38.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.614+0000 7fb176e32700 1 -- start start 2024-08-17T02:25:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.614+0000 7fb176e32700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb17015d460 0x7fb1700c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.614+0000 7fb176e32700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1700c9ff0 con 0x7fb17006abb0 2024-08-17T02:25:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.614+0000 7fb176e32700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1700c93e0 con 0x7fb1700c8f60 2024-08-17T02:25:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.614+0000 7fb176e32700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1700c96c0 con 0x7fb17015d460 2024-08-17T02:25:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.614+0000 7fb174bce700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb17015d460 0x7fb1700c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb16ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb17006abb0 0x7fb170161200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60968/0 (socket says 172.21.15.31:60968) 2024-08-17T02:25:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb16ffff700 1 -- 172.21.15.31:0/3420128988 learned_addr learned my addr 172.21.15.31:0/3420128988 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb174bce700 1 --2- 172.21.15.31:0/3420128988 >> v2:172.21.15.31:3300/0 conn(0x7fb17015d460 0x7fb1700c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36736/0 (socket says 172.21.15.31:36736) 2024-08-17T02:25:38.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb174bce700 1 -- 172.21.15.31:0/3420128988 >> v1:172.21.15.92:6789/0 conn(0x7fb1700c8f60 legacy=0x7fb1700ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb174bce700 1 -- 172.21.15.31:0/3420128988 >> v1:172.21.15.31:6789/0 conn(0x7fb17006abb0 legacy=0x7fb170161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb16f7fe700 1 -- 172.21.15.31:0/3420128988 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136801368 0 0) 0x7fb1700c9ff0 con 0x7fb17006abb0 2024-08-17T02:25:38.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb174bce700 1 -- 172.21.15.31:0/3420128988 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700c99a0 con 0x7fb17015d460 2024-08-17T02:25:38.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb174bce700 1 --2- 172.21.15.31:0/3420128988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17015d460 0x7fb1700c8a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1600098e0 tx=0x7fb1600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a86acbdb5549cca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb16f7fe700 1 -- 172.21.15.31:0/3420128988 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160009e80 con 0x7fb17015d460 2024-08-17T02:25:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb16f7fe700 1 -- 172.21.15.31:0/3420128988 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16000b860 con 0x7fb17015d460 2024-08-17T02:25:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb16f7fe700 1 -- 172.21.15.31:0/3420128988 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16000bbe0 con 0x7fb17015d460 2024-08-17T02:25:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb176e32700 1 -- 172.21.15.31:0/3420128988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17015d460 msgr2=0x7fb1700c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb176e32700 1 --2- 172.21.15.31:0/3420128988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17015d460 0x7fb1700c8a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1600098e0 tx=0x7fb1600091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb176e32700 1 -- 172.21.15.31:0/3420128988 shutdown_connections 2024-08-17T02:25:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb176e32700 1 --2- 172.21.15.31:0/3420128988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17015d460 0x7fb1700c8a20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb176e32700 1 -- 172.21.15.31:0/3420128988 >> 172.21.15.31:0/3420128988 conn(0x7fb170067e80 msgr2=0x7fb170069120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb176e32700 1 -- 172.21.15.31:0/3420128988 shutdown_connections 2024-08-17T02:25:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.618+0000 7fb176e32700 1 -- 172.21.15.31:0/3420128988 wait complete. 2024-08-17T02:25:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb176e32700 1 Processor -- start 2024-08-17T02:25:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb176e32700 1 -- start start 2024-08-17T02:25:38.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb176e32700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17006abb0 0x7fb170155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb176e32700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb17015d460 0x7fb170154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb176e32700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb170155530 0x7fb1700a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb176e32700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17015c1a0 con 0x7fb17006abb0 2024-08-17T02:25:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb176e32700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17015c480 con 0x7fb17015d460 2024-08-17T02:25:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb176e32700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17015c760 con 0x7fb170155530 2024-08-17T02:25:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb174bce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17006abb0 0x7fb170155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb174bce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17006abb0 0x7fb170155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36744/0 (socket says 172.21.15.31:36744) 2024-08-17T02:25:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb16ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb17015d460 0x7fb170154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb174bce700 1 -- 172.21.15.31:0/3992277477 learned_addr learned my addr 172.21.15.31:0/3992277477 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb1753cf700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb170155530 0x7fb1700a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb174bce700 1 -- 172.21.15.31:0/3992277477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb170155530 msgr2=0x7fb1700a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb174bce700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb170155530 0x7fb1700a6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb174bce700 1 -- 172.21.15.31:0/3992277477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb17015d460 msgr2=0x7fb170154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb174bce700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb17015d460 0x7fb170154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb174bce700 1 -- 172.21.15.31:0/3992277477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160009420 con 0x7fb17006abb0 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb174bce700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17006abb0 0x7fb170155ff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb170063b40 tx=0x7fb160017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb16cff9700 1 -- 172.21.15.31:0/3992277477 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16001f070 con 0x7fb17006abb0 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb16cff9700 1 -- 172.21.15.31:0/3992277477 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160000c90 con 0x7fb17006abb0 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb176e32700 1 -- 172.21.15.31:0/3992277477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17015ca40 con 0x7fb17006abb0 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb16cff9700 1 -- 172.21.15.31:0/3992277477 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160025420 con 0x7fb17006abb0 2024-08-17T02:25:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.622+0000 7fb176e32700 1 -- 172.21.15.31:0/3992277477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17015be70 con 0x7fb17006abb0 2024-08-17T02:25:38.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.626+0000 7fb176e32700 1 -- 172.21.15.31:0/3992277477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17015cc80 con 0x7fb17006abb0 2024-08-17T02:25:38.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.626+0000 7fb16cff9700 1 -- 172.21.15.31:0/3992277477 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb160023070 con 0x7fb17006abb0 2024-08-17T02:25:38.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.626+0000 7fb16cff9700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb150060860 0x7fb150062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.626+0000 7fb16ffff700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb150060860 0x7fb150062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.626+0000 7fb16cff9700 1 -- 172.21.15.31:0/3992277477 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb16007dc30 con 0x7fb17006abb0 2024-08-17T02:25:38.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.626+0000 7fb16ffff700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb150060860 0x7fb150062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb1700c8f30 tx=0x7fb158007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.634+0000 7fb16cff9700 1 -- 172.21.15.31:0/3992277477 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb16004e3d0 con 0x7fb17006abb0 2024-08-17T02:25:38.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.858+0000 7fb176e32700 1 -- 172.21.15.31:0/3992277477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fb17015c2e0 con 0x7fb17006abb0 2024-08-17T02:25:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.866+0000 7fb16cff9700 1 -- 172.21.15.31:0/3992277477 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb17015c2e0 con 0x7fb17006abb0 2024-08-17T02:25:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 -- 172.21.15.31:0/3992277477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb150060860 msgr2=0x7fb150062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb150060860 0x7fb150062d10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb1700c8f30 tx=0x7fb158007d10 comp rx=0 tx=0).stop 2024-08-17T02:25:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 -- 172.21.15.31:0/3992277477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17006abb0 msgr2=0x7fb170155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17006abb0 0x7fb170155ff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb170063b40 tx=0x7fb160017000 comp rx=0 tx=0).stop 2024-08-17T02:25:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 -- 172.21.15.31:0/3992277477 shutdown_connections 2024-08-17T02:25:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb150060860 0x7fb150062d10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb170155530 0x7fb1700a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb17015d460 0x7fb170154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 --2- 172.21.15.31:0/3992277477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb17006abb0 0x7fb170155ff0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 -- 172.21.15.31:0/3992277477 >> 172.21.15.31:0/3992277477 conn(0x7fb170067e80 msgr2=0x7fb170156c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 -- 172.21.15.31:0/3992277477 shutdown_connections 2024-08-17T02:25:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.870+0000 7fb176e32700 1 -- 172.21.15.31:0/3992277477 wait complete. 2024-08-17T02:25:38.885 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:38.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef968f700 1 Processor -- start 2024-08-17T02:25:38.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef968f700 1 -- start start 2024-08-17T02:25:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef968f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ef4155f50 0x7f8ef40b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef968f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8ef406ead0 0x7f8ef40cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef968f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef40b31b0 con 0x7f8ef4156320 2024-08-17T02:25:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef968f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40693a0 con 0x7f8ef4155f50 2024-08-17T02:25:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef968f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40b0550 con 0x7f8ef406ead0 2024-08-17T02:25:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ef4155f50 0x7f8ef40b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8ef4155f50 0x7f8ef40b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36754/0 (socket says 172.21.15.31:36754) 2024-08-17T02:25:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef2ffd700 1 -- 172.21.15.31:0/3681943095 learned_addr learned my addr 172.21.15.31:0/3681943095 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef27fc700 1 --1- 172.21.15.31:0/3681943095 >> v1:172.21.15.31:6789/0 conn(0x7f8ef4156320 0x7f8ef406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60978/0 (socket says 172.21.15.31:60978) 2024-08-17T02:25:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.994+0000 7f8ef37fe700 1 --2- 172.21.15.31:0/3681943095 >> v2:172.21.15.92:3300/0 conn(0x7f8ef406ead0 0x7f8ef40cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef2ffd700 1 -- 172.21.15.31:0/3681943095 >> v2:172.21.15.92:3300/0 conn(0x7f8ef406ead0 msgr2=0x7f8ef40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef2ffd700 1 --2- 172.21.15.31:0/3681943095 >> v2:172.21.15.92:3300/0 conn(0x7f8ef406ead0 0x7f8ef40cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef2ffd700 1 -- 172.21.15.31:0/3681943095 >> v1:172.21.15.31:6789/0 conn(0x7f8ef4156320 legacy=0x7f8ef406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef2ffd700 1 -- 172.21.15.31:0/3681943095 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef40b2bf0 con 0x7f8ef4155f50 2024-08-17T02:25:38.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef1ffb700 1 -- 172.21.15.31:0/3681943095 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438647800 0 0) 0x7f8ef40b31b0 con 0x7f8ef4156320 2024-08-17T02:25:38.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef2ffd700 1 --2- 172.21.15.31:0/3681943095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef4155f50 0x7f8ef40b2610 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40099b0 tx=0x7f8ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c128355068eaafbe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef1ffb700 1 -- 172.21.15.31:0/3681943095 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4009ea0 con 0x7f8ef4155f50 2024-08-17T02:25:38.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef1ffb700 1 -- 172.21.15.31:0/3681943095 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee400b820 con 0x7f8ef4155f50 2024-08-17T02:25:38.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef1ffb700 1 -- 172.21.15.31:0/3681943095 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400bbe0 con 0x7f8ef4155f50 2024-08-17T02:25:39.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef968f700 1 -- 172.21.15.31:0/3681943095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef4155f50 msgr2=0x7f8ef40b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef968f700 1 --2- 172.21.15.31:0/3681943095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef4155f50 0x7f8ef40b2610 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40099b0 tx=0x7f8ee4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:39.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef968f700 1 -- 172.21.15.31:0/3681943095 shutdown_connections 2024-08-17T02:25:39.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef968f700 1 --2- 172.21.15.31:0/3681943095 >> v2:172.21.15.92:3300/0 conn(0x7f8ef406ead0 0x7f8ef40cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef968f700 1 --2- 172.21.15.31:0/3681943095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef4155f50 0x7f8ef40b2610 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef968f700 1 -- 172.21.15.31:0/3681943095 >> 172.21.15.31:0/3681943095 conn(0x7f8ef406bba0 msgr2=0x7f8ef4068510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef968f700 1 -- 172.21.15.31:0/3681943095 shutdown_connections 2024-08-17T02:25:39.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:38.998+0000 7f8ef968f700 1 -- 172.21.15.31:0/3681943095 wait complete. 2024-08-17T02:25:39.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef968f700 1 Processor -- start 2024-08-17T02:25:39.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef968f700 1 -- start start 2024-08-17T02:25:39.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef968f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef406ead0 0x7f8ef40c3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef968f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ef4155f50 0x7f8ef414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef968f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ef4156320 0x7f8ef416c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef968f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40c3580 con 0x7f8ef406ead0 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef968f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4156810 con 0x7f8ef4156320 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef968f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef414df20 con 0x7f8ef4155f50 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef406ead0 0x7f8ef40c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef406ead0 0x7f8ef40c3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36760/0 (socket says 172.21.15.31:36760) 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef2ffd700 1 -- 172.21.15.31:0/2234357032 learned_addr learned my addr 172.21.15.31:0/2234357032 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef37fe700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ef4156320 0x7f8ef416c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef27fc700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ef4155f50 0x7f8ef414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef37fe700 1 -- 172.21.15.31:0/2234357032 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ef4155f50 msgr2=0x7f8ef414d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef37fe700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ef4155f50 0x7f8ef414d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef37fe700 1 -- 172.21.15.31:0/2234357032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef406ead0 msgr2=0x7f8ef40c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef37fe700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef406ead0 0x7f8ef40c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef37fe700 1 -- 172.21.15.31:0/2234357032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40094f0 con 0x7f8ef4156320 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef2ffd700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef406ead0 0x7f8ef40c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef37fe700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ef4156320 0x7f8ef416c150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00ec90 tx=0x7f8eec00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8eeaffd700 1 -- 172.21.15.31:0/2234357032 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00c890 con 0x7f8ef4156320 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8eeaffd700 1 -- 172.21.15.31:0/2234357032 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec00f040 con 0x7f8ef4156320 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef968f700 1 -- 172.21.15.31:0/2234357032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef414e1a0 con 0x7f8ef4156320 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8eeaffd700 1 -- 172.21.15.31:0/2234357032 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00cc60 con 0x7f8ef4156320 2024-08-17T02:25:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.002+0000 7f8ef968f700 1 -- 172.21.15.31:0/2234357032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef414e760 con 0x7f8ef4156320 2024-08-17T02:25:39.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.006+0000 7f8ef968f700 1 -- 172.21.15.31:0/2234357032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef40712b0 con 0x7f8ef4156320 2024-08-17T02:25:39.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.006+0000 7f8eeaffd700 1 -- 172.21.15.31:0/2234357032 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8eec014690 con 0x7f8ef4156320 2024-08-17T02:25:39.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.006+0000 7f8eeaffd700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8ed4060860 0x7f8ed4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.006+0000 7f8eeaffd700 1 -- 172.21.15.31:0/2234357032 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8eec07d300 con 0x7f8ef4156320 2024-08-17T02:25:39.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.006+0000 7f8ef2ffd700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8ed4060860 0x7f8ed4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.006+0000 7f8ef2ffd700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8ed4060860 0x7f8ed4062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009340 tx=0x7f8ee4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.018+0000 7f8eeaffd700 1 -- 172.21.15.31:0/2234357032 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8eec051530 con 0x7f8ef4156320 2024-08-17T02:25:39.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.190+0000 7f8ef968f700 1 -- 172.21.15.31:0/2234357032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ef4156950 con 0x7f8ef4156320 2024-08-17T02:25:39.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.190+0000 7f8eeaffd700 1 -- 172.21.15.31:0/2234357032 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f8eec0510c0 con 0x7f8ef4156320 2024-08-17T02:25:39.194 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:39.194 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":32,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:25:36.201631+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.194+0000 7f8ef968f700 1 -- 172.21.15.31:0/2234357032 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8ed4060860 msgr2=0x7f8ed4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.194+0000 7f8ef968f700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8ed4060860 0x7f8ed4062d10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009340 tx=0x7f8ee4017000 comp rx=0 tx=0).stop 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.194+0000 7f8ef968f700 1 -- 172.21.15.31:0/2234357032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ef4156320 msgr2=0x7f8ef416c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.194+0000 7f8ef968f700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ef4156320 0x7f8ef416c150 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00ec90 tx=0x7f8eec00b040 comp rx=0 tx=0).stop 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.194+0000 7f8ef968f700 1 -- 172.21.15.31:0/2234357032 shutdown_connections 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.194+0000 7f8ef968f700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8ed4060860 0x7f8ed4062d10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.194+0000 7f8ef968f700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ef4156320 0x7f8ef416c150 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.194+0000 7f8ef968f700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ef4155f50 0x7f8ef414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.194+0000 7f8ef968f700 1 --2- 172.21.15.31:0/2234357032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ef406ead0 0x7f8ef40c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.198+0000 7f8ef968f700 1 -- 172.21.15.31:0/2234357032 >> 172.21.15.31:0/2234357032 conn(0x7f8ef406bba0 msgr2=0x7f8ef40cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.198+0000 7f8ef968f700 1 -- 172.21.15.31:0/2234357032 shutdown_connections 2024-08-17T02:25:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.198+0000 7f8ef968f700 1 -- 172.21.15.31:0/2234357032 wait complete. 2024-08-17T02:25:39.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:25:39.212 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:39.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.326+0000 7fadfa55a700 1 Processor -- start 2024-08-17T02:25:39.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.326+0000 7fadfa55a700 1 -- start start 2024-08-17T02:25:39.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadf4068aa0 0x7fadf4068e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fadf4159fd0 0x7fadf40af290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf415cc00 con 0x7fadf40cb010 2024-08-17T02:25:39.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf4150510 con 0x7fadf4159fd0 2024-08-17T02:25:39.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40cb400 con 0x7fadf4068aa0 2024-08-17T02:25:39.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadf9d59700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fadf4159fd0 0x7fadf40af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadf9d59700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fadf4159fd0 0x7fadf40af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36764/0 (socket says 172.21.15.31:36764) 2024-08-17T02:25:39.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadf9d59700 1 -- 172.21.15.31:0/777522371 learned_addr learned my addr 172.21.15.31:0/777522371 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:39.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadf8d57700 1 --1- 172.21.15.31:0/777522371 >> v1:172.21.15.31:6789/0 conn(0x7fadf40cb010 0x7fadf40aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60982/0 (socket says 172.21.15.31:60982) 2024-08-17T02:25:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadf9558700 1 --2- 172.21.15.31:0/777522371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadf4068aa0 0x7fadf4068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadf9d59700 1 -- 172.21.15.31:0/777522371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadf4068aa0 msgr2=0x7fadf4068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadf9d59700 1 --2- 172.21.15.31:0/777522371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadf4068aa0 0x7fadf4068e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadf9d59700 1 -- 172.21.15.31:0/777522371 >> v1:172.21.15.31:6789/0 conn(0x7fadf40cb010 legacy=0x7fadf40aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadf9d59700 1 -- 172.21.15.31:0/777522371 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf415ce50 con 0x7fadf4159fd0 2024-08-17T02:25:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadebfff700 1 -- 172.21.15.31:0/777522371 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224995657 0 0) 0x7fadf415cc00 con 0x7fadf40cb010 2024-08-17T02:25:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadf9d59700 1 --2- 172.21.15.31:0/777522371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf4159fd0 0x7fadf40af290 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fadec009f20 tx=0x7fadec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548cacebed281d8b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadebfff700 1 -- 172.21.15.31:0/777522371 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec00e070 con 0x7fadf4159fd0 2024-08-17T02:25:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadebfff700 1 -- 172.21.15.31:0/777522371 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec00ba80 con 0x7fadf4159fd0 2024-08-17T02:25:39.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadebfff700 1 -- 172.21.15.31:0/777522371 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec0092e0 con 0x7fadf4159fd0 2024-08-17T02:25:39.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 -- 172.21.15.31:0/777522371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf4159fd0 msgr2=0x7fadf40af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 --2- 172.21.15.31:0/777522371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf4159fd0 0x7fadf40af290 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fadec009f20 tx=0x7fadec009840 comp rx=0 tx=0).stop 2024-08-17T02:25:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 -- 172.21.15.31:0/777522371 shutdown_connections 2024-08-17T02:25:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 --2- 172.21.15.31:0/777522371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf4159fd0 0x7fadf40af290 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 --2- 172.21.15.31:0/777522371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadf4068aa0 0x7fadf4068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 -- 172.21.15.31:0/777522371 >> 172.21.15.31:0/777522371 conn(0x7fadf40d0090 msgr2=0x7fadf40d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 -- 172.21.15.31:0/777522371 shutdown_connections 2024-08-17T02:25:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.330+0000 7fadfa55a700 1 -- 172.21.15.31:0/777522371 wait complete. 2024-08-17T02:25:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadfa55a700 1 Processor -- start 2024-08-17T02:25:39.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadfa55a700 1 -- start start 2024-08-17T02:25:39.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadfa55a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadf4068aa0 0x7fadf40b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadfa55a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf40cb010 0x7fadf40b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadfa55a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadf4159fd0 0x7fadf40b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadfa55a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40b44e0 con 0x7fadf40cb010 2024-08-17T02:25:39.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadfa55a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40b47c0 con 0x7fadf4159fd0 2024-08-17T02:25:39.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadfa55a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40b4aa0 con 0x7fadf4068aa0 2024-08-17T02:25:39.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf8d57700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf40cb010 0x7fadf40b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf8d57700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf40cb010 0x7fadf40b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36768/0 (socket says 172.21.15.31:36768) 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf8d57700 1 -- 172.21.15.31:0/2308172653 learned_addr learned my addr 172.21.15.31:0/2308172653 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf9d59700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadf4159fd0 0x7fadf40b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf9558700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadf4068aa0 0x7fadf40b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf8d57700 1 -- 172.21.15.31:0/2308172653 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadf4068aa0 msgr2=0x7fadf40b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf8d57700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadf4068aa0 0x7fadf40b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf8d57700 1 -- 172.21.15.31:0/2308172653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadf4159fd0 msgr2=0x7fadf40b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf8d57700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadf4159fd0 0x7fadf40b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf8d57700 1 -- 172.21.15.31:0/2308172653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec009ae0 con 0x7fadf40cb010 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadf8d57700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf40cb010 0x7fadf40b39b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fade40011e0 tx=0x7fade4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fade97fa700 1 -- 172.21.15.31:0/2308172653 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade4005a70 con 0x7fadf40cb010 2024-08-17T02:25:39.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fade97fa700 1 -- 172.21.15.31:0/2308172653 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade4005bd0 con 0x7fadf40cb010 2024-08-17T02:25:39.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fade97fa700 1 -- 172.21.15.31:0/2308172653 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40070d0 con 0x7fadf40cb010 2024-08-17T02:25:39.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadfa55a700 1 -- 172.21.15.31:0/2308172653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf40b4d80 con 0x7fadf40cb010 2024-08-17T02:25:39.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.334+0000 7fadfa55a700 1 -- 172.21.15.31:0/2308172653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf4152b90 con 0x7fadf40cb010 2024-08-17T02:25:39.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.338+0000 7fade97fa700 1 -- 172.21.15.31:0/2308172653 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fade4007480 con 0x7fadf40cb010 2024-08-17T02:25:39.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.338+0000 7fadfa55a700 1 -- 172.21.15.31:0/2308172653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf40b5250 con 0x7fadf40cb010 2024-08-17T02:25:39.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.338+0000 7fade97fa700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fadd8060860 0x7fadd8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.338+0000 7fade97fa700 1 -- 172.21.15.31:0/2308172653 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fade407bca0 con 0x7fadf40cb010 2024-08-17T02:25:39.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.338+0000 7fadf9558700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fadd8060860 0x7fadd8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.338+0000 7fadf9558700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fadd8060860 0x7fadd8062d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fadf0006fd0 tx=0x7fadf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.346+0000 7fade97fa700 1 -- 172.21.15.31:0/2308172653 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fade404a480 con 0x7fadf40cb010 2024-08-17T02:25:39.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.510+0000 7fadfa55a700 1 -- 172.21.15.31:0/2308172653 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadf40712b0 con 0x7fadf40cb010 2024-08-17T02:25:39.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.510+0000 7fade97fa700 1 -- 172.21.15.31:0/2308172653 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fade4017020 con 0x7fadf40cb010 2024-08-17T02:25:39.512 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:25:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 -- 172.21.15.31:0/2308172653 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fadd8060860 msgr2=0x7fadd8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fadd8060860 0x7fadd8062d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fadf0006fd0 tx=0x7fadf0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 -- 172.21.15.31:0/2308172653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf40cb010 msgr2=0x7fadf40b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf40cb010 0x7fadf40b39b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fade40011e0 tx=0x7fade4007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 -- 172.21.15.31:0/2308172653 shutdown_connections 2024-08-17T02:25:39.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fadd8060860 0x7fadd8062d10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fadf4159fd0 0x7fadf40b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadf40cb010 0x7fadf40b39b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 --2- 172.21.15.31:0/2308172653 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fadf4068aa0 0x7fadf40b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 -- 172.21.15.31:0/2308172653 >> 172.21.15.31:0/2308172653 conn(0x7fadf40d0090 msgr2=0x7fadf415bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 -- 172.21.15.31:0/2308172653 shutdown_connections 2024-08-17T02:25:39.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.514+0000 7fadfa55a700 1 -- 172.21.15.31:0/2308172653 wait complete. 2024-08-17T02:25:39.527 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:25:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.630+0000 7f0e099bc700 1 Processor -- start 2024-08-17T02:25:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.630+0000 7f0e099bc700 1 -- start start 2024-08-17T02:25:39.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.630+0000 7f0e099bc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e0415d630 0x7f0e04069630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.630+0000 7f0e099bc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0e0415da00 0x7f0e040b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.630+0000 7f0e099bc700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e040691a0 con 0x7f0e040b3b90 2024-08-17T02:25:39.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.630+0000 7f0e099bc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e040b18e0 con 0x7f0e0415d630 2024-08-17T02:25:39.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.630+0000 7f0e099bc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e04069b70 con 0x7f0e0415da00 2024-08-17T02:25:39.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e089ba700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e0415d630 0x7f0e04069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e089ba700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e0415d630 0x7f0e04069630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36780/0 (socket says 172.21.15.31:36780) 2024-08-17T02:25:39.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e089ba700 1 -- 172.21.15.31:0/1925916960 learned_addr learned my addr 172.21.15.31:0/1925916960 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:39.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e03fff700 1 --2- 172.21.15.31:0/1925916960 >> v2:172.21.15.92:3300/0 conn(0x7f0e0415da00 0x7f0e040b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e089ba700 1 -- 172.21.15.31:0/1925916960 >> v2:172.21.15.92:3300/0 conn(0x7f0e0415da00 msgr2=0x7f0e040b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:39.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e089ba700 1 --2- 172.21.15.31:0/1925916960 >> v2:172.21.15.92:3300/0 conn(0x7f0e0415da00 0x7f0e040b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e089ba700 1 -- 172.21.15.31:0/1925916960 >> v1:172.21.15.92:6789/0 conn(0x7f0e040b3b90 legacy=0x7f0e0406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e089ba700 1 -- 172.21.15.31:0/1925916960 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e040b1600 con 0x7f0e0415d630 2024-08-17T02:25:39.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e089ba700 1 --2- 172.21.15.31:0/1925916960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415d630 0x7f0e04069630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0e04066b90 tx=0x7f0df4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1d40bcee961d28 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e037fe700 1 -- 172.21.15.31:0/1925916960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4009e70 con 0x7f0e0415d630 2024-08-17T02:25:39.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e037fe700 1 -- 172.21.15.31:0/1925916960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df400b860 con 0x7f0e0415d630 2024-08-17T02:25:39.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e037fe700 1 -- 172.21.15.31:0/1925916960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df400bc20 con 0x7f0e0415d630 2024-08-17T02:25:39.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e099bc700 1 -- 172.21.15.31:0/1925916960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415d630 msgr2=0x7f0e04069630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e099bc700 1 --2- 172.21.15.31:0/1925916960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415d630 0x7f0e04069630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0e04066b90 tx=0x7f0df4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:39.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e099bc700 1 -- 172.21.15.31:0/1925916960 shutdown_connections 2024-08-17T02:25:39.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e099bc700 1 --2- 172.21.15.31:0/1925916960 >> v2:172.21.15.92:3300/0 conn(0x7f0e0415da00 0x7f0e040b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e099bc700 1 --2- 172.21.15.31:0/1925916960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415d630 0x7f0e04069630 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e099bc700 1 -- 172.21.15.31:0/1925916960 >> 172.21.15.31:0/1925916960 conn(0x7f0e040cdf80 msgr2=0x7f0e040ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e099bc700 1 -- 172.21.15.31:0/1925916960 shutdown_connections 2024-08-17T02:25:39.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.634+0000 7f0e099bc700 1 -- 172.21.15.31:0/1925916960 wait complete. 2024-08-17T02:25:39.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e099bc700 1 Processor -- start 2024-08-17T02:25:39.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e099bc700 1 -- start start 2024-08-17T02:25:39.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e099bc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0e040b3b90 0x7f0e04157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e099bc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e0415d630 0x7f0e041581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e099bc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415da00 0x7f0e040cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e099bc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e040cb360 con 0x7f0e0415da00 2024-08-17T02:25:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e099bc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04161aa0 con 0x7f0e0415d630 2024-08-17T02:25:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e099bc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0415e8e0 con 0x7f0e040b3b90 2024-08-17T02:25:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e091bb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415da00 0x7f0e040cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e091bb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415da00 0x7f0e040cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36790/0 (socket says 172.21.15.31:36790) 2024-08-17T02:25:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e091bb700 1 -- 172.21.15.31:0/3372554947 learned_addr learned my addr 172.21.15.31:0/3372554947 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e03fff700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e0415d630 0x7f0e041581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e089ba700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0e040b3b90 0x7f0e04157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e091bb700 1 -- 172.21.15.31:0/3372554947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0e040b3b90 msgr2=0x7f0e04157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e091bb700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0e040b3b90 0x7f0e04157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e091bb700 1 -- 172.21.15.31:0/3372554947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e0415d630 msgr2=0x7f0e041581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e091bb700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e0415d630 0x7f0e041581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e091bb700 1 -- 172.21.15.31:0/3372554947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40094f0 con 0x7f0e0415da00 2024-08-17T02:25:39.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e091bb700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415da00 0x7f0e040cb7b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c4c0 tx=0x7f0dfc007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e00ff9700 1 -- 172.21.15.31:0/3372554947 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc00ce70 con 0x7f0e0415da00 2024-08-17T02:25:39.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e00ff9700 1 -- 172.21.15.31:0/3372554947 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dfc011590 con 0x7f0e0415da00 2024-08-17T02:25:39.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e099bc700 1 -- 172.21.15.31:0/3372554947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0415ebc0 con 0x7f0e0415da00 2024-08-17T02:25:39.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e00ff9700 1 -- 172.21.15.31:0/3372554947 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc011970 con 0x7f0e0415da00 2024-08-17T02:25:39.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.638+0000 7f0e099bc700 1 -- 172.21.15.31:0/3372554947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e040cd510 con 0x7f0e0415da00 2024-08-17T02:25:39.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.642+0000 7f0e099bc700 1 -- 172.21.15.31:0/3372554947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e040cb4d0 con 0x7f0e0415da00 2024-08-17T02:25:39.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.642+0000 7f0e00ff9700 1 -- 172.21.15.31:0/3372554947 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0dfc011ce0 con 0x7f0e0415da00 2024-08-17T02:25:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.642+0000 7f0e00ff9700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0de4060860 0x7f0de4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.642+0000 7f0e00ff9700 1 -- 172.21.15.31:0/3372554947 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0dfc07bb90 con 0x7f0e0415da00 2024-08-17T02:25:39.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.642+0000 7f0e089ba700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0de4060860 0x7f0de4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.642+0000 7f0e089ba700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0de4060860 0x7f0de4062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e04066b90 tx=0x7f0df4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.650+0000 7f0e00ff9700 1 -- 172.21.15.31:0/3372554947 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0e040cb4d0 con 0x7f0e0415da00 2024-08-17T02:25:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.818+0000 7f0e099bc700 1 -- 172.21.15.31:0/3372554947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0e040cb4a0 con 0x7f0e0415da00 2024-08-17T02:25:39.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.818+0000 7f0e00ff9700 1 -- 172.21.15.31:0/3372554947 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0dfc017090 con 0x7f0e0415da00 2024-08-17T02:25:39.820 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:39.821 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-08-17T02:25:39.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:39.821 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-08-17T02:25:39.821 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-08-17T02:25:39.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:39.821 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 -- 172.21.15.31:0/3372554947 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0de4060860 msgr2=0x7f0de4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0de4060860 0x7f0de4062d10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e04066b90 tx=0x7f0df4017000 comp rx=0 tx=0).stop 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 -- 172.21.15.31:0/3372554947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415da00 msgr2=0x7f0e040cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415da00 0x7f0e040cb7b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c4c0 tx=0x7f0dfc007f50 comp rx=0 tx=0).stop 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 -- 172.21.15.31:0/3372554947 shutdown_connections 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0de4060860 0x7f0de4062d10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e0415da00 0x7f0e040cb7b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e0415d630 0x7f0e041581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 --2- 172.21.15.31:0/3372554947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0e040b3b90 0x7f0e04157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 -- 172.21.15.31:0/3372554947 >> 172.21.15.31:0/3372554947 conn(0x7f0e040cdf80 msgr2=0x7f0e040b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 -- 172.21.15.31:0/3372554947 shutdown_connections 2024-08-17T02:25:39.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.822+0000 7f0e099bc700 1 -- 172.21.15.31:0/3372554947 wait complete. 2024-08-17T02:25:39.834 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:25:39.834 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:25:39.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.950+0000 7fb7edf46700 1 Processor -- start 2024-08-17T02:25:39.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.950+0000 7fb7edf46700 1 -- start start 2024-08-17T02:25:39.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7edf46700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e8159130 0x7fb7e81595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7edf46700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e8159f60 con 0x7fb7e81553b0 2024-08-17T02:25:39.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7edf46700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e8155e90 con 0x7fb7e8159ae0 2024-08-17T02:25:39.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7edf46700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8156150 con 0x7fb7e8159130 2024-08-17T02:25:39.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7ecf44700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb7e81553b0 0x7fb7e8155780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:60984/0 (socket says 172.21.15.31:60984) 2024-08-17T02:25:39.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7ecf44700 1 -- 172.21.15.31:0/3403039324 learned_addr learned my addr 172.21.15.31:0/3403039324 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:39.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e7fff700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e8159130 0x7fb7e81595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206978289 0 0) 0x7fb7e8159f60 con 0x7fb7e81553b0 2024-08-17T02:25:39.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d4003570 con 0x7fb7e81553b0 2024-08-17T02:25:39.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284887322 0 0) 0x7fb7e8155e90 con 0x7fb7e8159ae0 2024-08-17T02:25:39.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e8159f60 con 0x7fb7e8159ae0 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3099952765 0 0) 0x7fb7d4003570 con 0x7fb7e81553b0 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e8159130 msgr2=0x7fb7e81595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e8159130 0x7fb7e81595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 >> v1:172.21.15.92:6789/0 conn(0x7fb7e8159ae0 legacy=0x7fb7e81571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e8156430 con 0x7fb7e81553b0 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7fb7d0001470 con 0x7fb7e81553b0 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 >> v1:172.21.15.31:6789/0 conn(0x7fb7e81553b0 legacy=0x7fb7e8155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7d4003c20 0x7fb7d4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d4004810 0x7fb7d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7d40051c0 0x7fb7d400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8156150 con 0x7fb7d4004810 2024-08-17T02:25:39.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d400c0b0 con 0x7fb7d40051c0 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d400c270 con 0x7fb7d4003c20 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e7fff700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7e8159130 0x7fb7e81595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e7fff700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d4004810 0x7fb7d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7ecf44700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7d4003c20 0x7fb7d4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7ed745700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7d40051c0 0x7fb7d400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e7fff700 1 -- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7d4003c20 msgr2=0x7fb7d4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e7fff700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7d4003c20 0x7fb7d4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e7fff700 1 -- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7d40051c0 msgr2=0x7fb7d400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e7fff700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7d40051c0 0x7fb7d400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e7fff700 1 -- 172.21.15.31:0/3403039324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4003570 con 0x7fb7d4004810 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7ed745700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7d40051c0 0x7fb7d400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e7fff700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d4004810 0x7fb7d4004c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb7e806eee0 tx=0x7fb7d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a99892ce1956399 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d800e710 con 0x7fb7d4004810 2024-08-17T02:25:39.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d800e870 con 0x7fb7d4004810 2024-08-17T02:25:39.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.954+0000 7fb7e77fe700 1 -- 172.21.15.31:0/3403039324 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d800ec10 con 0x7fb7d4004810 2024-08-17T02:25:39.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.958+0000 7fb7edf46700 1 -- 172.21.15.31:0/3403039324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d4004810 msgr2=0x7fb7d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.958+0000 7fb7edf46700 1 --2- 172.21.15.31:0/3403039324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7d4004810 0x7fb7d4004c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb7e806eee0 tx=0x7fb7d80091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.958+0000 7fb7ed745700 1 -- 172.21.15.31:0/3403039324 reap_dead start 2024-08-17T02:25:39.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.958+0000 7fb7edf46700 1 -- 172.21.15.31:0/3403039324 shutdown_connections 2024-08-17T02:25:39.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.958+0000 7fb7edf46700 1 -- 172.21.15.31:0/3403039324 >> 172.21.15.31:0/3403039324 conn(0x7fb7e806bbb0 msgr2=0x7fb7e80b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:39.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.958+0000 7fb7edf46700 1 -- 172.21.15.31:0/3403039324 shutdown_connections 2024-08-17T02:25:39.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.958+0000 7fb7edf46700 1 -- 172.21.15.31:0/3403039324 wait complete. 2024-08-17T02:25:39.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.958+0000 7fb7edf46700 1 Processor -- start 2024-08-17T02:25:39.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.958+0000 7fb7edf46700 1 -- start start 2024-08-17T02:25:39.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7edf46700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7d4004810 0x7fb7e813cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7edf46700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7e8144960 0x7fb7e8144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7edf46700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e81531d0 0x7fb7e8153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7edf46700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8146990 con 0x7fb7e8144960 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7edf46700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8150740 con 0x7fb7e81531d0 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7edf46700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8153b60 con 0x7fb7d4004810 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7e8144960 0x7fb7e8144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7e8144960 0x7fb7e8144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36804/0 (socket says 172.21.15.31:36804) 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e7fff700 1 -- 172.21.15.31:0/1259654001 learned_addr learned my addr 172.21.15.31:0/1259654001 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7ecf44700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7d4004810 0x7fb7e813cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7ed745700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e81531d0 0x7fb7e8153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e7fff700 1 -- 172.21.15.31:0/1259654001 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7d4004810 msgr2=0x7fb7e813cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e7fff700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7d4004810 0x7fb7e813cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e7fff700 1 -- 172.21.15.31:0/1259654001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e81531d0 msgr2=0x7fb7e8153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:39.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e7fff700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e81531d0 0x7fb7e8153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:39.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e7fff700 1 -- 172.21.15.31:0/1259654001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e814f890 con 0x7fb7e8144960 2024-08-17T02:25:39.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e7fff700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7e8144960 0x7fb7e8144dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400c080 tx=0x7fb7d8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e4ff9700 1 -- 172.21.15.31:0/1259654001 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8022070 con 0x7fb7e8144960 2024-08-17T02:25:39.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e4ff9700 1 -- 172.21.15.31:0/1259654001 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d800ebf0 con 0x7fb7e8144960 2024-08-17T02:25:39.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7edf46700 1 -- 172.21.15.31:0/1259654001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e8150bd0 con 0x7fb7e8144960 2024-08-17T02:25:39.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7e4ff9700 1 -- 172.21.15.31:0/1259654001 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80276c0 con 0x7fb7e8144960 2024-08-17T02:25:39.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.962+0000 7fb7edf46700 1 -- 172.21.15.31:0/1259654001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e814fe10 con 0x7fb7e8144960 2024-08-17T02:25:39.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.966+0000 7fb7edf46700 1 -- 172.21.15.31:0/1259654001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e80648e0 con 0x7fb7e8144960 2024-08-17T02:25:39.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.966+0000 7fb7e4ff9700 1 -- 172.21.15.31:0/1259654001 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb7d8031440 con 0x7fb7e8144960 2024-08-17T02:25:39.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.966+0000 7fb7e4ff9700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb7c8060860 0x7fb7c8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:39.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.966+0000 7fb7ecf44700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb7c8060860 0x7fb7c8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:39.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.966+0000 7fb7e4ff9700 1 -- 172.21.15.31:0/1259654001 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb7d807e3e0 con 0x7fb7e8144960 2024-08-17T02:25:39.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.966+0000 7fb7ecf44700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb7c8060860 0x7fb7c8062d10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0001120 tx=0x7fb7d0007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:39.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:39.974+0000 7fb7e4ff9700 1 -- 172.21.15.31:0/1259654001 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb7e80648e0 con 0x7fb7e8144960 2024-08-17T02:25:40.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.142+0000 7fb7edf46700 1 -- 172.21.15.31:0/1259654001 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb7e81508f0 con 0x7fb7e8144960 2024-08-17T02:25:40.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.382+0000 7fb7e4ff9700 1 -- 172.21.15.31:0/1259654001 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb7e81508f0 con 0x7fb7e8144960 2024-08-17T02:25:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 -- 172.21.15.31:0/1259654001 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb7c8060860 msgr2=0x7fb7c8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb7c8060860 0x7fb7c8062d10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0001120 tx=0x7fb7d0007040 comp rx=0 tx=0).stop 2024-08-17T02:25:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 -- 172.21.15.31:0/1259654001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7e8144960 msgr2=0x7fb7e8144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7e8144960 0x7fb7e8144dd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400c080 tx=0x7fb7d8019000 comp rx=0 tx=0).stop 2024-08-17T02:25:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 -- 172.21.15.31:0/1259654001 shutdown_connections 2024-08-17T02:25:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb7c8060860 0x7fb7c8062d10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7e81531d0 0x7fb7e8153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7e8144960 0x7fb7e8144dd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 --2- 172.21.15.31:0/1259654001 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7d4004810 0x7fb7e813cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 -- 172.21.15.31:0/1259654001 >> 172.21.15.31:0/1259654001 conn(0x7fb7e806bbb0 msgr2=0x7fb7e81570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 -- 172.21.15.31:0/1259654001 shutdown_connections 2024-08-17T02:25:40.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.390+0000 7fb7edf46700 1 -- 172.21.15.31:0/1259654001 wait complete. 2024-08-17T02:25:40.394 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-08-17T02:25:40.405 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:25:40.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.518+0000 7f5df93de700 1 Processor -- start 2024-08-17T02:25:40.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.518+0000 7f5df93de700 1 -- start start 2024-08-17T02:25:40.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df93de700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5df41592f0 0x7f5df40cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df93de700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df40cb6a0 0x7f5df40cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df93de700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5df41596c0 0x7f5df40cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df93de700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df40cd3c0 con 0x7f5df41592f0 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df93de700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df415a780 con 0x7f5df41596c0 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df93de700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df415ac10 con 0x7f5df40cb6a0 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5df41592f0 0x7f5df40cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5df41592f0 0x7f5df40cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36814/0 (socket says 172.21.15.31:36814) 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df3fff700 1 -- 172.21.15.31:0/4084071979 learned_addr learned my addr 172.21.15.31:0/4084071979 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df8bdd700 1 --2- 172.21.15.31:0/4084071979 >> v2:172.21.15.92:3300/0 conn(0x7f5df41596c0 0x7f5df40cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df37fe700 1 --2- 172.21.15.31:0/4084071979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df40cb6a0 0x7f5df40cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df3fff700 1 -- 172.21.15.31:0/4084071979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df40cb6a0 msgr2=0x7f5df40cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df3fff700 1 --2- 172.21.15.31:0/4084071979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df40cb6a0 0x7f5df40cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df3fff700 1 -- 172.21.15.31:0/4084071979 >> v2:172.21.15.92:3300/0 conn(0x7f5df41596c0 msgr2=0x7f5df40cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df3fff700 1 --2- 172.21.15.31:0/4084071979 >> v2:172.21.15.92:3300/0 conn(0x7f5df41596c0 0x7f5df40cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df3fff700 1 -- 172.21.15.31:0/4084071979 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4159b70 con 0x7f5df41592f0 2024-08-17T02:25:40.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df3fff700 1 --2- 172.21.15.31:0/4084071979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df41592f0 0x7f5df40cb160 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5df40cd940 tx=0x7f5ddc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f723717c951281 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df2ffd700 1 -- 172.21.15.31:0/4084071979 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00b640 con 0x7f5df41592f0 2024-08-17T02:25:40.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df2ffd700 1 -- 172.21.15.31:0/4084071979 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00b7a0 con 0x7f5df41592f0 2024-08-17T02:25:40.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.522+0000 7f5df2ffd700 1 -- 172.21.15.31:0/4084071979 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00bb60 con 0x7f5df41592f0 2024-08-17T02:25:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 -- 172.21.15.31:0/4084071979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df41592f0 msgr2=0x7f5df40cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 --2- 172.21.15.31:0/4084071979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df41592f0 0x7f5df40cb160 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5df40cd940 tx=0x7f5ddc009250 comp rx=0 tx=0).stop 2024-08-17T02:25:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 -- 172.21.15.31:0/4084071979 shutdown_connections 2024-08-17T02:25:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 --2- 172.21.15.31:0/4084071979 >> v2:172.21.15.92:3300/0 conn(0x7f5df41596c0 0x7f5df40cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 --2- 172.21.15.31:0/4084071979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df40cb6a0 0x7f5df40cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 --2- 172.21.15.31:0/4084071979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df41592f0 0x7f5df40cb160 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 -- 172.21.15.31:0/4084071979 >> 172.21.15.31:0/4084071979 conn(0x7f5df4067400 msgr2=0x7f5df4067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 -- 172.21.15.31:0/4084071979 shutdown_connections 2024-08-17T02:25:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 -- 172.21.15.31:0/4084071979 wait complete. 2024-08-17T02:25:40.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 Processor -- start 2024-08-17T02:25:40.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.526+0000 7f5df93de700 1 -- start start 2024-08-17T02:25:40.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df93de700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df41592f0 0x7f5df415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df93de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5df41596c0 0x7f5df4143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df93de700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b2e70 0x7f5df40c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df93de700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40b3fa0 con 0x7f5df40b2e70 2024-08-17T02:25:40.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df93de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40b3300 con 0x7f5df41596c0 2024-08-17T02:25:40.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df93de700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40b35e0 con 0x7f5df41592f0 2024-08-17T02:25:40.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df8bdd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b2e70 0x7f5df40c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df3fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df41592f0 0x7f5df415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df8bdd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b2e70 0x7f5df40c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36816/0 (socket says 172.21.15.31:36816) 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df8bdd700 1 -- 172.21.15.31:0/2777095819 learned_addr learned my addr 172.21.15.31:0/2777095819 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5df41596c0 0x7f5df4143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df3fff700 1 -- 172.21.15.31:0/2777095819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5df41596c0 msgr2=0x7f5df4143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df3fff700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5df41596c0 0x7f5df4143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df3fff700 1 -- 172.21.15.31:0/2777095819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b2e70 msgr2=0x7f5df40c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df3fff700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b2e70 0x7f5df40c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df3fff700 1 -- 172.21.15.31:0/2777095819 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0094f0 con 0x7f5df41592f0 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df37fe700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5df41596c0 0x7f5df4143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:40.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df8bdd700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b2e70 0x7f5df40c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:40.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df3fff700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df41592f0 0x7f5df415d890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5df4089150 tx=0x7f5ddc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5debfff700 1 -- 172.21.15.31:0/2777095819 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00b910 con 0x7f5df41592f0 2024-08-17T02:25:40.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5debfff700 1 -- 172.21.15.31:0/2777095819 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00ba70 con 0x7f5df41592f0 2024-08-17T02:25:40.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df93de700 1 -- 172.21.15.31:0/2777095819 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df40b38c0 con 0x7f5df41592f0 2024-08-17T02:25:40.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5debfff700 1 -- 172.21.15.31:0/2777095819 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc011650 con 0x7f5df41592f0 2024-08-17T02:25:40.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df93de700 1 -- 172.21.15.31:0/2777095819 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df415ddd0 con 0x7f5df41592f0 2024-08-17T02:25:40.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.530+0000 7f5df93de700 1 -- 172.21.15.31:0/2777095819 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df40712b0 con 0x7f5df41592f0 2024-08-17T02:25:40.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.534+0000 7f5debfff700 1 -- 172.21.15.31:0/2777095819 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5ddc044a70 con 0x7f5df41592f0 2024-08-17T02:25:40.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.534+0000 7f5debfff700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5dd4060860 0x7f5dd4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:40.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.534+0000 7f5debfff700 1 -- 172.21.15.31:0/2777095819 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f5ddc07e210 con 0x7f5df41592f0 2024-08-17T02:25:40.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.534+0000 7f5df37fe700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5dd4060860 0x7f5dd4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:40.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.534+0000 7f5df37fe700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5dd4060860 0x7f5dd4062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5df40b3f30 tx=0x7f5de40091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:40.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.546+0000 7f5debfff700 1 -- 172.21.15.31:0/2777095819 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5ddc04e8a0 con 0x7f5df41592f0 2024-08-17T02:25:40.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:40.714+0000 7f5df93de700 1 -- 172.21.15.31:0/2777095819 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5df40cfe40 con 0x7f5df41592f0 2024-08-17T02:25:41.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.394+0000 7f5debfff700 1 -- 172.21.15.31:0/2777095819 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5ddc051ec0 con 0x7f5df41592f0 2024-08-17T02:25:41.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.406+0000 7f5df93de700 1 -- 172.21.15.31:0/2777095819 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5dd4060860 msgr2=0x7f5dd4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.406+0000 7f5df93de700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5dd4060860 0x7f5dd4062d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5df40b3f30 tx=0x7f5de40091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.406+0000 7f5df93de700 1 -- 172.21.15.31:0/2777095819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df41592f0 msgr2=0x7f5df415d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.406+0000 7f5df93de700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df41592f0 0x7f5df415d890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5df4089150 tx=0x7f5ddc017000 comp rx=0 tx=0).stop 2024-08-17T02:25:41.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.410+0000 7f5df93de700 1 -- 172.21.15.31:0/2777095819 shutdown_connections 2024-08-17T02:25:41.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.410+0000 7f5df93de700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5dd4060860 0x7f5dd4062d10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.410+0000 7f5df93de700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5df40b2e70 0x7f5df40c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.410+0000 7f5df93de700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5df41596c0 0x7f5df4143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.410+0000 7f5df93de700 1 --2- 172.21.15.31:0/2777095819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5df41592f0 0x7f5df415d890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.410+0000 7f5df93de700 1 -- 172.21.15.31:0/2777095819 >> 172.21.15.31:0/2777095819 conn(0x7f5df4067400 msgr2=0x7f5df40c5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:41.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.410+0000 7f5df93de700 1 -- 172.21.15.31:0/2777095819 shutdown_connections 2024-08-17T02:25:41.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.410+0000 7f5df93de700 1 -- 172.21.15.31:0/2777095819 wait complete. 2024-08-17T02:25:41.417 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-08-17T02:25:41.428 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:25:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27ef07700 1 Processor -- start 2024-08-17T02:25:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27ef07700 1 -- start start 2024-08-17T02:25:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27ef07700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd2781592f0 0x7fd2780cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27ef07700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2781596c0 0x7fd2780ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27ef07700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27815a780 con 0x7fd2780cb6a0 2024-08-17T02:25:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27ef07700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27815ac10 con 0x7fd2781596c0 2024-08-17T02:25:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27ef07700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd278159b70 con 0x7fd2781592f0 2024-08-17T02:25:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27e706700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2781596c0 0x7fd2780ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27d704700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd2780cb6a0 0x7fd2780cc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50178/0 (socket says 172.21.15.31:50178) 2024-08-17T02:25:41.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27d704700 1 -- 172.21.15.31:0/2395799885 learned_addr learned my addr 172.21.15.31:0/2395799885 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:41.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27df05700 1 --2- 172.21.15.31:0/2395799885 >> v2:172.21.15.92:3300/0 conn(0x7fd2781592f0 0x7fd2780cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27cf03700 1 -- 172.21.15.31:0/2395799885 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829029705 0 0) 0x7fd27815a780 con 0x7fd2780cb6a0 2024-08-17T02:25:41.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27cf03700 1 -- 172.21.15.31:0/2395799885 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd264003570 con 0x7fd2780cb6a0 2024-08-17T02:25:41.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27df05700 1 -- 172.21.15.31:0/2395799885 >> v2:172.21.15.31:3300/0 conn(0x7fd2781596c0 msgr2=0x7fd2780ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:41.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27df05700 1 --2- 172.21.15.31:0/2395799885 >> v2:172.21.15.31:3300/0 conn(0x7fd2781596c0 0x7fd2780ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.534+0000 7fd27df05700 1 -- 172.21.15.31:0/2395799885 >> v1:172.21.15.31:6789/0 conn(0x7fd2780cb6a0 legacy=0x7fd2780cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27df05700 1 -- 172.21.15.31:0/2395799885 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd278159e50 con 0x7fd2781592f0 2024-08-17T02:25:41.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27e706700 1 --2- 172.21.15.31:0/2395799885 >> v2:172.21.15.31:3300/0 conn(0x7fd2781596c0 0x7fd2780ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:41.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27df05700 1 --2- 172.21.15.31:0/2395799885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2781592f0 0x7fd2780cb160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd278089150 tx=0x7fd2740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bf9baa380b354c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27cf03700 1 -- 172.21.15.31:0/2395799885 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274011630 con 0x7fd2781592f0 2024-08-17T02:25:41.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27cf03700 1 -- 172.21.15.31:0/2395799885 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd274011790 con 0x7fd2781592f0 2024-08-17T02:25:41.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27cf03700 1 -- 172.21.15.31:0/2395799885 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274011b30 con 0x7fd2781592f0 2024-08-17T02:25:41.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27ef07700 1 -- 172.21.15.31:0/2395799885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2781592f0 msgr2=0x7fd2780cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27ef07700 1 --2- 172.21.15.31:0/2395799885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2781592f0 0x7fd2780cb160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd278089150 tx=0x7fd2740091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27ef07700 1 -- 172.21.15.31:0/2395799885 shutdown_connections 2024-08-17T02:25:41.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27ef07700 1 --2- 172.21.15.31:0/2395799885 >> v2:172.21.15.31:3300/0 conn(0x7fd2781596c0 0x7fd2780ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27ef07700 1 --2- 172.21.15.31:0/2395799885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2781592f0 0x7fd2780cb160 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27ef07700 1 -- 172.21.15.31:0/2395799885 >> 172.21.15.31:0/2395799885 conn(0x7fd278067400 msgr2=0x7fd278067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:41.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27ef07700 1 -- 172.21.15.31:0/2395799885 shutdown_connections 2024-08-17T02:25:41.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.538+0000 7fd27ef07700 1 -- 172.21.15.31:0/2395799885 wait complete. 2024-08-17T02:25:41.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27ef07700 1 Processor -- start 2024-08-17T02:25:41.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27ef07700 1 -- start start 2024-08-17T02:25:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27ef07700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2781592f0 0x7fd2780b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27ef07700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2781596c0 0x7fd278158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27ef07700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2781526b0 0x7fd278156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27ef07700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780b3e10 con 0x7fd2781596c0 2024-08-17T02:25:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27ef07700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780b3570 con 0x7fd2781592f0 2024-08-17T02:25:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27ef07700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780b3850 con 0x7fd2781526b0 2024-08-17T02:25:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27d704700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2781596c0 0x7fd278158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27df05700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2781592f0 0x7fd2780b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27d704700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2781596c0 0x7fd278158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39576/0 (socket says 172.21.15.31:39576) 2024-08-17T02:25:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27d704700 1 -- 172.21.15.31:0/996851893 learned_addr learned my addr 172.21.15.31:0/996851893 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:41.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27e706700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2781526b0 0x7fd278156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27df05700 1 -- 172.21.15.31:0/996851893 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2781526b0 msgr2=0x7fd278156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27df05700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2781526b0 0x7fd278156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27df05700 1 -- 172.21.15.31:0/996851893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2781596c0 msgr2=0x7fd278158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27df05700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2781596c0 0x7fd278158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27df05700 1 -- 172.21.15.31:0/996851893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270009a20 con 0x7fd2781592f0 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27d704700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2781596c0 0x7fd278158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.542+0000 7fd27df05700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2781592f0 0x7fd2780b2e70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd274016000 tx=0x7fd274017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.546+0000 7fd26dffb700 1 -- 172.21.15.31:0/996851893 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274011900 con 0x7fd2781592f0 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.546+0000 7fd26dffb700 1 -- 172.21.15.31:0/996851893 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd274011aa0 con 0x7fd2781592f0 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.546+0000 7fd27ef07700 1 -- 172.21.15.31:0/996851893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd274009420 con 0x7fd2781592f0 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.546+0000 7fd26dffb700 1 -- 172.21.15.31:0/996851893 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27401a680 con 0x7fd2781592f0 2024-08-17T02:25:41.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.546+0000 7fd27ef07700 1 -- 172.21.15.31:0/996851893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2780b4310 con 0x7fd2781592f0 2024-08-17T02:25:41.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.546+0000 7fd27ef07700 1 -- 172.21.15.31:0/996851893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2780712b0 con 0x7fd2781592f0 2024-08-17T02:25:41.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.546+0000 7fd26dffb700 1 -- 172.21.15.31:0/996851893 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd27401a9f0 con 0x7fd2781592f0 2024-08-17T02:25:41.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.546+0000 7fd26dffb700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd25c060890 0x7fd25c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.546+0000 7fd26dffb700 1 -- 172.21.15.31:0/996851893 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fd27407e610 con 0x7fd2781592f0 2024-08-17T02:25:41.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.546+0000 7fd27d704700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd25c060890 0x7fd25c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.550+0000 7fd27d704700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd25c060890 0x7fd25c062d40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd278069350 tx=0x7fd268009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.558+0000 7fd26dffb700 1 -- 172.21.15.31:0/996851893 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd27404eb60 con 0x7fd2781592f0 2024-08-17T02:25:41.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:41.762+0000 7fd27ef07700 1 -- 172.21.15.31:0/996851893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd2780ce020 con 0x7fd2781592f0 2024-08-17T02:25:42.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.429+0000 7fd26dffb700 1 -- 172.21.15.31:0/996851893 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd274052180 con 0x7fd2781592f0 2024-08-17T02:25:42.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 -- 172.21.15.31:0/996851893 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd25c060890 msgr2=0x7fd25c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd25c060890 0x7fd25c062d40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd278069350 tx=0x7fd268009040 comp rx=0 tx=0).stop 2024-08-17T02:25:42.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 -- 172.21.15.31:0/996851893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2781592f0 msgr2=0x7fd2780b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2781592f0 0x7fd2780b2e70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd274016000 tx=0x7fd274017000 comp rx=0 tx=0).stop 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 -- 172.21.15.31:0/996851893 shutdown_connections 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd25c060890 0x7fd25c062d40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd2781526b0 0x7fd278156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2781596c0 0x7fd278158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 --2- 172.21.15.31:0/996851893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2781592f0 0x7fd2780b2e70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 -- 172.21.15.31:0/996851893 >> 172.21.15.31:0/996851893 conn(0x7fd278067400 msgr2=0x7fd2780c63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 -- 172.21.15.31:0/996851893 shutdown_connections 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.433+0000 7fd27ef07700 1 -- 172.21.15.31:0/996851893 wait complete. 2024-08-17T02:25:42.436 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:25:42.446 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:42.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cca2a2700 1 Processor -- start 2024-08-17T02:25:42.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cca2a2700 1 -- start start 2024-08-17T02:25:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cca2a2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1cc415d2a0 0x7f1cc415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cca2a2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc40aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cca2a2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc40c98b0 con 0x7f1cc40cd940 2024-08-17T02:25:42.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cca2a2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40b2f00 con 0x7f1cc415d2a0 2024-08-17T02:25:42.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cca2a2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40ac810 con 0x7f1cc40cd4f0 2024-08-17T02:25:42.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cc8a9f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc40aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cc92a0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1cc415d2a0 0x7f1cc415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cc8a9f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc40aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:51720/0 (socket says 172.21.15.31:51720) 2024-08-17T02:25:42.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cc8a9f700 1 -- 172.21.15.31:0/3378050422 learned_addr learned my addr 172.21.15.31:0/3378050422 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:42.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cc9aa1700 1 --1- 172.21.15.31:0/3378050422 >> v1:172.21.15.92:6789/0 conn(0x7f1cc40cd940 0x7f1cc4067400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:43260/0 (socket says 172.21.15.31:43260) 2024-08-17T02:25:42.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cc8a9f700 1 -- 172.21.15.31:0/3378050422 >> v2:172.21.15.92:3300/0 conn(0x7f1cc415d2a0 msgr2=0x7f1cc415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:42.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cc8a9f700 1 --2- 172.21.15.31:0/3378050422 >> v2:172.21.15.92:3300/0 conn(0x7f1cc415d2a0 0x7f1cc415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cc8a9f700 1 -- 172.21.15.31:0/3378050422 >> v1:172.21.15.92:6789/0 conn(0x7f1cc40cd940 legacy=0x7f1cc4067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cc8a9f700 1 -- 172.21.15.31:0/3378050422 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40b22f0 con 0x7f1cc40cd4f0 2024-08-17T02:25:42.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cc8a9f700 1 --2- 172.21.15.31:0/3378050422 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc40aead0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40099b0 tx=0x7f1cb4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54f0f859dcbf35be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cbbfff700 1 -- 172.21.15.31:0/3378050422 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4009ea0 con 0x7f1cc40cd4f0 2024-08-17T02:25:42.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cbbfff700 1 -- 172.21.15.31:0/3378050422 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb400b860 con 0x7f1cc40cd4f0 2024-08-17T02:25:42.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cbbfff700 1 -- 172.21.15.31:0/3378050422 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400bc00 con 0x7f1cc40cd4f0 2024-08-17T02:25:42.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3378050422 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 msgr2=0x7f1cc40aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.549+0000 7f1cca2a2700 1 --2- 172.21.15.31:0/3378050422 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc40aead0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40099b0 tx=0x7f1cb4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:42.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3378050422 shutdown_connections 2024-08-17T02:25:42.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 --2- 172.21.15.31:0/3378050422 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc40aead0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 --2- 172.21.15.31:0/3378050422 >> v2:172.21.15.92:3300/0 conn(0x7f1cc415d2a0 0x7f1cc415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3378050422 >> 172.21.15.31:0/3378050422 conn(0x7f1cc4063b20 msgr2=0x7f1cc406b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3378050422 shutdown_connections 2024-08-17T02:25:42.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3378050422 wait complete. 2024-08-17T02:25:42.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 Processor -- start 2024-08-17T02:25:42.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 -- start start 2024-08-17T02:25:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc4147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cc40cd940 0x7f1cc4154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cc415d2a0 0x7f1cc4154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc414a010 con 0x7f1cc415d2a0 2024-08-17T02:25:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc41551b0 con 0x7f1cc40cd940 2024-08-17T02:25:42.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cca2a2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4155430 con 0x7f1cc40cd4f0 2024-08-17T02:25:42.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cc9aa1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cc415d2a0 0x7f1cc4154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cc92a0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc4147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cc8a9f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cc40cd940 0x7f1cc4154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cc92a0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc4147020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:51726/0 (socket says 172.21.15.31:51726) 2024-08-17T02:25:42.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cc9aa1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cc415d2a0 0x7f1cc4154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39592/0 (socket says 172.21.15.31:39592) 2024-08-17T02:25:42.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.553+0000 7f1cc92a0700 1 -- 172.21.15.31:0/3370799245 learned_addr learned my addr 172.21.15.31:0/3370799245 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:42.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cc9aa1700 1 -- 172.21.15.31:0/3370799245 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 msgr2=0x7f1cc4147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cc9aa1700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc4147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cc9aa1700 1 -- 172.21.15.31:0/3370799245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cc40cd940 msgr2=0x7f1cc4154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cc9aa1700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cc40cd940 0x7f1cc4154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cc9aa1700 1 -- 172.21.15.31:0/3370799245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb40094f0 con 0x7f1cc415d2a0 2024-08-17T02:25:42.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cc9aa1700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cc415d2a0 0x7f1cc4154c70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00cc40 tx=0x7f1cbc001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cb97fa700 1 -- 172.21.15.31:0/3370799245 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc005df0 con 0x7f1cc415d2a0 2024-08-17T02:25:42.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cb97fa700 1 -- 172.21.15.31:0/3370799245 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00a6a0 con 0x7f1cc415d2a0 2024-08-17T02:25:42.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3370799245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc4155710 con 0x7f1cc415d2a0 2024-08-17T02:25:42.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cb97fa700 1 -- 172.21.15.31:0/3370799245 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00aa60 con 0x7f1cc415d2a0 2024-08-17T02:25:42.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3370799245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc4155cd0 con 0x7f1cc415d2a0 2024-08-17T02:25:42.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cb97fa700 1 -- 172.21.15.31:0/3370799245 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1cbc0070f0 con 0x7f1cc415d2a0 2024-08-17T02:25:42.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.557+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3370799245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc40712b0 con 0x7f1cc415d2a0 2024-08-17T02:25:42.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.561+0000 7f1cb97fa700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ca8060860 0x7f1ca8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.561+0000 7f1cb97fa700 1 -- 172.21.15.31:0/3370799245 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1cbc07cb80 con 0x7f1cc415d2a0 2024-08-17T02:25:42.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.561+0000 7f1cc92a0700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ca8060860 0x7f1ca8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.561+0000 7f1cc92a0700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ca8060860 0x7f1ca8062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009dd0 tx=0x7f1cc00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.565+0000 7f1cb97fa700 1 -- 172.21.15.31:0/3370799245 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1cbc04d050 con 0x7f1cc415d2a0 2024-08-17T02:25:42.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.729+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3370799245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cc4070cc0 con 0x7f1cc415d2a0 2024-08-17T02:25:42.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.729+0000 7f1cb97fa700 1 -- 172.21.15.31:0/3370799245 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f1cbc050670 con 0x7f1cc415d2a0 2024-08-17T02:25:42.734 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:42.734 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":35,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:25:41.764897+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:40.183864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:40.754356+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3370799245 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ca8060860 msgr2=0x7f1ca8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ca8060860 0x7f1ca8062d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0009dd0 tx=0x7f1cc00091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3370799245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cc415d2a0 msgr2=0x7f1cc4154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cc415d2a0 0x7f1cc4154c70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00cc40 tx=0x7f1cbc001a50 comp rx=0 tx=0).stop 2024-08-17T02:25:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3370799245 shutdown_connections 2024-08-17T02:25:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1ca8060860 0x7f1ca8062d10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cc415d2a0 0x7f1cc4154c70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cc40cd940 0x7f1cc4154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 --2- 172.21.15.31:0/3370799245 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cc40cd4f0 0x7f1cc4147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3370799245 >> 172.21.15.31:0/3370799245 conn(0x7f1cc4063b20 msgr2=0x7f1cc40c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3370799245 shutdown_connections 2024-08-17T02:25:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.733+0000 7f1cca2a2700 1 -- 172.21.15.31:0/3370799245 wait complete. 2024-08-17T02:25:42.748 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 Processor -- start 2024-08-17T02:25:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 -- start start 2024-08-17T02:25:42.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f82f8140780 0x7f82f8140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82f80ca340 0x7f82f80b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f80ca7c0 con 0x7f82f80b0fe0 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80b1970 con 0x7f82f80ca340 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80ab690 con 0x7f82f8140780 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fe4e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82f80ca340 0x7f82f80b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fe4e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f82f80ca340 0x7f82f80b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39594/0 (socket says 172.21.15.31:39594) 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fe4e0700 1 -- 172.21.15.31:0/3191197159 learned_addr learned my addr 172.21.15.31:0/3191197159 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fdcdf700 1 --2- 172.21.15.31:0/3191197159 >> v2:172.21.15.92:3300/0 conn(0x7f82f8140780 0x7f82f8140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fe4e0700 1 -- 172.21.15.31:0/3191197159 >> v2:172.21.15.92:3300/0 conn(0x7f82f8140780 msgr2=0x7f82f8140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fe4e0700 1 --2- 172.21.15.31:0/3191197159 >> v2:172.21.15.92:3300/0 conn(0x7f82f8140780 0x7f82f8140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fe4e0700 1 -- 172.21.15.31:0/3191197159 >> v1:172.21.15.92:6789/0 conn(0x7f82f80b0fe0 legacy=0x7f82f80c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fe4e0700 1 -- 172.21.15.31:0/3191197159 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80caa00 con 0x7f82f80ca340 2024-08-17T02:25:42.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fe4e0700 1 --2- 172.21.15.31:0/3191197159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f80ca340 0x7f82f80b1430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f82f80cce30 tx=0x7f82f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e277d69949780da9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fccdd700 1 -- 172.21.15.31:0/3191197159 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000e070 con 0x7f82f80ca340 2024-08-17T02:25:42.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fccdd700 1 -- 172.21.15.31:0/3191197159 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f000ba50 con 0x7f82f80ca340 2024-08-17T02:25:42.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fccdd700 1 -- 172.21.15.31:0/3191197159 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00092e0 con 0x7f82f80ca340 2024-08-17T02:25:42.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 -- 172.21.15.31:0/3191197159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f80ca340 msgr2=0x7f82f80b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 --2- 172.21.15.31:0/3191197159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f80ca340 0x7f82f80b1430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f82f80cce30 tx=0x7f82f0009840 comp rx=0 tx=0).stop 2024-08-17T02:25:42.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 -- 172.21.15.31:0/3191197159 shutdown_connections 2024-08-17T02:25:42.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 --2- 172.21.15.31:0/3191197159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f80ca340 0x7f82f80b1430 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 --2- 172.21.15.31:0/3191197159 >> v2:172.21.15.92:3300/0 conn(0x7f82f8140780 0x7f82f8140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 -- 172.21.15.31:0/3191197159 >> 172.21.15.31:0/3191197159 conn(0x7f82f8067400 msgr2=0x7f82f8067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 -- 172.21.15.31:0/3191197159 shutdown_connections 2024-08-17T02:25:42.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.857+0000 7f82fece1700 1 -- 172.21.15.31:0/3191197159 wait complete. 2024-08-17T02:25:42.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.861+0000 7f82fece1700 1 Processor -- start 2024-08-17T02:25:42.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.861+0000 7f82fece1700 1 -- start start 2024-08-17T02:25:42.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fece1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82f80b0fe0 0x7f82f813e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fece1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82f80ca340 0x7f82f81582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fece1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f8140780 0x7f82f813d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fece1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81595f0 con 0x7f82f8140780 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fece1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81589e0 con 0x7f82f80b0fe0 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fece1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8158cc0 con 0x7f82f80ca340 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fe4e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f8140780 0x7f82f813d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fdcdf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82f80b0fe0 0x7f82f813e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fe4e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f8140780 0x7f82f813d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39610/0 (socket says 172.21.15.31:39610) 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fe4e0700 1 -- 172.21.15.31:0/3585509461 learned_addr learned my addr 172.21.15.31:0/3585509461 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fd4de700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82f80ca340 0x7f82f81582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fe4e0700 1 -- 172.21.15.31:0/3585509461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82f80ca340 msgr2=0x7f82f81582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fe4e0700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82f80ca340 0x7f82f81582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fe4e0700 1 -- 172.21.15.31:0/3585509461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82f80b0fe0 msgr2=0x7f82f813e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fe4e0700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82f80b0fe0 0x7f82f813e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fe4e0700 1 -- 172.21.15.31:0/3585509461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0009ae0 con 0x7f82f8140780 2024-08-17T02:25:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fe4e0700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f8140780 0x7f82f813d280 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f82f8063be0 tx=0x7f82f0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82e9ffb700 1 -- 172.21.15.31:0/3585509461 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0008ce0 con 0x7f82f8140780 2024-08-17T02:25:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82e9ffb700 1 -- 172.21.15.31:0/3585509461 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f0008e60 con 0x7f82f8140780 2024-08-17T02:25:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fece1700 1 -- 172.21.15.31:0/3585509461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f8158fa0 con 0x7f82f8140780 2024-08-17T02:25:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82e9ffb700 1 -- 172.21.15.31:0/3585509461 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f00266b0 con 0x7f82f8140780 2024-08-17T02:25:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fece1700 1 -- 172.21.15.31:0/3585509461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f8157140 con 0x7f82f8140780 2024-08-17T02:25:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.865+0000 7f82fece1700 1 -- 172.21.15.31:0/3585509461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f8159760 con 0x7f82f8140780 2024-08-17T02:25:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.869+0000 7f82e9ffb700 1 -- 172.21.15.31:0/3585509461 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f82f0003040 con 0x7f82f8140780 2024-08-17T02:25:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.869+0000 7f82e9ffb700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f82dc060860 0x7f82dc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.869+0000 7f82e9ffb700 1 -- 172.21.15.31:0/3585509461 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82f007eb90 con 0x7f82f8140780 2024-08-17T02:25:42.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.869+0000 7f82fdcdf700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f82dc060860 0x7f82dc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.869+0000 7f82fdcdf700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f82dc060860 0x7f82dc062d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f82f4006fd0 tx=0x7f82f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:42.873+0000 7f82e9ffb700 1 -- 172.21.15.31:0/3585509461 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f82f004efe0 con 0x7f82f8140780 2024-08-17T02:25:43.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.041+0000 7f82fece1700 1 -- 172.21.15.31:0/3585509461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82f80712b0 con 0x7f82f8140780 2024-08-17T02:25:43.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.041+0000 7f82e9ffb700 1 -- 172.21.15.31:0/3585509461 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f82f0011e60 con 0x7f82f8140780 2024-08-17T02:25:43.045 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:43.045 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":35,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:25:41.764897+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:40.183864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:40.754356+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:43.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 -- 172.21.15.31:0/3585509461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f82dc060860 msgr2=0x7f82dc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f82dc060860 0x7f82dc062d10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f82f4006fd0 tx=0x7f82f4008040 comp rx=0 tx=0).stop 2024-08-17T02:25:43.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 -- 172.21.15.31:0/3585509461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f8140780 msgr2=0x7f82f813d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f8140780 0x7f82f813d280 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f82f8063be0 tx=0x7f82f0018000 comp rx=0 tx=0).stop 2024-08-17T02:25:43.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 -- 172.21.15.31:0/3585509461 shutdown_connections 2024-08-17T02:25:43.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f82dc060860 0x7f82dc062d10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82f8140780 0x7f82f813d280 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82f80ca340 0x7f82f81582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 --2- 172.21.15.31:0/3585509461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82f80b0fe0 0x7f82f813e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 -- 172.21.15.31:0/3585509461 >> 172.21.15.31:0/3585509461 conn(0x7f82f8067400 msgr2=0x7f82f8068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 -- 172.21.15.31:0/3585509461 shutdown_connections 2024-08-17T02:25:43.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.045+0000 7f82fece1700 1 -- 172.21.15.31:0/3585509461 wait complete. 2024-08-17T02:25:43.059 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:25:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd72359e700 1 Processor -- start 2024-08-17T02:25:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd72359e700 1 -- start start 2024-08-17T02:25:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd72359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd7240b0f80 0x7fd72406a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd72359e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7240ab6e0 con 0x7fd72406a0f0 2024-08-17T02:25:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd72359e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7240abf80 con 0x7fd7240cc3c0 2024-08-17T02:25:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd72359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72415a7f0 con 0x7fd7240b0f80 2024-08-17T02:25:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd721d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd7240b0f80 0x7fd72406a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd72259c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd72406a0f0 0x7fd7241557d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50192/0 (socket says 172.21.15.31:50192) 2024-08-17T02:25:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd72259c700 1 -- 172.21.15.31:0/628487338 learned_addr learned my addr 172.21.15.31:0/628487338 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:43.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd721d9b700 1 -- 172.21.15.31:0/628487338 >> v1:172.21.15.92:6789/0 conn(0x7fd7240cc3c0 legacy=0x7fd7240ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd721d9b700 1 -- 172.21.15.31:0/628487338 >> v1:172.21.15.31:6789/0 conn(0x7fd72406a0f0 legacy=0x7fd7241557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd72159a700 1 -- 172.21.15.31:0/628487338 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860343578 0 0) 0x7fd7240ab6e0 con 0x7fd72406a0f0 2024-08-17T02:25:43.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.173+0000 7fd721d9b700 1 -- 172.21.15.31:0/628487338 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7240ab930 con 0x7fd7240b0f80 2024-08-17T02:25:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd721d9b700 1 --2- 172.21.15.31:0/628487338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240b0f80 0x7fd72406a4c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009910 tx=0x7fd70c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeacf5837fcb80c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72159a700 1 -- 172.21.15.31:0/628487338 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00b820 con 0x7fd7240b0f80 2024-08-17T02:25:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72159a700 1 -- 172.21.15.31:0/628487338 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c00b980 con 0x7fd7240b0f80 2024-08-17T02:25:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72159a700 1 -- 172.21.15.31:0/628487338 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00bd20 con 0x7fd7240b0f80 2024-08-17T02:25:43.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72359e700 1 -- 172.21.15.31:0/628487338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240b0f80 msgr2=0x7fd72406a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72359e700 1 --2- 172.21.15.31:0/628487338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240b0f80 0x7fd72406a4c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009910 tx=0x7fd70c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72359e700 1 -- 172.21.15.31:0/628487338 shutdown_connections 2024-08-17T02:25:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72359e700 1 --2- 172.21.15.31:0/628487338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240b0f80 0x7fd72406a4c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72359e700 1 -- 172.21.15.31:0/628487338 >> 172.21.15.31:0/628487338 conn(0x7fd724067e90 msgr2=0x7fd7240cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72359e700 1 -- 172.21.15.31:0/628487338 shutdown_connections 2024-08-17T02:25:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72359e700 1 -- 172.21.15.31:0/628487338 wait complete. 2024-08-17T02:25:43.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72359e700 1 Processor -- start 2024-08-17T02:25:43.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.177+0000 7fd72359e700 1 -- start start 2024-08-17T02:25:43.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd72359e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72406a0f0 0x7fd724148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd72359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd7240cc3c0 0x7fd724156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd72359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240ca6f0 0x7fd724157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd72359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240cb790 con 0x7fd7240ca6f0 2024-08-17T02:25:43.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd72359e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240cab80 con 0x7fd72406a0f0 2024-08-17T02:25:43.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd72359e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240cae60 con 0x7fd7240cc3c0 2024-08-17T02:25:43.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd722d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240ca6f0 0x7fd724157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd722d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240ca6f0 0x7fd724157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39638/0 (socket says 172.21.15.31:39638) 2024-08-17T02:25:43.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd722d9d700 1 -- 172.21.15.31:0/4180107505 learned_addr learned my addr 172.21.15.31:0/4180107505 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:43.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd72259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72406a0f0 0x7fd724148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd721d9b700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd7240cc3c0 0x7fd724156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd722d9d700 1 -- 172.21.15.31:0/4180107505 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd7240cc3c0 msgr2=0x7fd724156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd722d9d700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd7240cc3c0 0x7fd724156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd722d9d700 1 -- 172.21.15.31:0/4180107505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72406a0f0 msgr2=0x7fd724148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd722d9d700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72406a0f0 0x7fd724148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd722d9d700 1 -- 172.21.15.31:0/4180107505 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c009420 con 0x7fd7240ca6f0 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd722d9d700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240ca6f0 0x7fd724157140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd71400c8e0 tx=0x7fd714001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd71a7fc700 1 -- 172.21.15.31:0/4180107505 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714012630 con 0x7fd7240ca6f0 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd71a7fc700 1 -- 172.21.15.31:0/4180107505 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd714012790 con 0x7fd7240ca6f0 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd72359e700 1 -- 172.21.15.31:0/4180107505 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7240cb140 con 0x7fd7240ca6f0 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd71a7fc700 1 -- 172.21.15.31:0/4180107505 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714012b50 con 0x7fd7240ca6f0 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd72359e700 1 -- 172.21.15.31:0/4180107505 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7241595c0 con 0x7fd7240ca6f0 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.181+0000 7fd72359e700 1 -- 172.21.15.31:0/4180107505 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7240cb940 con 0x7fd7240ca6f0 2024-08-17T02:25:43.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.185+0000 7fd71a7fc700 1 -- 172.21.15.31:0/4180107505 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd71401a3a0 con 0x7fd7240ca6f0 2024-08-17T02:25:43.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.185+0000 7fd71a7fc700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd704060860 0x7fd704062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.185+0000 7fd71a7fc700 1 -- 172.21.15.31:0/4180107505 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd71407cdb0 con 0x7fd7240ca6f0 2024-08-17T02:25:43.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.185+0000 7fd72259c700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd704060860 0x7fd704062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.185+0000 7fd72259c700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd704060860 0x7fd704062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd71c007fd0 tx=0x7fd71c007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.193+0000 7fd71a7fc700 1 -- 172.21.15.31:0/4180107505 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd7240cb940 con 0x7fd7240ca6f0 2024-08-17T02:25:43.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.397+0000 7fd72359e700 1 -- 172.21.15.31:0/4180107505 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd7240cb940 con 0x7fd7240ca6f0 2024-08-17T02:25:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.413+0000 7fd71a7fc700 1 -- 172.21.15.31:0/4180107505 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd7240cb940 con 0x7fd7240ca6f0 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 -- 172.21.15.31:0/4180107505 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd704060860 msgr2=0x7fd704062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd704060860 0x7fd704062d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd71c007fd0 tx=0x7fd71c007d10 comp rx=0 tx=0).stop 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 -- 172.21.15.31:0/4180107505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240ca6f0 msgr2=0x7fd724157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240ca6f0 0x7fd724157140 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd71400c8e0 tx=0x7fd714001710 comp rx=0 tx=0).stop 2024-08-17T02:25:43.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 -- 172.21.15.31:0/4180107505 shutdown_connections 2024-08-17T02:25:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd704060860 0x7fd704062d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7240ca6f0 0x7fd724157140 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd7240cc3c0 0x7fd724156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 --2- 172.21.15.31:0/4180107505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd72406a0f0 0x7fd724148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 -- 172.21.15.31:0/4180107505 >> 172.21.15.31:0/4180107505 conn(0x7fd724067e90 msgr2=0x7fd7241548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 -- 172.21.15.31:0/4180107505 shutdown_connections 2024-08-17T02:25:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.417+0000 7fd72359e700 1 -- 172.21.15.31:0/4180107505 wait complete. 2024-08-17T02:25:43.433 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:25:43.459 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:43.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:43.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.545+0000 7f5016b81700 1 Processor -- start 2024-08-17T02:25:43.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.545+0000 7f5016b81700 1 -- start start 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f5016b81700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50100b4340 0x7f50100b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f5016b81700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50100b2a60 con 0x7f5010159700 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f5016b81700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50100b11b0 con 0x7f5010159330 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f5016b81700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50100b1490 con 0x7f50100b4340 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f501511e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5010159700 0x7f50100cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50200/0 (socket says 172.21.15.31:50200) 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f501511e700 1 -- 172.21.15.31:0/652184509 learned_addr learned my addr 172.21.15.31:0/652184509 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500ffff700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50100b4340 0x7f50100b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145147599 0 0) 0x7f50100b2a60 con 0x7f5010159700 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ffc003570 con 0x7f5010159700 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648833707 0 0) 0x7f50100b11b0 con 0x7f5010159330 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50100b2a60 con 0x7f5010159330 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362775094 0 0) 0x7f4ffc003570 con 0x7f5010159700 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50100b4340 msgr2=0x7f50100b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50100b4340 0x7f50100b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 >> v1:172.21.15.92:6789/0 conn(0x7f5010159330 legacy=0x7f50100b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50100b1770 con 0x7f5010159700 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f50080017f0 con 0x7f5010159700 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 >> v1:172.21.15.31:6789/0 conn(0x7f5010159700 legacy=0x7f50100cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ffc003c20 0x7f4ffc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50100b4340 0x7f4ffc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ffc004d50 0x7f4ffc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50100b1490 con 0x7f4ffc004d50 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc00bb70 con 0x7f4ffc003c20 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc00bd30 con 0x7f50100b4340 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f501511e700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ffc004d50 0x7f4ffc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500ffff700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50100b4340 0x7f4ffc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f501491d700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ffc003c20 0x7f4ffc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f501511e700 1 -- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50100b4340 msgr2=0x7f4ffc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f501511e700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f50100b4340 0x7f4ffc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f501511e700 1 -- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ffc003c20 msgr2=0x7f4ffc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f501511e700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ffc003c20 0x7f4ffc004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f501511e700 1 -- 172.21.15.31:0/652184509 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc003570 con 0x7f4ffc004d50 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f501511e700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ffc004d50 0x7f4ffc0051c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f500800a8d0 tx=0x7f5008002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b106ee99ba6432 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50080070d0 con 0x7f4ffc004d50 2024-08-17T02:25:43.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5008007230 con 0x7f4ffc004d50 2024-08-17T02:25:43.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.549+0000 7f500f7fe700 1 -- 172.21.15.31:0/652184509 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50080075f0 con 0x7f4ffc004d50 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.553+0000 7f5016b81700 1 -- 172.21.15.31:0/652184509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ffc004d50 msgr2=0x7f4ffc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.553+0000 7f5016b81700 1 --2- 172.21.15.31:0/652184509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ffc004d50 0x7f4ffc0051c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f500800a8d0 tx=0x7f5008002190 comp rx=0 tx=0).stop 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.553+0000 7f501511e700 1 -- 172.21.15.31:0/652184509 reap_dead start 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.553+0000 7f5016b81700 1 -- 172.21.15.31:0/652184509 shutdown_connections 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.553+0000 7f5016b81700 1 -- 172.21.15.31:0/652184509 >> 172.21.15.31:0/652184509 conn(0x7f5010099610 msgr2=0x7f5010067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.553+0000 7f5016b81700 1 -- 172.21.15.31:0/652184509 shutdown_connections 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.553+0000 7f5016b81700 1 -- 172.21.15.31:0/652184509 wait complete. 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.553+0000 7f5016b81700 1 Processor -- start 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.553+0000 7f5016b81700 1 -- start start 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f5016b81700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010150fb0 0x7f501009c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f5016b81700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5010151380 0x7f501009cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f5016b81700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f501013e7d0 0x7f501013ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f5016b81700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501009dbd0 con 0x7f5010150fb0 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f5016b81700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501013e340 con 0x7f501013e7d0 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f5016b81700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501009d330 con 0x7f5010151380 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f501491d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010150fb0 0x7f501009c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f501491d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010150fb0 0x7f501009c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39666/0 (socket says 172.21.15.31:39666) 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f501491d700 1 -- 172.21.15.31:0/2691026038 learned_addr learned my addr 172.21.15.31:0/2691026038 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f500ffff700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5010151380 0x7f501009cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f501511e700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f501013e7d0 0x7f501013ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f501491d700 1 -- 172.21.15.31:0/2691026038 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5010151380 msgr2=0x7f501009cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f501491d700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5010151380 0x7f501009cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f501491d700 1 -- 172.21.15.31:0/2691026038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f501013e7d0 msgr2=0x7f501013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f501491d700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f501013e7d0 0x7f501013ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f501491d700 1 -- 172.21.15.31:0/2691026038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501009d610 con 0x7f5010150fb0 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f501491d700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010150fb0 0x7f501009c5c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5000002b80 tx=0x7f5000007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f500cff9700 1 -- 172.21.15.31:0/2691026038 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000f8d0 con 0x7f5010150fb0 2024-08-17T02:25:43.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f500cff9700 1 -- 172.21.15.31:0/2691026038 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500000fa50 con 0x7f5010150fb0 2024-08-17T02:25:43.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f500cff9700 1 -- 172.21.15.31:0/2691026038 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000fe10 con 0x7f5010150fb0 2024-08-17T02:25:43.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f5016b81700 1 -- 172.21.15.31:0/2691026038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501009d8f0 con 0x7f5010150fb0 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f5016b81700 1 -- 172.21.15.31:0/2691026038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501013f180 con 0x7f5010150fb0 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.557+0000 7f5016b81700 1 -- 172.21.15.31:0/2691026038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50100712b0 con 0x7f5010150fb0 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.561+0000 7f500cff9700 1 -- 172.21.15.31:0/2691026038 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5000006a30 con 0x7f5010150fb0 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.561+0000 7f500cff9700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ff0060860 0x7f4ff0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.561+0000 7f500cff9700 1 -- 172.21.15.31:0/2691026038 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f500007cec0 con 0x7f5010150fb0 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.561+0000 7f500ffff700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ff0060860 0x7f4ff0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.561+0000 7f500ffff700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ff0060860 0x7f4ff0062d10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f501009e160 tx=0x7f4ff80091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.565+0000 7f500cff9700 1 -- 172.21.15.31:0/2691026038 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f500004d310 con 0x7f5010150fb0 2024-08-17T02:25:43.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:43.769+0000 7f5016b81700 1 -- 172.21.15.31:0/2691026038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f501015ad80 con 0x7f5010150fb0 2024-08-17T02:25:44.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.429+0000 7f500cff9700 1 -- 172.21.15.31:0/2691026038 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5000050930 con 0x7f5010150fb0 2024-08-17T02:25:44.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 -- 172.21.15.31:0/2691026038 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ff0060860 msgr2=0x7f4ff0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ff0060860 0x7f4ff0062d10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f501009e160 tx=0x7f4ff80091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 -- 172.21.15.31:0/2691026038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010150fb0 msgr2=0x7f501009c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010150fb0 0x7f501009c5c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5000002b80 tx=0x7f5000007d30 comp rx=0 tx=0).stop 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 -- 172.21.15.31:0/2691026038 shutdown_connections 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ff0060860 0x7f4ff0062d10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f501013e7d0 0x7f501013ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5010151380 0x7f501009cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 --2- 172.21.15.31:0/2691026038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5010150fb0 0x7f501009c5c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 -- 172.21.15.31:0/2691026038 >> 172.21.15.31:0/2691026038 conn(0x7f5010099610 msgr2=0x7f5010068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 -- 172.21.15.31:0/2691026038 shutdown_connections 2024-08-17T02:25:44.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.433+0000 7f5016b81700 1 -- 172.21.15.31:0/2691026038 wait complete. 2024-08-17T02:25:44.454 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:44.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaffff700 1 Processor -- start 2024-08-17T02:25:44.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaffff700 1 -- start start 2024-08-17T02:25:44.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5ab00aff40 0x7f5ab0159870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 0x7f5ab015a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab0068980 con 0x7f5ab00afb70 2024-08-17T02:25:44.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab0067b10 con 0x7f5ab00aff40 2024-08-17T02:25:44.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab015a770 con 0x7f5ab0159db0 2024-08-17T02:25:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaeffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5ab00afb70 0x7f5ab0067400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50216/0 (socket says 172.21.15.31:50216) 2024-08-17T02:25:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaeffd700 1 -- 172.21.15.31:0/871278757 learned_addr learned my addr 172.21.15.31:0/871278757 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aae7fc700 1 --2- 172.21.15.31:0/871278757 >> v2:172.21.15.31:3300/0 conn(0x7f5ab00aff40 0x7f5ab0159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaf7fe700 1 --2- 172.21.15.31:0/871278757 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 0x7f5ab015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aadffb700 1 -- 172.21.15.31:0/871278757 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000373610 0 0) 0x7f5ab0068980 con 0x7f5ab00afb70 2024-08-17T02:25:44.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aadffb700 1 -- 172.21.15.31:0/871278757 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a98003570 con 0x7f5ab00afb70 2024-08-17T02:25:44.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aae7fc700 1 -- 172.21.15.31:0/871278757 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 msgr2=0x7f5ab015a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aae7fc700 1 --2- 172.21.15.31:0/871278757 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 0x7f5ab015a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aae7fc700 1 -- 172.21.15.31:0/871278757 >> v1:172.21.15.31:6789/0 conn(0x7f5ab00afb70 legacy=0x7f5ab0067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aae7fc700 1 -- 172.21.15.31:0/871278757 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0067d70 con 0x7f5ab00aff40 2024-08-17T02:25:44.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aaf7fe700 1 --2- 172.21.15.31:0/871278757 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 0x7f5ab015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aae7fc700 1 --2- 172.21.15.31:0/871278757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00aff40 0x7f5ab0159870 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40098e0 tx=0x7f5aa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01122100965c099 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aadffb700 1 -- 172.21.15.31:0/871278757 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4011630 con 0x7f5ab00aff40 2024-08-17T02:25:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aadffb700 1 -- 172.21.15.31:0/871278757 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa4011790 con 0x7f5ab00aff40 2024-08-17T02:25:44.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.569+0000 7f5aadffb700 1 -- 172.21.15.31:0/871278757 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4011b30 con 0x7f5ab00aff40 2024-08-17T02:25:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.573+0000 7f5aaffff700 1 -- 172.21.15.31:0/871278757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00aff40 msgr2=0x7f5ab0159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.573+0000 7f5aaffff700 1 --2- 172.21.15.31:0/871278757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00aff40 0x7f5ab0159870 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40098e0 tx=0x7f5aa40091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.573+0000 7f5aaffff700 1 -- 172.21.15.31:0/871278757 shutdown_connections 2024-08-17T02:25:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.573+0000 7f5aaffff700 1 --2- 172.21.15.31:0/871278757 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 0x7f5ab015a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.573+0000 7f5aaffff700 1 --2- 172.21.15.31:0/871278757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00aff40 0x7f5ab0159870 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.573+0000 7f5aaffff700 1 -- 172.21.15.31:0/871278757 >> 172.21.15.31:0/871278757 conn(0x7f5ab00cc5d0 msgr2=0x7f5ab00cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.573+0000 7f5aaffff700 1 -- 172.21.15.31:0/871278757 shutdown_connections 2024-08-17T02:25:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.573+0000 7f5aaffff700 1 -- 172.21.15.31:0/871278757 wait complete. 2024-08-17T02:25:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.573+0000 7f5aaffff700 1 Processor -- start 2024-08-17T02:25:44.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.573+0000 7f5aaffff700 1 -- start start 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00afb70 0x7f5ab013ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ab00aff40 0x7f5ab0154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 0x7f5ab01694c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0155f20 con 0x7f5ab00afb70 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0155250 con 0x7f5ab00aff40 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab01558d0 con 0x7f5ab0159db0 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00afb70 0x7f5ab013ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00afb70 0x7f5ab013ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39678/0 (socket says 172.21.15.31:39678) 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaeffd700 1 -- 172.21.15.31:0/1825428670 learned_addr learned my addr 172.21.15.31:0/1825428670 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aae7fc700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ab00aff40 0x7f5ab0154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaf7fe700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 0x7f5ab01694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaeffd700 1 -- 172.21.15.31:0/1825428670 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 msgr2=0x7f5ab01694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaeffd700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 0x7f5ab01694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaeffd700 1 -- 172.21.15.31:0/1825428670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ab00aff40 msgr2=0x7f5ab0154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaeffd700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ab00aff40 0x7f5ab0154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaeffd700 1 -- 172.21.15.31:0/1825428670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa8009a20 con 0x7f5ab00afb70 2024-08-17T02:25:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaeffd700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00afb70 0x7f5ab013ef00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5aa000c590 tx=0x7f5aa0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5a96ffd700 1 -- 172.21.15.31:0/1825428670 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0005cd0 con 0x7f5ab00afb70 2024-08-17T02:25:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5a96ffd700 1 -- 172.21.15.31:0/1825428670 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa0005e50 con 0x7f5ab00afb70 2024-08-17T02:25:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaffff700 1 -- 172.21.15.31:0/1825428670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa4009420 con 0x7f5ab00afb70 2024-08-17T02:25:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5a96ffd700 1 -- 172.21.15.31:0/1825428670 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0007320 con 0x7f5ab00afb70 2024-08-17T02:25:44.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.577+0000 7f5aaffff700 1 -- 172.21.15.31:0/1825428670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab013f440 con 0x7f5ab00afb70 2024-08-17T02:25:44.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.581+0000 7f5aaffff700 1 -- 172.21.15.31:0/1825428670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab0155730 con 0x7f5ab00afb70 2024-08-17T02:25:44.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.581+0000 7f5a96ffd700 1 -- 172.21.15.31:0/1825428670 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5aa001b3b0 con 0x7f5ab00afb70 2024-08-17T02:25:44.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.581+0000 7f5a96ffd700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5a9c060860 0x7f5a9c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.581+0000 7f5a96ffd700 1 -- 172.21.15.31:0/1825428670 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5aa007c240 con 0x7f5ab00afb70 2024-08-17T02:25:44.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.581+0000 7f5aae7fc700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5a9c060860 0x7f5a9c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.581+0000 7f5aae7fc700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5a9c060860 0x7f5a9c062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40091e0 tx=0x7f5aa4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.589+0000 7f5a96ffd700 1 -- 172.21.15.31:0/1825428670 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5ab0155730 con 0x7f5ab00afb70 2024-08-17T02:25:44.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.789+0000 7f5aaffff700 1 -- 172.21.15.31:0/1825428670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ab0155730 con 0x7f5ab00afb70 2024-08-17T02:25:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5a96ffd700 1 -- 172.21.15.31:0/1825428670 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f5ab0155730 con 0x7f5ab00afb70 2024-08-17T02:25:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:44.795 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1920530016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1920530016},{"type":"v1","addr":"172.21.15.92:6833","nonce":1920530016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3381009547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3381009547},{"type":"v1","addr":"172.21.15.92:6835","nonce":3381009547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5040,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/548139464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":548139464},{"type":"v1","addr":"172.21.15.31:6836","nonce":548139464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:41.765672+0000","modified":"2024-08-17T02:25:44.420703+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6837/1886584780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1886584780},{"type":"v1","addr":"172.21.15.31:6837","nonce":1886584780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 -- 172.21.15.31:0/1825428670 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5a9c060860 msgr2=0x7f5a9c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5a9c060860 0x7f5a9c062d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40091e0 tx=0x7f5aa4017000 comp rx=0 tx=0).stop 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 -- 172.21.15.31:0/1825428670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00afb70 msgr2=0x7f5ab013ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00afb70 0x7f5ab013ef00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5aa000c590 tx=0x7f5aa0007e00 comp rx=0 tx=0).stop 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 -- 172.21.15.31:0/1825428670 shutdown_connections 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5a9c060860 0x7f5a9c062d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ab0159db0 0x7f5ab01694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ab00aff40 0x7f5ab0154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 --2- 172.21.15.31:0/1825428670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ab00afb70 0x7f5ab013ef00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 -- 172.21.15.31:0/1825428670 >> 172.21.15.31:0/1825428670 conn(0x7f5ab00cc5d0 msgr2=0x7f5ab015acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 -- 172.21.15.31:0/1825428670 shutdown_connections 2024-08-17T02:25:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.793+0000 7f5aaffff700 1 -- 172.21.15.31:0/1825428670 wait complete. 2024-08-17T02:25:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 14 2024-08-17T02:25:44.808 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:44.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bafe9d700 1 Processor -- start 2024-08-17T02:25:44.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bafe9d700 1 -- start start 2024-08-17T02:25:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bafe9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ba806a1a0 0x7f6ba806a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bafe9d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba80cb1b0 con 0x7f6ba80b12b0 2024-08-17T02:25:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bafe9d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba806aae0 con 0x7f6ba8156fd0 2024-08-17T02:25:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bafe9d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba80ca5a0 con 0x7f6ba806a1a0 2024-08-17T02:25:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bae43a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ba806a1a0 0x7f6ba806a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bad438700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6ba80b12b0 0x7f6ba80c9b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50230/0 (socket says 172.21.15.31:50230) 2024-08-17T02:25:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bad438700 1 -- 172.21.15.31:0/1123187337 learned_addr learned my addr 172.21.15.31:0/1123187337 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:44.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bae43a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ba806a1a0 0x7f6ba806a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39682/0 (socket says 172.21.15.31:39682) 2024-08-17T02:25:44.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bae43a700 1 -- 172.21.15.31:0/1123187337 >> v1:172.21.15.92:6789/0 conn(0x7f6ba8156fd0 legacy=0x7f6ba80cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bae43a700 1 -- 172.21.15.31:0/1123187337 >> v1:172.21.15.31:6789/0 conn(0x7f6ba80b12b0 legacy=0x7f6ba80c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.909+0000 7f6bae43a700 1 -- 172.21.15.31:0/1123187337 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba80ca880 con 0x7f6ba806a1a0 2024-08-17T02:25:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bae43a700 1 --2- 172.21.15.31:0/1123187337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba806a1a0 0x7f6ba806a5a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009e60 tx=0x7f6ba0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b25a3951bd0153 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bacc37700 1 -- 172.21.15.31:0/1123187337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000e070 con 0x7f6ba806a1a0 2024-08-17T02:25:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bacc37700 1 -- 172.21.15.31:0/1123187337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba000bc30 con 0x7f6ba806a1a0 2024-08-17T02:25:44.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bacc37700 1 -- 172.21.15.31:0/1123187337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0012430 con 0x7f6ba806a1a0 2024-08-17T02:25:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bafe9d700 1 -- 172.21.15.31:0/1123187337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba806a1a0 msgr2=0x7f6ba806a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bafe9d700 1 --2- 172.21.15.31:0/1123187337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba806a1a0 0x7f6ba806a5a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009e60 tx=0x7f6ba0009780 comp rx=0 tx=0).stop 2024-08-17T02:25:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bafe9d700 1 -- 172.21.15.31:0/1123187337 shutdown_connections 2024-08-17T02:25:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bafe9d700 1 --2- 172.21.15.31:0/1123187337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba806a1a0 0x7f6ba806a5a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bafe9d700 1 -- 172.21.15.31:0/1123187337 >> 172.21.15.31:0/1123187337 conn(0x7f6ba80cbe50 msgr2=0x7f6ba80cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bafe9d700 1 -- 172.21.15.31:0/1123187337 shutdown_connections 2024-08-17T02:25:44.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.913+0000 7f6bafe9d700 1 -- 172.21.15.31:0/1123187337 wait complete. 2024-08-17T02:25:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bafe9d700 1 Processor -- start 2024-08-17T02:25:44.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bafe9d700 1 -- start start 2024-08-17T02:25:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bafe9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ba806a1a0 0x7f6ba80c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bafe9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba80b12b0 0x7f6ba813efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bafe9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba8156fd0 0x7f6ba81597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bafe9d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80c6850 con 0x7f6ba80b12b0 2024-08-17T02:25:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bafe9d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80c5c40 con 0x7f6ba8156fd0 2024-08-17T02:25:44.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bafe9d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80c5f20 con 0x7f6ba806a1a0 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bad438700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba80b12b0 0x7f6ba813efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bad438700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba80b12b0 0x7f6ba813efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39688/0 (socket says 172.21.15.31:39688) 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bad438700 1 -- 172.21.15.31:0/2893965772 learned_addr learned my addr 172.21.15.31:0/2893965772 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bae43a700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba8156fd0 0x7f6ba81597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6badc39700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ba806a1a0 0x7f6ba80c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bad438700 1 -- 172.21.15.31:0/2893965772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ba806a1a0 msgr2=0x7f6ba80c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bad438700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ba806a1a0 0x7f6ba80c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bad438700 1 -- 172.21.15.31:0/2893965772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba8156fd0 msgr2=0x7f6ba81597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bad438700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba8156fd0 0x7f6ba81597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bad438700 1 -- 172.21.15.31:0/2893965772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0009a20 con 0x7f6ba80b12b0 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.917+0000 7f6bad438700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba80b12b0 0x7f6ba813efd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c7c0 tx=0x7f6b98007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6b9dffb700 1 -- 172.21.15.31:0/2893965772 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98005b30 con 0x7f6ba80b12b0 2024-08-17T02:25:44.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6b9dffb700 1 -- 172.21.15.31:0/2893965772 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b98005c90 con 0x7f6ba80b12b0 2024-08-17T02:25:44.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6bafe9d700 1 -- 172.21.15.31:0/2893965772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba80c6200 con 0x7f6ba80b12b0 2024-08-17T02:25:44.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6b9dffb700 1 -- 172.21.15.31:0/2893965772 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98007320 con 0x7f6ba80b12b0 2024-08-17T02:25:44.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6bafe9d700 1 -- 172.21.15.31:0/2893965772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba80c5910 con 0x7f6ba80b12b0 2024-08-17T02:25:44.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6bafe9d700 1 -- 172.21.15.31:0/2893965772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba80c6a00 con 0x7f6ba80b12b0 2024-08-17T02:25:44.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6b9dffb700 1 -- 172.21.15.31:0/2893965772 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6b98007690 con 0x7f6ba80b12b0 2024-08-17T02:25:44.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6b9dffb700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6b8c060860 0x7f6b8c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6b9dffb700 1 -- 172.21.15.31:0/2893965772 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b9807c110 con 0x7f6ba80b12b0 2024-08-17T02:25:44.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6badc39700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6b8c060860 0x7f6b8c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.921+0000 7f6badc39700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6b8c060860 0x7f6b8c062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4000c00 tx=0x7f6ba4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:44.929+0000 7f6b9dffb700 1 -- 172.21.15.31:0/2893965772 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f6ba80c6a00 con 0x7f6ba80b12b0 2024-08-17T02:25:45.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.093+0000 7f6bafe9d700 1 -- 172.21.15.31:0/2893965772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ba80712b0 con 0x7f6ba80b12b0 2024-08-17T02:25:45.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6b9dffb700 1 -- 172.21.15.31:0/2893965772 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f6b9804c560 con 0x7f6ba80b12b0 2024-08-17T02:25:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:45.099 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":36,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:25:43.392262+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:40.183864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:40.754356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:45.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 -- 172.21.15.31:0/2893965772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6b8c060860 msgr2=0x7f6b8c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6b8c060860 0x7f6b8c062d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4000c00 tx=0x7f6ba4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 -- 172.21.15.31:0/2893965772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba80b12b0 msgr2=0x7f6ba813efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba80b12b0 0x7f6ba813efd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c7c0 tx=0x7f6b98007f30 comp rx=0 tx=0).stop 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 -- 172.21.15.31:0/2893965772 shutdown_connections 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6b8c060860 0x7f6b8c062d10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba8156fd0 0x7f6ba81597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ba80b12b0 0x7f6ba813efd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 --2- 172.21.15.31:0/2893965772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ba806a1a0 0x7f6ba80c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 -- 172.21.15.31:0/2893965772 >> 172.21.15.31:0/2893965772 conn(0x7f6ba80cbe50 msgr2=0x7f6ba80cb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 -- 172.21.15.31:0/2893965772 shutdown_connections 2024-08-17T02:25:45.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.097+0000 7f6bafe9d700 1 -- 172.21.15.31:0/2893965772 wait complete. 2024-08-17T02:25:45.113 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:25:45.113 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:45.203 INFO:tasks.ceph.mds.c.smithi031.stderr:2024-08-17T02:25:45.201+0000 7f566e59a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:25:45.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01cec28700 1 Processor -- start 2024-08-17T02:25:45.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01cec28700 1 -- start start 2024-08-17T02:25:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01cec28700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c8140780 0x7f01c8140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01cec28700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f01c80ca340 0x7f01c80b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01cec28700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c80ca7c0 con 0x7f01c80b0fe0 2024-08-17T02:25:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01cec28700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c80b1970 con 0x7f01c80ca340 2024-08-17T02:25:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01cec28700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80ab690 con 0x7f01c8140780 2024-08-17T02:25:45.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01cd425700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f01c80b0fe0 0x7f01c80c9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50246/0 (socket says 172.21.15.31:50246) 2024-08-17T02:25:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01cd425700 1 -- 172.21.15.31:0/3811467584 learned_addr learned my addr 172.21.15.31:0/3811467584 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01ce427700 1 --2- 172.21.15.31:0/3811467584 >> v2:172.21.15.92:3300/0 conn(0x7f01c80ca340 0x7f01c80b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01cdc26700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c8140780 0x7f01c8140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671434832 0 0) 0x7f01bc001110 con 0x7f01c80b0fe0 2024-08-17T02:25:45.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.221+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01b4003570 con 0x7f01c80b0fe0 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 422665248 0 0) 0x7f01b4003570 con 0x7f01c80b0fe0 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c8140780 msgr2=0x7f01c8140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c8140780 0x7f01c8140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 >> v2:172.21.15.92:3300/0 conn(0x7f01c80ca340 msgr2=0x7f01c80b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 --2- 172.21.15.31:0/3811467584 >> v2:172.21.15.92:3300/0 conn(0x7f01c80ca340 0x7f01c80b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c80caa00 con 0x7f01c80b0fe0 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f01bc001600 con 0x7f01c80b0fe0 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 >> v1:172.21.15.31:6789/0 conn(0x7f01c80b0fe0 legacy=0x7f01c80c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b4003a60 0x7f01b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01b4004810 0x7f01b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c8140780 0x7f01b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80b1970 con 0x7f01b4003a60 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80ab690 con 0x7f01b4004810 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b400ba60 con 0x7f01c8140780 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cdc26700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b4003a60 0x7f01b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cd425700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01b4004810 0x7f01b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ce427700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c8140780 0x7f01b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cdc26700 1 -- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c8140780 msgr2=0x7f01b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cdc26700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c8140780 0x7f01b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cdc26700 1 -- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01b4004810 msgr2=0x7f01b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cdc26700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01b4004810 0x7f01b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cdc26700 1 -- 172.21.15.31:0/3811467584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4003570 con 0x7f01b4003a60 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cdc26700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b4003a60 0x7f01b4003e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009c30 tx=0x7f01c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7217fc794122e4e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c400e710 con 0x7f01b4003a60 2024-08-17T02:25:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c400e870 con 0x7f01b4003a60 2024-08-17T02:25:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ccc24700 1 -- 172.21.15.31:0/3811467584 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c400ec30 con 0x7f01b4003a60 2024-08-17T02:25:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cec28700 1 -- 172.21.15.31:0/3811467584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b4003a60 msgr2=0x7f01b4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cec28700 1 --2- 172.21.15.31:0/3811467584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b4003a60 0x7f01b4003e70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009c30 tx=0x7f01c40091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01ce427700 1 -- 172.21.15.31:0/3811467584 reap_dead start 2024-08-17T02:25:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cec28700 1 -- 172.21.15.31:0/3811467584 shutdown_connections 2024-08-17T02:25:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cec28700 1 -- 172.21.15.31:0/3811467584 >> 172.21.15.31:0/3811467584 conn(0x7f01c8067400 msgr2=0x7f01c8067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cec28700 1 -- 172.21.15.31:0/3811467584 shutdown_connections 2024-08-17T02:25:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.225+0000 7f01cec28700 1 -- 172.21.15.31:0/3811467584 wait complete. 2024-08-17T02:25:45.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01cec28700 1 Processor -- start 2024-08-17T02:25:45.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01cec28700 1 -- start start 2024-08-17T02:25:45.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01cec28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01b4003a60 0x7f01c815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01cec28700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c815bae0 0x7f01c813cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01cec28700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01c813d180 0x7f01c8159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01cec28700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c815b110 con 0x7f01c813d180 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01cec28700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c813d600 con 0x7f01b4003a60 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01cec28700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c815a500 con 0x7f01c815bae0 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01ce427700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01c813d180 0x7f01c8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01ce427700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01c813d180 0x7f01c8159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39704/0 (socket says 172.21.15.31:39704) 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01ce427700 1 -- 172.21.15.31:0/3187605263 learned_addr learned my addr 172.21.15.31:0/3187605263 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01cdc26700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01b4003a60 0x7f01c815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.229+0000 7f01cd425700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c815bae0 0x7f01c813cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01ce427700 1 -- 172.21.15.31:0/3187605263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c815bae0 msgr2=0x7f01c813cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01ce427700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c815bae0 0x7f01c813cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01ce427700 1 -- 172.21.15.31:0/3187605263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01b4003a60 msgr2=0x7f01c815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01ce427700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01b4003a60 0x7f01c815b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01ce427700 1 -- 172.21.15.31:0/3187605263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c815a7e0 con 0x7f01c813d180 2024-08-17T02:25:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01ce427700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01c813d180 0x7f01c8159790 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f01c8141090 tx=0x7f01c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01b9ffb700 1 -- 172.21.15.31:0/3187605263 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c000e070 con 0x7f01c813d180 2024-08-17T02:25:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01b9ffb700 1 -- 172.21.15.31:0/3187605263 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c0011b80 con 0x7f01c813d180 2024-08-17T02:25:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01cec28700 1 -- 172.21.15.31:0/3187605263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c815aac0 con 0x7f01c813d180 2024-08-17T02:25:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01b9ffb700 1 -- 172.21.15.31:0/3187605263 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0016470 con 0x7f01c813d180 2024-08-17T02:25:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01cec28700 1 -- 172.21.15.31:0/3187605263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c8167b90 con 0x7f01c813d180 2024-08-17T02:25:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01b9ffb700 1 -- 172.21.15.31:0/3187605263 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f01c00168a0 con 0x7f01c813d180 2024-08-17T02:25:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01cec28700 1 -- 172.21.15.31:0/3187605263 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c815b2c0 con 0x7f01c813d180 2024-08-17T02:25:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01b9ffb700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01ac060860 0x7f01ac062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01b9ffb700 1 -- 172.21.15.31:0/3187605263 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01c007d590 con 0x7f01c813d180 2024-08-17T02:25:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01cdc26700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01ac060860 0x7f01ac062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.233+0000 7f01cdc26700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01ac060860 0x7f01ac062d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f01c40091e0 tx=0x7f01c401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.241+0000 7f01b9ffb700 1 -- 172.21.15.31:0/3187605263 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f01c815b2c0 con 0x7f01c813d180 2024-08-17T02:25:45.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.401+0000 7f01cec28700 1 -- 172.21.15.31:0/3187605263 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01c815b2c0 con 0x7f01ac060860 2024-08-17T02:25:45.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.421+0000 7f01b9ffb700 1 -- 172.21.15.31:0/3187605263 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287047 (secure 0 0 0) 0x7f01c815b2c0 con 0x7f01ac060860 2024-08-17T02:25:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:45.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.425+0000 7f01cec28700 1 -- 172.21.15.31:0/3187605263 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01ac060860 msgr2=0x7f01ac062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.425+0000 7f01cec28700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01ac060860 0x7f01ac062d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f01c40091e0 tx=0x7f01c401a000 comp rx=0 tx=0).stop 2024-08-17T02:25:45.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.429+0000 7f01cec28700 1 -- 172.21.15.31:0/3187605263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01c813d180 msgr2=0x7f01c8159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.429+0000 7f01cec28700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01c813d180 0x7f01c8159790 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f01c8141090 tx=0x7f01c000b040 comp rx=0 tx=0).stop 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.429+0000 7f01cec28700 1 -- 172.21.15.31:0/3187605263 shutdown_connections 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.429+0000 7f01cec28700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f01ac060860 0x7f01ac062d10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.429+0000 7f01cec28700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01c813d180 0x7f01c8159790 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.429+0000 7f01cec28700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c815bae0 0x7f01c813cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.429+0000 7f01cec28700 1 --2- 172.21.15.31:0/3187605263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01b4003a60 0x7f01c815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.429+0000 7f01cec28700 1 -- 172.21.15.31:0/3187605263 >> 172.21.15.31:0/3187605263 conn(0x7f01c8067400 msgr2=0x7f01c813fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.429+0000 7f01cec28700 1 -- 172.21.15.31:0/3187605263 shutdown_connections 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.429+0000 7f01cec28700 1 -- 172.21.15.31:0/3187605263 wait complete. 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:25:45.443 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-08-17T02:25:43.599972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387188,"kb_used_data":4160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587532,"statfs":{"total":773094113280,"available":770649632768,"internally_reserved":0,"allocated":4259840,"data_stored":2335260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001003"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429866+0000","last_change":"2024-08-17T02:25:42.429866+0000","last_active":"2024-08-17T02:25:42.429866+0000","last_peered":"2024-08-17T02:25:42.429866+0000","last_clean":"2024-08-17T02:25:42.429866+0000","last_became_active":"2024-08-17T02:25:42.429589+0000","last_became_peered":"2024-08-17T02:25:42.429589+0000","last_unstale":"2024-08-17T02:25:42.429866+0000","last_undegraded":"2024-08-17T02:25:42.429866+0000","last_fullsized":"2024-08-17T02:25:42.429866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404932+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:07.672234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418423+0000","last_change":"2024-08-17T02:25:42.418423+0000","last_active":"2024-08-17T02:25:42.418423+0000","last_peered":"2024-08-17T02:25:42.418423+0000","last_clean":"2024-08-17T02:25:42.418423+0000","last_became_active":"2024-08-17T02:25:42.418156+0000","last_became_peered":"2024-08-17T02:25:42.418156+0000","last_unstale":"2024-08-17T02:25:42.418423+0000","last_undegraded":"2024-08-17T02:25:42.418423+0000","last_fullsized":"2024-08-17T02:25:42.418423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:43.004563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420792+0000","last_change":"2024-08-17T02:25:42.420792+0000","last_active":"2024-08-17T02:25:42.420792+0000","last_peered":"2024-08-17T02:25:42.420792+0000","last_clean":"2024-08-17T02:25:42.420792+0000","last_became_active":"2024-08-17T02:25:42.420383+0000","last_became_peered":"2024-08-17T02:25:42.420383+0000","last_unstale":"2024-08-17T02:25:42.420792+0000","last_undegraded":"2024-08-17T02:25:42.420792+0000","last_fullsized":"2024-08-17T02:25:42.420792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:45.898859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.407547+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:49:35.652729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417300+0000","last_change":"2024-08-17T02:25:42.417300+0000","last_active":"2024-08-17T02:25:42.417300+0000","last_peered":"2024-08-17T02:25:42.417300+0000","last_clean":"2024-08-17T02:25:42.417300+0000","last_became_active":"2024-08-17T02:25:42.417005+0000","last_became_peered":"2024-08-17T02:25:42.417005+0000","last_unstale":"2024-08-17T02:25:42.417300+0000","last_undegraded":"2024-08-17T02:25:42.417300+0000","last_fullsized":"2024-08-17T02:25:42.417300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:35.329338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416534+0000","last_change":"2024-08-17T02:25:42.416534+0000","last_active":"2024-08-17T02:25:42.416534+0000","last_peered":"2024-08-17T02:25:42.416534+0000","last_clean":"2024-08-17T02:25:42.416534+0000","last_became_active":"2024-08-17T02:25:42.416145+0000","last_became_peered":"2024-08-17T02:25:42.416145+0000","last_unstale":"2024-08-17T02:25:42.416534+0000","last_undegraded":"2024-08-17T02:25:42.416534+0000","last_fullsized":"2024-08-17T02:25:42.416534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:36.767291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419906+0000","last_change":"2024-08-17T02:25:42.419906+0000","last_active":"2024-08-17T02:25:42.419906+0000","last_peered":"2024-08-17T02:25:42.419906+0000","last_clean":"2024-08-17T02:25:42.419906+0000","last_became_active":"2024-08-17T02:25:42.419605+0000","last_became_peered":"2024-08-17T02:25:42.419605+0000","last_unstale":"2024-08-17T02:25:42.419906+0000","last_undegraded":"2024-08-17T02:25:42.419906+0000","last_fullsized":"2024-08-17T02:25:42.419906+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:12.438819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418898+0000","last_change":"2024-08-17T02:25:42.418898+0000","last_active":"2024-08-17T02:25:42.418898+0000","last_peered":"2024-08-17T02:25:42.418898+0000","last_clean":"2024-08-17T02:25:42.418898+0000","last_became_active":"2024-08-17T02:25:42.418610+0000","last_became_peered":"2024-08-17T02:25:42.418610+0000","last_unstale":"2024-08-17T02:25:42.418898+0000","last_undegraded":"2024-08-17T02:25:42.418898+0000","last_fullsized":"2024-08-17T02:25:42.418898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:02.087099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416219+0000","last_change":"2024-08-17T02:25:42.416219+0000","last_active":"2024-08-17T02:25:42.416219+0000","last_peered":"2024-08-17T02:25:42.416219+0000","last_clean":"2024-08-17T02:25:42.416219+0000","last_became_active":"2024-08-17T02:25:42.415937+0000","last_became_peered":"2024-08-17T02:25:42.415937+0000","last_unstale":"2024-08-17T02:25:42.416219+0000","last_undegraded":"2024-08-17T02:25:42.416219+0000","last_fullsized":"2024-08-17T02:25:42.416219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:08.435265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421885+0000","last_change":"2024-08-17T02:25:42.421885+0000","last_active":"2024-08-17T02:25:42.421885+0000","last_peered":"2024-08-17T02:25:42.421885+0000","last_clean":"2024-08-17T02:25:42.421885+0000","last_became_active":"2024-08-17T02:25:42.421627+0000","last_became_peered":"2024-08-17T02:25:42.421627+0000","last_unstale":"2024-08-17T02:25:42.421885+0000","last_undegraded":"2024-08-17T02:25:42.421885+0000","last_fullsized":"2024-08-17T02:25:42.421885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:18.458775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.414237+0000","last_change":"2024-08-17T02:25:42.414237+0000","last_active":"2024-08-17T02:25:42.414237+0000","last_peered":"2024-08-17T02:25:42.414237+0000","last_clean":"2024-08-17T02:25:42.414237+0000","last_became_active":"2024-08-17T02:25:42.413842+0000","last_became_peered":"2024-08-17T02:25:42.413842+0000","last_unstale":"2024-08-17T02:25:42.414237+0000","last_undegraded":"2024-08-17T02:25:42.414237+0000","last_fullsized":"2024-08-17T02:25:42.414237+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:04.272280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418431+0000","last_change":"2024-08-17T02:25:42.418431+0000","last_active":"2024-08-17T02:25:42.418431+0000","last_peered":"2024-08-17T02:25:42.418431+0000","last_clean":"2024-08-17T02:25:42.418431+0000","last_became_active":"2024-08-17T02:25:42.418152+0000","last_became_peered":"2024-08-17T02:25:42.418152+0000","last_unstale":"2024-08-17T02:25:42.418431+0000","last_undegraded":"2024-08-17T02:25:42.418431+0000","last_fullsized":"2024-08-17T02:25:42.418431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418167+0000","last_change":"2024-08-17T02:25:42.418167+0000","last_active":"2024-08-17T02:25:42.418167+0000","last_peered":"2024-08-17T02:25:42.418167+0000","last_clean":"2024-08-17T02:25:42.418167+0000","last_became_active":"2024-08-17T02:25:42.417535+0000","last_became_peered":"2024-08-17T02:25:42.417535+0000","last_unstale":"2024-08-17T02:25:42.418167+0000","last_undegraded":"2024-08-17T02:25:42.418167+0000","last_fullsized":"2024-08-17T02:25:42.418167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:22:16.256006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423733+0000","last_change":"2024-08-17T02:25:42.423733+0000","last_active":"2024-08-17T02:25:42.423733+0000","last_peered":"2024-08-17T02:25:42.423733+0000","last_clean":"2024-08-17T02:25:42.423733+0000","last_became_active":"2024-08-17T02:25:42.423437+0000","last_became_peered":"2024-08-17T02:25:42.423437+0000","last_unstale":"2024-08-17T02:25:42.423733+0000","last_undegraded":"2024-08-17T02:25:42.423733+0000","last_fullsized":"2024-08-17T02:25:42.423733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:01.372278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423980+0000","last_change":"2024-08-17T02:25:42.423980+0000","last_active":"2024-08-17T02:25:42.423980+0000","last_peered":"2024-08-17T02:25:42.423980+0000","last_clean":"2024-08-17T02:25:42.423980+0000","last_became_active":"2024-08-17T02:25:42.422527+0000","last_became_peered":"2024-08-17T02:25:42.422527+0000","last_unstale":"2024-08-17T02:25:42.423980+0000","last_undegraded":"2024-08-17T02:25:42.423980+0000","last_fullsized":"2024-08-17T02:25:42.423980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:10.073499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421044+0000","last_change":"2024-08-17T02:25:42.421044+0000","last_active":"2024-08-17T02:25:42.421044+0000","last_peered":"2024-08-17T02:25:42.421044+0000","last_clean":"2024-08-17T02:25:42.421044+0000","last_became_active":"2024-08-17T02:25:42.420760+0000","last_became_peered":"2024-08-17T02:25:42.420760+0000","last_unstale":"2024-08-17T02:25:42.421044+0000","last_undegraded":"2024-08-17T02:25:42.421044+0000","last_fullsized":"2024-08-17T02:25:42.421044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:54.517688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.406076+0000","last_change":"2024-08-17T02:25:42.406076+0000","last_active":"2024-08-17T02:25:42.406076+0000","last_peered":"2024-08-17T02:25:42.406076+0000","last_clean":"2024-08-17T02:25:42.406076+0000","last_became_active":"2024-08-17T02:25:42.405724+0000","last_became_peered":"2024-08-17T02:25:42.405724+0000","last_unstale":"2024-08-17T02:25:42.406076+0000","last_undegraded":"2024-08-17T02:25:42.406076+0000","last_fullsized":"2024-08-17T02:25:42.406076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:15.820514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416984+0000","last_change":"2024-08-17T02:25:42.416984+0000","last_active":"2024-08-17T02:25:42.416984+0000","last_peered":"2024-08-17T02:25:42.416984+0000","last_clean":"2024-08-17T02:25:42.416984+0000","last_became_active":"2024-08-17T02:25:42.415956+0000","last_became_peered":"2024-08-17T02:25:42.415956+0000","last_unstale":"2024-08-17T02:25:42.416984+0000","last_undegraded":"2024-08-17T02:25:42.416984+0000","last_fullsized":"2024-08-17T02:25:42.416984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:06.955772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.407630+0000","last_change":"2024-08-17T02:25:42.407630+0000","last_active":"2024-08-17T02:25:42.407630+0000","last_peered":"2024-08-17T02:25:42.407630+0000","last_clean":"2024-08-17T02:25:42.407630+0000","last_became_active":"2024-08-17T02:25:42.407237+0000","last_became_peered":"2024-08-17T02:25:42.407237+0000","last_unstale":"2024-08-17T02:25:42.407630+0000","last_undegraded":"2024-08-17T02:25:42.407630+0000","last_fullsized":"2024-08-17T02:25:42.407630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:22.134006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.415635+0000","last_change":"2024-08-17T02:25:42.415635+0000","last_active":"2024-08-17T02:25:42.415635+0000","last_peered":"2024-08-17T02:25:42.415635+0000","last_clean":"2024-08-17T02:25:42.415635+0000","last_became_active":"2024-08-17T02:25:42.406945+0000","last_became_peered":"2024-08-17T02:25:42.406945+0000","last_unstale":"2024-08-17T02:25:42.415635+0000","last_undegraded":"2024-08-17T02:25:42.415635+0000","last_fullsized":"2024-08-17T02:25:42.415635+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419390+0000","last_change":"2024-08-17T02:25:42.419390+0000","last_active":"2024-08-17T02:25:42.419390+0000","last_peered":"2024-08-17T02:25:42.419390+0000","last_clean":"2024-08-17T02:25:42.419390+0000","last_became_active":"2024-08-17T02:25:42.419015+0000","last_became_peered":"2024-08-17T02:25:42.419015+0000","last_unstale":"2024-08-17T02:25:42.419390+0000","last_undegraded":"2024-08-17T02:25:42.419390+0000","last_fullsized":"2024-08-17T02:25:42.419390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:53.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416037+0000","last_change":"2024-08-17T02:25:42.416037+0000","last_active":"2024-08-17T02:25:42.416037+0000","last_peered":"2024-08-17T02:25:42.416037+0000","last_clean":"2024-08-17T02:25:42.416037+0000","last_became_active":"2024-08-17T02:25:42.415756+0000","last_became_peered":"2024-08-17T02:25:42.415756+0000","last_unstale":"2024-08-17T02:25:42.416037+0000","last_undegraded":"2024-08-17T02:25:42.416037+0000","last_fullsized":"2024-08-17T02:25:42.416037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:43.554521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421864+0000","last_change":"2024-08-17T02:25:42.421864+0000","last_active":"2024-08-17T02:25:42.421864+0000","last_peered":"2024-08-17T02:25:42.421864+0000","last_clean":"2024-08-17T02:25:42.421864+0000","last_became_active":"2024-08-17T02:25:42.421396+0000","last_became_peered":"2024-08-17T02:25:42.421396+0000","last_unstale":"2024-08-17T02:25:42.421864+0000","last_undegraded":"2024-08-17T02:25:42.421864+0000","last_fullsized":"2024-08-17T02:25:42.421864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:53:59.660258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420428+0000","last_change":"2024-08-17T02:25:42.420428+0000","last_active":"2024-08-17T02:25:42.420428+0000","last_peered":"2024-08-17T02:25:42.420428+0000","last_clean":"2024-08-17T02:25:42.420428+0000","last_became_active":"2024-08-17T02:25:42.419860+0000","last_became_peered":"2024-08-17T02:25:42.419860+0000","last_unstale":"2024-08-17T02:25:42.420428+0000","last_undegraded":"2024-08-17T02:25:42.420428+0000","last_fullsized":"2024-08-17T02:25:42.420428+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:50.507537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.427962+0000","last_change":"2024-08-17T02:25:42.427962+0000","last_active":"2024-08-17T02:25:42.427962+0000","last_peered":"2024-08-17T02:25:42.427962+0000","last_clean":"2024-08-17T02:25:42.427962+0000","last_became_active":"2024-08-17T02:25:42.427683+0000","last_became_peered":"2024-08-17T02:25:42.427683+0000","last_unstale":"2024-08-17T02:25:42.427962+0000","last_undegraded":"2024-08-17T02:25:42.427962+0000","last_fullsized":"2024-08-17T02:25:42.427962+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:39.859919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404414+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:16.638589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417839+0000","last_change":"2024-08-17T02:25:42.417839+0000","last_active":"2024-08-17T02:25:42.417839+0000","last_peered":"2024-08-17T02:25:42.417839+0000","last_clean":"2024-08-17T02:25:42.417839+0000","last_became_active":"2024-08-17T02:25:42.417570+0000","last_became_peered":"2024-08-17T02:25:42.417570+0000","last_unstale":"2024-08-17T02:25:42.417839+0000","last_undegraded":"2024-08-17T02:25:42.417839+0000","last_fullsized":"2024-08-17T02:25:42.417839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:44.235619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417567+0000","last_change":"2024-08-17T02:25:42.417567+0000","last_active":"2024-08-17T02:25:42.417567+0000","last_peered":"2024-08-17T02:25:42.417567+0000","last_clean":"2024-08-17T02:25:42.417567+0000","last_became_active":"2024-08-17T02:25:42.417216+0000","last_became_peered":"2024-08-17T02:25:42.417216+0000","last_unstale":"2024-08-17T02:25:42.417567+0000","last_undegraded":"2024-08-17T02:25:42.417567+0000","last_fullsized":"2024-08-17T02:25:42.417567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:41.195953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422296+0000","last_change":"2024-08-17T02:25:42.422296+0000","last_active":"2024-08-17T02:25:42.422296+0000","last_peered":"2024-08-17T02:25:42.422296+0000","last_clean":"2024-08-17T02:25:42.422296+0000","last_became_active":"2024-08-17T02:25:42.407208+0000","last_became_peered":"2024-08-17T02:25:42.407208+0000","last_unstale":"2024-08-17T02:25:42.422296+0000","last_undegraded":"2024-08-17T02:25:42.422296+0000","last_fullsized":"2024-08-17T02:25:42.422296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420013+0000","last_change":"2024-08-17T02:25:42.420013+0000","last_active":"2024-08-17T02:25:42.420013+0000","last_peered":"2024-08-17T02:25:42.420013+0000","last_clean":"2024-08-17T02:25:42.420013+0000","last_became_active":"2024-08-17T02:25:42.419638+0000","last_became_peered":"2024-08-17T02:25:42.419638+0000","last_unstale":"2024-08-17T02:25:42.420013+0000","last_undegraded":"2024-08-17T02:25:42.420013+0000","last_fullsized":"2024-08-17T02:25:42.420013+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:10.073499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420835+0000","last_change":"2024-08-17T02:25:42.420835+0000","last_active":"2024-08-17T02:25:42.420835+0000","last_peered":"2024-08-17T02:25:42.420835+0000","last_clean":"2024-08-17T02:25:42.420835+0000","last_became_active":"2024-08-17T02:25:42.420623+0000","last_became_peered":"2024-08-17T02:25:42.420623+0000","last_unstale":"2024-08-17T02:25:42.420835+0000","last_undegraded":"2024-08-17T02:25:42.420835+0000","last_fullsized":"2024-08-17T02:25:42.420835+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:08.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.410144+0000","last_change":"2024-08-17T02:25:42.410144+0000","last_active":"2024-08-17T02:25:42.410144+0000","last_peered":"2024-08-17T02:25:42.410144+0000","last_clean":"2024-08-17T02:25:42.410144+0000","last_became_active":"2024-08-17T02:25:42.408813+0000","last_became_peered":"2024-08-17T02:25:42.408813+0000","last_unstale":"2024-08-17T02:25:42.410144+0000","last_undegraded":"2024-08-17T02:25:42.410144+0000","last_fullsized":"2024-08-17T02:25:42.410144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:55.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.436617+0000","last_change":"2024-08-17T02:25:41.414400+0000","last_active":"2024-08-17T02:25:42.436617+0000","last_peered":"2024-08-17T02:25:42.436617+0000","last_clean":"2024-08-17T02:25:42.436617+0000","last_became_active":"2024-08-17T02:25:41.413990+0000","last_became_peered":"2024-08-17T02:25:41.413990+0000","last_unstale":"2024-08-17T02:25:42.436617+0000","last_undegraded":"2024-08-17T02:25:42.436617+0000","last_fullsized":"2024-08-17T02:25:42.436617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:09.064759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417423+0000","last_change":"2024-08-17T02:25:42.417423+0000","last_active":"2024-08-17T02:25:42.417423+0000","last_peered":"2024-08-17T02:25:42.417423+0000","last_clean":"2024-08-17T02:25:42.417423+0000","last_became_active":"2024-08-17T02:25:42.417172+0000","last_became_peered":"2024-08-17T02:25:42.417172+0000","last_unstale":"2024-08-17T02:25:42.417423+0000","last_undegraded":"2024-08-17T02:25:42.417423+0000","last_fullsized":"2024-08-17T02:25:42.417423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:47.035562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.413880+0000","last_change":"2024-08-17T02:25:41.412731+0000","last_active":"2024-08-17T02:25:42.413880+0000","last_peered":"2024-08-17T02:25:42.413880+0000","last_clean":"2024-08-17T02:25:42.413880+0000","last_became_active":"2024-08-17T02:25:41.412451+0000","last_became_peered":"2024-08-17T02:25:41.412451+0000","last_unstale":"2024-08-17T02:25:42.413880+0000","last_undegraded":"2024-08-17T02:25:42.413880+0000","last_fullsized":"2024-08-17T02:25:42.413880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:54.301346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423308+0000","last_change":"2024-08-17T02:25:42.423308+0000","last_active":"2024-08-17T02:25:42.423308+0000","last_peered":"2024-08-17T02:25:42.423308+0000","last_clean":"2024-08-17T02:25:42.423308+0000","last_became_active":"2024-08-17T02:25:42.422988+0000","last_became_peered":"2024-08-17T02:25:42.422988+0000","last_unstale":"2024-08-17T02:25:42.423308+0000","last_undegraded":"2024-08-17T02:25:42.423308+0000","last_fullsized":"2024-08-17T02:25:42.423308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:00:06.810017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434405+0000","last_change":"2024-08-17T02:25:41.414749+0000","last_active":"2024-08-17T02:25:42.434405+0000","last_peered":"2024-08-17T02:25:42.434405+0000","last_clean":"2024-08-17T02:25:42.434405+0000","last_became_active":"2024-08-17T02:25:41.414484+0000","last_became_peered":"2024-08-17T02:25:41.414484+0000","last_unstale":"2024-08-17T02:25:42.434405+0000","last_undegraded":"2024-08-17T02:25:42.434405+0000","last_fullsized":"2024-08-17T02:25:42.434405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:48:43.410239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416685+0000","last_change":"2024-08-17T02:25:42.416685+0000","last_active":"2024-08-17T02:25:42.416685+0000","last_peered":"2024-08-17T02:25:42.416685+0000","last_clean":"2024-08-17T02:25:42.416685+0000","last_became_active":"2024-08-17T02:25:42.416113+0000","last_became_peered":"2024-08-17T02:25:42.416113+0000","last_unstale":"2024-08-17T02:25:42.416685+0000","last_undegraded":"2024-08-17T02:25:42.416685+0000","last_fullsized":"2024-08-17T02:25:42.416685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:41.832444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434872+0000","last_change":"2024-08-17T02:25:41.419882+0000","last_active":"2024-08-17T02:25:42.434872+0000","last_peered":"2024-08-17T02:25:42.434872+0000","last_clean":"2024-08-17T02:25:42.434872+0000","last_became_active":"2024-08-17T02:25:41.419595+0000","last_became_peered":"2024-08-17T02:25:41.419595+0000","last_unstale":"2024-08-17T02:25:42.434872+0000","last_undegraded":"2024-08-17T02:25:42.434872+0000","last_fullsized":"2024-08-17T02:25:42.434872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:28.023006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418376+0000","last_change":"2024-08-17T02:25:42.418376+0000","last_active":"2024-08-17T02:25:42.418376+0000","last_peered":"2024-08-17T02:25:42.418376+0000","last_clean":"2024-08-17T02:25:42.418376+0000","last_became_active":"2024-08-17T02:25:42.417769+0000","last_became_peered":"2024-08-17T02:25:42.417769+0000","last_unstale":"2024-08-17T02:25:42.418376+0000","last_undegraded":"2024-08-17T02:25:42.418376+0000","last_fullsized":"2024-08-17T02:25:42.418376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:57.975103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.412210+0000","last_change":"2024-08-17T02:25:41.413895+0000","last_active":"2024-08-17T02:25:42.412210+0000","last_peered":"2024-08-17T02:25:42.412210+0000","last_clean":"2024-08-17T02:25:42.412210+0000","last_became_active":"2024-08-17T02:25:41.413485+0000","last_became_peered":"2024-08-17T02:25:41.413485+0000","last_unstale":"2024-08-17T02:25:42.412210+0000","last_undegraded":"2024-08-17T02:25:42.412210+0000","last_fullsized":"2024-08-17T02:25:42.412210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:56.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419203+0000","last_change":"2024-08-17T02:25:42.419203+0000","last_active":"2024-08-17T02:25:42.419203+0000","last_peered":"2024-08-17T02:25:42.419203+0000","last_clean":"2024-08-17T02:25:42.419203+0000","last_became_active":"2024-08-17T02:25:42.418852+0000","last_became_peered":"2024-08-17T02:25:42.418852+0000","last_unstale":"2024-08-17T02:25:42.419203+0000","last_undegraded":"2024-08-17T02:25:42.419203+0000","last_fullsized":"2024-08-17T02:25:42.419203+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:01.372278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.411348+0000","last_change":"2024-08-17T02:25:41.416539+0000","last_active":"2024-08-17T02:25:42.411348+0000","last_peered":"2024-08-17T02:25:42.411348+0000","last_clean":"2024-08-17T02:25:42.411348+0000","last_became_active":"2024-08-17T02:25:41.416179+0000","last_became_peered":"2024-08-17T02:25:41.416179+0000","last_unstale":"2024-08-17T02:25:42.411348+0000","last_undegraded":"2024-08-17T02:25:42.411348+0000","last_fullsized":"2024-08-17T02:25:42.411348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:34.320598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429847+0000","last_change":"2024-08-17T02:25:42.429847+0000","last_active":"2024-08-17T02:25:42.429847+0000","last_peered":"2024-08-17T02:25:42.429847+0000","last_clean":"2024-08-17T02:25:42.429847+0000","last_became_active":"2024-08-17T02:25:42.429552+0000","last_became_peered":"2024-08-17T02:25:42.429552+0000","last_unstale":"2024-08-17T02:25:42.429847+0000","last_undegraded":"2024-08-17T02:25:42.429847+0000","last_fullsized":"2024-08-17T02:25:42.429847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:27.411778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416478+0000","last_change":"2024-08-17T02:25:41.413648+0000","last_active":"2024-08-17T02:25:41.416478+0000","last_peered":"2024-08-17T02:25:41.416478+0000","last_clean":"2024-08-17T02:25:41.416478+0000","last_became_active":"2024-08-17T02:25:41.413311+0000","last_became_peered":"2024-08-17T02:25:41.413311+0000","last_unstale":"2024-08-17T02:25:41.416478+0000","last_undegraded":"2024-08-17T02:25:41.416478+0000","last_fullsized":"2024-08-17T02:25:41.416478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:12.438714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420210+0000","last_change":"2024-08-17T02:25:42.420210+0000","last_active":"2024-08-17T02:25:42.420210+0000","last_peered":"2024-08-17T02:25:42.420210+0000","last_clean":"2024-08-17T02:25:42.420210+0000","last_became_active":"2024-08-17T02:25:42.419925+0000","last_became_peered":"2024-08-17T02:25:42.419925+0000","last_unstale":"2024-08-17T02:25:42.420210+0000","last_undegraded":"2024-08-17T02:25:42.420210+0000","last_fullsized":"2024-08-17T02:25:42.420210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:18.458775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.420278+0000","last_change":"2024-08-17T02:25:41.419672+0000","last_active":"2024-08-17T02:25:41.420278+0000","last_peered":"2024-08-17T02:25:41.420278+0000","last_clean":"2024-08-17T02:25:41.420278+0000","last_became_active":"2024-08-17T02:25:41.419363+0000","last_became_peered":"2024-08-17T02:25:41.419363+0000","last_unstale":"2024-08-17T02:25:41.420278+0000","last_undegraded":"2024-08-17T02:25:41.420278+0000","last_fullsized":"2024-08-17T02:25:41.420278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:03.263540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.414001+0000","last_change":"2024-08-17T02:25:42.414001+0000","last_active":"2024-08-17T02:25:42.414001+0000","last_peered":"2024-08-17T02:25:42.414001+0000","last_clean":"2024-08-17T02:25:42.414001+0000","last_became_active":"2024-08-17T02:25:42.413711+0000","last_became_peered":"2024-08-17T02:25:42.413711+0000","last_unstale":"2024-08-17T02:25:42.414001+0000","last_undegraded":"2024-08-17T02:25:42.414001+0000","last_fullsized":"2024-08-17T02:25:42.414001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:00.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.412465+0000","last_change":"2024-08-17T02:25:41.412465+0000","last_active":"2024-08-17T02:25:41.412465+0000","last_peered":"2024-08-17T02:25:41.412465+0000","last_clean":"2024-08-17T02:25:41.412465+0000","last_became_active":"2024-08-17T02:25:41.412180+0000","last_became_peered":"2024-08-17T02:25:41.412180+0000","last_unstale":"2024-08-17T02:25:41.412465+0000","last_undegraded":"2024-08-17T02:25:41.412465+0000","last_fullsized":"2024-08-17T02:25:41.412465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:40:41.453122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416127+0000","last_change":"2024-08-17T02:25:42.416127+0000","last_active":"2024-08-17T02:25:42.416127+0000","last_peered":"2024-08-17T02:25:42.416127+0000","last_clean":"2024-08-17T02:25:42.416127+0000","last_became_active":"2024-08-17T02:25:42.415840+0000","last_became_peered":"2024-08-17T02:25:42.415840+0000","last_unstale":"2024-08-17T02:25:42.416127+0000","last_undegraded":"2024-08-17T02:25:42.416127+0000","last_fullsized":"2024-08-17T02:25:42.416127+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:08.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416977+0000","last_change":"2024-08-17T02:25:41.416977+0000","last_active":"2024-08-17T02:25:41.416977+0000","last_peered":"2024-08-17T02:25:41.416977+0000","last_clean":"2024-08-17T02:25:41.416977+0000","last_became_active":"2024-08-17T02:25:41.416573+0000","last_became_peered":"2024-08-17T02:25:41.416573+0000","last_unstale":"2024-08-17T02:25:41.416977+0000","last_undegraded":"2024-08-17T02:25:41.416977+0000","last_fullsized":"2024-08-17T02:25:41.416977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:14.096901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420814+0000","last_change":"2024-08-17T02:25:42.420814+0000","last_active":"2024-08-17T02:25:42.420814+0000","last_peered":"2024-08-17T02:25:42.420814+0000","last_clean":"2024-08-17T02:25:42.420814+0000","last_became_active":"2024-08-17T02:25:42.420331+0000","last_became_peered":"2024-08-17T02:25:42.420331+0000","last_unstale":"2024-08-17T02:25:42.420814+0000","last_undegraded":"2024-08-17T02:25:42.420814+0000","last_fullsized":"2024-08-17T02:25:42.420814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:22.274775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433174+0000","last_change":"2024-08-17T02:25:41.406456+0000","last_active":"2024-08-17T02:25:42.433174+0000","last_peered":"2024-08-17T02:25:42.433174+0000","last_clean":"2024-08-17T02:25:42.433174+0000","last_became_active":"2024-08-17T02:25:41.406085+0000","last_became_peered":"2024-08-17T02:25:41.406085+0000","last_unstale":"2024-08-17T02:25:42.433174+0000","last_undegraded":"2024-08-17T02:25:42.433174+0000","last_fullsized":"2024-08-17T02:25:42.433174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:40.187213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419317+0000","last_change":"2024-08-17T02:25:42.419317+0000","last_active":"2024-08-17T02:25:42.419317+0000","last_peered":"2024-08-17T02:25:42.419317+0000","last_clean":"2024-08-17T02:25:42.419317+0000","last_became_active":"2024-08-17T02:25:42.418969+0000","last_became_peered":"2024-08-17T02:25:42.418969+0000","last_unstale":"2024-08-17T02:25:42.419317+0000","last_undegraded":"2024-08-17T02:25:42.419317+0000","last_fullsized":"2024-08-17T02:25:42.419317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:50.507537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434765+0000","last_change":"2024-08-17T02:25:41.419970+0000","last_active":"2024-08-17T02:25:42.434765+0000","last_peered":"2024-08-17T02:25:42.434765+0000","last_clean":"2024-08-17T02:25:42.434765+0000","last_became_active":"2024-08-17T02:25:41.419704+0000","last_became_peered":"2024-08-17T02:25:41.419704+0000","last_unstale":"2024-08-17T02:25:42.434765+0000","last_undegraded":"2024-08-17T02:25:42.434765+0000","last_fullsized":"2024-08-17T02:25:42.434765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:01.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416809+0000","last_change":"2024-08-17T02:25:42.416809+0000","last_active":"2024-08-17T02:25:42.416809+0000","last_peered":"2024-08-17T02:25:42.416809+0000","last_clean":"2024-08-17T02:25:42.416809+0000","last_became_active":"2024-08-17T02:25:42.416549+0000","last_became_peered":"2024-08-17T02:25:42.416549+0000","last_unstale":"2024-08-17T02:25:42.416809+0000","last_undegraded":"2024-08-17T02:25:42.416809+0000","last_fullsized":"2024-08-17T02:25:42.416809+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:18.471103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433055+0000","last_change":"2024-08-17T02:25:41.415123+0000","last_active":"2024-08-17T02:25:42.433055+0000","last_peered":"2024-08-17T02:25:42.433055+0000","last_clean":"2024-08-17T02:25:42.433055+0000","last_became_active":"2024-08-17T02:25:41.414783+0000","last_became_peered":"2024-08-17T02:25:41.414783+0000","last_unstale":"2024-08-17T02:25:42.433055+0000","last_undegraded":"2024-08-17T02:25:42.433055+0000","last_fullsized":"2024-08-17T02:25:42.433055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:06.176945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418728+0000","last_change":"2024-08-17T02:25:42.418728+0000","last_active":"2024-08-17T02:25:42.418728+0000","last_peered":"2024-08-17T02:25:42.418728+0000","last_clean":"2024-08-17T02:25:42.418728+0000","last_became_active":"2024-08-17T02:25:42.418446+0000","last_became_peered":"2024-08-17T02:25:42.418446+0000","last_unstale":"2024-08-17T02:25:42.418728+0000","last_undegraded":"2024-08-17T02:25:42.418728+0000","last_fullsized":"2024-08-17T02:25:42.418728+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:42.876425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.422123+0000","last_change":"2024-08-17T02:25:41.417738+0000","last_active":"2024-08-17T02:25:41.422123+0000","last_peered":"2024-08-17T02:25:41.422123+0000","last_clean":"2024-08-17T02:25:41.422123+0000","last_became_active":"2024-08-17T02:25:41.417458+0000","last_became_peered":"2024-08-17T02:25:41.417458+0000","last_unstale":"2024-08-17T02:25:41.422123+0000","last_undegraded":"2024-08-17T02:25:41.422123+0000","last_fullsized":"2024-08-17T02:25:41.422123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:42.545781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.426300+0000","last_change":"2024-08-17T02:25:42.426300+0000","last_active":"2024-08-17T02:25:42.426300+0000","last_peered":"2024-08-17T02:25:42.426300+0000","last_clean":"2024-08-17T02:25:42.426300+0000","last_became_active":"2024-08-17T02:25:42.425814+0000","last_became_peered":"2024-08-17T02:25:42.425814+0000","last_unstale":"2024-08-17T02:25:42.426300+0000","last_undegraded":"2024-08-17T02:25:42.426300+0000","last_fullsized":"2024-08-17T02:25:42.426300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.419395+0000","last_change":"2024-08-17T02:25:41.412269+0000","last_active":"2024-08-17T02:25:41.419395+0000","last_peered":"2024-08-17T02:25:41.419395+0000","last_clean":"2024-08-17T02:25:41.419395+0000","last_became_active":"2024-08-17T02:25:41.411996+0000","last_became_peered":"2024-08-17T02:25:41.411996+0000","last_unstale":"2024-08-17T02:25:41.419395+0000","last_undegraded":"2024-08-17T02:25:41.419395+0000","last_fullsized":"2024-08-17T02:25:41.419395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:26.990290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421316+0000","last_change":"2024-08-17T02:25:42.421316+0000","last_active":"2024-08-17T02:25:42.421316+0000","last_peered":"2024-08-17T02:25:42.421316+0000","last_clean":"2024-08-17T02:25:42.421316+0000","last_became_active":"2024-08-17T02:25:42.421027+0000","last_became_peered":"2024-08-17T02:25:42.421027+0000","last_unstale":"2024-08-17T02:25:42.421316+0000","last_undegraded":"2024-08-17T02:25:42.421316+0000","last_fullsized":"2024-08-17T02:25:42.421316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:22.274775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434466+0000","last_change":"2024-08-17T02:25:41.417196+0000","last_active":"2024-08-17T02:25:42.434466+0000","last_peered":"2024-08-17T02:25:42.434466+0000","last_clean":"2024-08-17T02:25:42.434466+0000","last_became_active":"2024-08-17T02:25:41.416884+0000","last_became_peered":"2024-08-17T02:25:41.416884+0000","last_unstale":"2024-08-17T02:25:42.434466+0000","last_undegraded":"2024-08-17T02:25:42.434466+0000","last_fullsized":"2024-08-17T02:25:42.434466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:51.323262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419706+0000","last_change":"2024-08-17T02:25:42.419706+0000","last_active":"2024-08-17T02:25:42.419706+0000","last_peered":"2024-08-17T02:25:42.419706+0000","last_clean":"2024-08-17T02:25:42.419706+0000","last_became_active":"2024-08-17T02:25:42.419419+0000","last_became_peered":"2024-08-17T02:25:42.419419+0000","last_unstale":"2024-08-17T02:25:42.419706+0000","last_undegraded":"2024-08-17T02:25:42.419706+0000","last_fullsized":"2024-08-17T02:25:42.419706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:45.898859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.401468+0000","last_change":"2024-08-17T02:25:41.413608+0000","last_active":"2024-08-17T02:25:42.401468+0000","last_peered":"2024-08-17T02:25:42.401468+0000","last_clean":"2024-08-17T02:25:42.401468+0000","last_became_active":"2024-08-17T02:25:41.413299+0000","last_became_peered":"2024-08-17T02:25:41.413299+0000","last_unstale":"2024-08-17T02:25:42.401468+0000","last_undegraded":"2024-08-17T02:25:42.401468+0000","last_fullsized":"2024-08-17T02:25:42.401468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:59.656053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429851+0000","last_change":"2024-08-17T02:25:42.429851+0000","last_active":"2024-08-17T02:25:42.429851+0000","last_peered":"2024-08-17T02:25:42.429851+0000","last_clean":"2024-08-17T02:25:42.429851+0000","last_became_active":"2024-08-17T02:25:42.429575+0000","last_became_peered":"2024-08-17T02:25:42.429575+0000","last_unstale":"2024-08-17T02:25:42.429851+0000","last_undegraded":"2024-08-17T02:25:42.429851+0000","last_fullsized":"2024-08-17T02:25:42.429851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:33.834531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433034+0000","last_change":"2024-08-17T02:25:41.416074+0000","last_active":"2024-08-17T02:25:42.433034+0000","last_peered":"2024-08-17T02:25:42.433034+0000","last_clean":"2024-08-17T02:25:42.433034+0000","last_became_active":"2024-08-17T02:25:41.415694+0000","last_became_peered":"2024-08-17T02:25:41.415694+0000","last_unstale":"2024-08-17T02:25:42.433034+0000","last_undegraded":"2024-08-17T02:25:42.433034+0000","last_fullsized":"2024-08-17T02:25:42.433034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:14.811773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404286+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:55.604947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.405428+0000","last_change":"2024-08-17T02:25:41.411845+0000","last_active":"2024-08-17T02:25:42.405428+0000","last_peered":"2024-08-17T02:25:42.405428+0000","last_clean":"2024-08-17T02:25:42.405428+0000","last_became_active":"2024-08-17T02:25:41.410319+0000","last_became_peered":"2024-08-17T02:25:41.410319+0000","last_unstale":"2024-08-17T02:25:42.405428+0000","last_undegraded":"2024-08-17T02:25:42.405428+0000","last_fullsized":"2024-08-17T02:25:42.405428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:26.741363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.410194+0000","last_change":"2024-08-17T02:25:42.410194+0000","last_active":"2024-08-17T02:25:42.410194+0000","last_peered":"2024-08-17T02:25:42.410194+0000","last_clean":"2024-08-17T02:25:42.410194+0000","last_became_active":"2024-08-17T02:25:42.409899+0000","last_became_peered":"2024-08-17T02:25:42.409899+0000","last_unstale":"2024-08-17T02:25:42.410194+0000","last_undegraded":"2024-08-17T02:25:42.410194+0000","last_fullsized":"2024-08-17T02:25:42.410194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:02.087099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.412888+0000","last_change":"2024-08-17T02:25:41.408140+0000","last_active":"2024-08-17T02:25:41.412888+0000","last_peered":"2024-08-17T02:25:41.412888+0000","last_clean":"2024-08-17T02:25:41.412888+0000","last_became_active":"2024-08-17T02:25:41.407869+0000","last_became_peered":"2024-08-17T02:25:41.407869+0000","last_unstale":"2024-08-17T02:25:41.412888+0000","last_undegraded":"2024-08-17T02:25:41.412888+0000","last_fullsized":"2024-08-17T02:25:41.412888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:22.195354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.407511+0000","last_change":"2024-08-17T02:25:42.407511+0000","last_active":"2024-08-17T02:25:42.407511+0000","last_peered":"2024-08-17T02:25:42.407511+0000","last_clean":"2024-08-17T02:25:42.407511+0000","last_became_active":"2024-08-17T02:25:42.407273+0000","last_became_peered":"2024-08-17T02:25:42.407273+0000","last_unstale":"2024-08-17T02:25:42.407511+0000","last_undegraded":"2024-08-17T02:25:42.407511+0000","last_fullsized":"2024-08-17T02:25:42.407511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:09.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.420302+0000","last_change":"2024-08-17T02:25:41.420302+0000","last_active":"2024-08-17T02:25:41.420302+0000","last_peered":"2024-08-17T02:25:41.420302+0000","last_clean":"2024-08-17T02:25:41.420302+0000","last_became_active":"2024-08-17T02:25:41.419958+0000","last_became_peered":"2024-08-17T02:25:41.419958+0000","last_unstale":"2024-08-17T02:25:41.420302+0000","last_undegraded":"2024-08-17T02:25:41.420302+0000","last_fullsized":"2024-08-17T02:25:41.420302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:53.300389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.407078+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:14.445941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416402+0000","last_change":"2024-08-17T02:25:41.412762+0000","last_active":"2024-08-17T02:25:41.416402+0000","last_peered":"2024-08-17T02:25:41.416402+0000","last_clean":"2024-08-17T02:25:41.416402+0000","last_became_active":"2024-08-17T02:25:41.412398+0000","last_became_peered":"2024-08-17T02:25:41.412398+0000","last_unstale":"2024-08-17T02:25:41.416402+0000","last_undegraded":"2024-08-17T02:25:41.416402+0000","last_fullsized":"2024-08-17T02:25:41.416402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:01.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422487+0000","last_change":"2024-08-17T02:25:42.422487+0000","last_active":"2024-08-17T02:25:42.422487+0000","last_peered":"2024-08-17T02:25:42.422487+0000","last_clean":"2024-08-17T02:25:42.422487+0000","last_became_active":"2024-08-17T02:25:42.422179+0000","last_became_peered":"2024-08-17T02:25:42.422179+0000","last_unstale":"2024-08-17T02:25:42.422487+0000","last_undegraded":"2024-08-17T02:25:42.422487+0000","last_fullsized":"2024-08-17T02:25:42.422487+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.411049+0000","last_change":"2024-08-17T02:25:41.408829+0000","last_active":"2024-08-17T02:25:41.411049+0000","last_peered":"2024-08-17T02:25:41.411049+0000","last_clean":"2024-08-17T02:25:41.411049+0000","last_became_active":"2024-08-17T02:25:41.408507+0000","last_became_peered":"2024-08-17T02:25:41.408507+0000","last_unstale":"2024-08-17T02:25:41.411049+0000","last_undegraded":"2024-08-17T02:25:41.411049+0000","last_fullsized":"2024-08-17T02:25:41.411049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:55.936904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.428934+0000","last_change":"2024-08-17T02:25:42.428934+0000","last_active":"2024-08-17T02:25:42.428934+0000","last_peered":"2024-08-17T02:25:42.428934+0000","last_clean":"2024-08-17T02:25:42.428934+0000","last_became_active":"2024-08-17T02:25:42.428579+0000","last_became_peered":"2024-08-17T02:25:42.428579+0000","last_unstale":"2024-08-17T02:25:42.428934+0000","last_undegraded":"2024-08-17T02:25:42.428934+0000","last_fullsized":"2024-08-17T02:25:42.428934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:01:35.750552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.405319+0000","last_change":"2024-08-17T02:25:41.404004+0000","last_active":"2024-08-17T02:25:41.405319+0000","last_peered":"2024-08-17T02:25:41.405319+0000","last_clean":"2024-08-17T02:25:41.405319+0000","last_became_active":"2024-08-17T02:25:41.403735+0000","last_became_peered":"2024-08-17T02:25:41.403735+0000","last_unstale":"2024-08-17T02:25:41.405319+0000","last_undegraded":"2024-08-17T02:25:41.405319+0000","last_fullsized":"2024-08-17T02:25:41.405319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:42.545781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.408344+0000","last_change":"2024-08-17T02:25:42.408344+0000","last_active":"2024-08-17T02:25:42.408344+0000","last_peered":"2024-08-17T02:25:42.408344+0000","last_clean":"2024-08-17T02:25:42.408344+0000","last_became_active":"2024-08-17T02:25:42.408053+0000","last_became_peered":"2024-08-17T02:25:42.408053+0000","last_unstale":"2024-08-17T02:25:42.408344+0000","last_undegraded":"2024-08-17T02:25:42.408344+0000","last_fullsized":"2024-08-17T02:25:42.408344+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:57.975103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.432007+0000","last_change":"2024-08-17T02:25:41.411005+0000","last_active":"2024-08-17T02:25:42.432007+0000","last_peered":"2024-08-17T02:25:42.432007+0000","last_clean":"2024-08-17T02:25:42.432007+0000","last_became_active":"2024-08-17T02:25:41.410680+0000","last_became_peered":"2024-08-17T02:25:41.410680+0000","last_unstale":"2024-08-17T02:25:42.432007+0000","last_undegraded":"2024-08-17T02:25:42.432007+0000","last_fullsized":"2024-08-17T02:25:42.432007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:41.995822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.408871+0000","last_change":"2024-08-17T02:25:42.408871+0000","last_active":"2024-08-17T02:25:42.408871+0000","last_peered":"2024-08-17T02:25:42.408871+0000","last_clean":"2024-08-17T02:25:42.408871+0000","last_became_active":"2024-08-17T02:25:42.408058+0000","last_became_peered":"2024-08-17T02:25:42.408058+0000","last_unstale":"2024-08-17T02:25:42.408871+0000","last_undegraded":"2024-08-17T02:25:42.408871+0000","last_fullsized":"2024-08-17T02:25:42.408871+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:41.832444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.415141+0000","last_change":"2024-08-17T02:25:41.415141+0000","last_active":"2024-08-17T02:25:41.415141+0000","last_peered":"2024-08-17T02:25:41.415141+0000","last_clean":"2024-08-17T02:25:41.415141+0000","last_became_active":"2024-08-17T02:25:41.414871+0000","last_became_peered":"2024-08-17T02:25:41.414871+0000","last_unstale":"2024-08-17T02:25:41.415141+0000","last_undegraded":"2024-08-17T02:25:41.415141+0000","last_fullsized":"2024-08-17T02:25:41.415141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:15.442741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418873+0000","last_change":"2024-08-17T02:25:42.418873+0000","last_active":"2024-08-17T02:25:42.418873+0000","last_peered":"2024-08-17T02:25:42.418873+0000","last_clean":"2024-08-17T02:25:42.418873+0000","last_became_active":"2024-08-17T02:25:42.418596+0000","last_became_peered":"2024-08-17T02:25:42.418596+0000","last_unstale":"2024-08-17T02:25:42.418873+0000","last_undegraded":"2024-08-17T02:25:42.418873+0000","last_fullsized":"2024-08-17T02:25:42.418873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:43.004563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.407774+0000","last_change":"2024-08-17T02:25:41.406162+0000","last_active":"2024-08-17T02:25:41.407774+0000","last_peered":"2024-08-17T02:25:41.407774+0000","last_clean":"2024-08-17T02:25:41.407774+0000","last_became_active":"2024-08-17T02:25:41.405855+0000","last_became_peered":"2024-08-17T02:25:41.405855+0000","last_unstale":"2024-08-17T02:25:41.407774+0000","last_undegraded":"2024-08-17T02:25:41.407774+0000","last_fullsized":"2024-08-17T02:25:41.407774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:05.947031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423499+0000","last_change":"2024-08-17T02:25:42.423499+0000","last_active":"2024-08-17T02:25:42.423499+0000","last_peered":"2024-08-17T02:25:42.423499+0000","last_clean":"2024-08-17T02:25:42.423499+0000","last_became_active":"2024-08-17T02:25:42.423157+0000","last_became_peered":"2024-08-17T02:25:42.423157+0000","last_unstale":"2024-08-17T02:25:42.423499+0000","last_undegraded":"2024-08-17T02:25:42.423499+0000","last_fullsized":"2024-08-17T02:25:42.423499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:47.035562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416353+0000","last_change":"2024-08-17T02:25:41.411329+0000","last_active":"2024-08-17T02:25:41.416353+0000","last_peered":"2024-08-17T02:25:41.416353+0000","last_clean":"2024-08-17T02:25:41.416353+0000","last_became_active":"2024-08-17T02:25:41.410916+0000","last_became_peered":"2024-08-17T02:25:41.410916+0000","last_unstale":"2024-08-17T02:25:41.416353+0000","last_undegraded":"2024-08-17T02:25:41.416353+0000","last_fullsized":"2024-08-17T02:25:41.416353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:56.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416987+0000","last_change":"2024-08-17T02:25:42.416987+0000","last_active":"2024-08-17T02:25:42.416987+0000","last_peered":"2024-08-17T02:25:42.416987+0000","last_clean":"2024-08-17T02:25:42.416987+0000","last_became_active":"2024-08-17T02:25:42.416662+0000","last_became_peered":"2024-08-17T02:25:42.416662+0000","last_unstale":"2024-08-17T02:25:42.416987+0000","last_undegraded":"2024-08-17T02:25:42.416987+0000","last_fullsized":"2024-08-17T02:25:42.416987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:00.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416400+0000","last_change":"2024-08-17T02:25:41.411479+0000","last_active":"2024-08-17T02:25:41.416400+0000","last_peered":"2024-08-17T02:25:41.416400+0000","last_clean":"2024-08-17T02:25:41.416400+0000","last_became_active":"2024-08-17T02:25:41.411185+0000","last_became_peered":"2024-08-17T02:25:41.411185+0000","last_unstale":"2024-08-17T02:25:41.416400+0000","last_undegraded":"2024-08-17T02:25:41.416400+0000","last_fullsized":"2024-08-17T02:25:41.416400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:14.811773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.426045+0000","last_change":"2024-08-17T02:25:42.426045+0000","last_active":"2024-08-17T02:25:42.426045+0000","last_peered":"2024-08-17T02:25:42.426045+0000","last_clean":"2024-08-17T02:25:42.426045+0000","last_became_active":"2024-08-17T02:25:42.425767+0000","last_became_peered":"2024-08-17T02:25:42.425767+0000","last_unstale":"2024-08-17T02:25:42.426045+0000","last_undegraded":"2024-08-17T02:25:42.426045+0000","last_fullsized":"2024-08-17T02:25:42.426045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:54.517688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.417303+0000","last_change":"2024-08-17T02:25:41.416245+0000","last_active":"2024-08-17T02:25:41.417303+0000","last_peered":"2024-08-17T02:25:41.417303+0000","last_clean":"2024-08-17T02:25:41.417303+0000","last_became_active":"2024-08-17T02:25:41.415762+0000","last_became_peered":"2024-08-17T02:25:41.415762+0000","last_unstale":"2024-08-17T02:25:41.417303+0000","last_undegraded":"2024-08-17T02:25:41.417303+0000","last_fullsized":"2024-08-17T02:25:41.417303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:05.947031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.409630+0000","last_change":"2024-08-17T02:25:42.409630+0000","last_active":"2024-08-17T02:25:42.409630+0000","last_peered":"2024-08-17T02:25:42.409630+0000","last_clean":"2024-08-17T02:25:42.409630+0000","last_became_active":"2024-08-17T02:25:42.409370+0000","last_became_peered":"2024-08-17T02:25:42.409370+0000","last_unstale":"2024-08-17T02:25:42.409630+0000","last_undegraded":"2024-08-17T02:25:42.409630+0000","last_fullsized":"2024-08-17T02:25:42.409630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:42.876425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.419542+0000","last_change":"2024-08-17T02:25:41.413754+0000","last_active":"2024-08-17T02:25:41.419542+0000","last_peered":"2024-08-17T02:25:41.419542+0000","last_clean":"2024-08-17T02:25:41.419542+0000","last_became_active":"2024-08-17T02:25:41.413461+0000","last_became_peered":"2024-08-17T02:25:41.413461+0000","last_unstale":"2024-08-17T02:25:41.419542+0000","last_undegraded":"2024-08-17T02:25:41.419542+0000","last_fullsized":"2024-08-17T02:25:41.419542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:21.125266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422150+0000","last_change":"2024-08-17T02:25:42.422150+0000","last_active":"2024-08-17T02:25:42.422150+0000","last_peered":"2024-08-17T02:25:42.422150+0000","last_clean":"2024-08-17T02:25:42.422150+0000","last_became_active":"2024-08-17T02:25:42.409094+0000","last_became_peered":"2024-08-17T02:25:42.409094+0000","last_unstale":"2024-08-17T02:25:42.422150+0000","last_undegraded":"2024-08-17T02:25:42.422150+0000","last_fullsized":"2024-08-17T02:25:42.422150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:44.235619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.415642+0000","last_change":"2024-08-17T02:25:41.413342+0000","last_active":"2024-08-17T02:25:41.415642+0000","last_peered":"2024-08-17T02:25:41.415642+0000","last_clean":"2024-08-17T02:25:41.415642+0000","last_became_active":"2024-08-17T02:25:41.411807+0000","last_became_peered":"2024-08-17T02:25:41.411807+0000","last_unstale":"2024-08-17T02:25:41.415642+0000","last_undegraded":"2024-08-17T02:25:41.415642+0000","last_fullsized":"2024-08-17T02:25:41.415642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:58.112071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.397663+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:25:41.397663+0000","last_peered":"2024-08-17T02:25:41.397663+0000","last_clean":"2024-08-17T02:25:41.397663+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:25:41.397663+0000","last_undegraded":"2024-08-17T02:25:41.397663+0000","last_fullsized":"2024-08-17T02:25:41.397663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":393216,"data_stored":149055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.804},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.66300000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.746},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.0449999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":2.0259999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.099}]},{"osd":6,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.165},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":2.073}]}]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297748,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074092,"statfs":{"total":96636764160,"available":96331870208,"internally_reserved":0,"allocated":401408,"data_stored":150585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.008}]},{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.083}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.85599999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.1739999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.212},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.2330000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.135}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.113},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1799999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.0549999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0840000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297760,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074080,"statfs":{"total":96636764160,"available":96331857920,"internally_reserved":0,"allocated":405504,"data_stored":149797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.82699999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.78300000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.621},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.74399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.296}]},{"osd":5,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.3640000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.391},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.337}]},{"osd":7,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.47}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.75700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.44},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.91200000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.099}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":970752,"data_stored":732638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.95199999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.083},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.89600000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.02}]},{"osd":7,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.137},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1719999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.1140000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.014},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.79300000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.208}]},{"osd":4,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.054}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.25},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.325}]},{"osd":6,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.399},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.2769999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.361},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.304}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":958464,"data_stored":726375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.60699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.026},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.91700000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.0609999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.115}]},{"osd":7,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.135},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.095}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:45.448 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:45.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.553+0000 7f5867fff700 1 Processor -- start 2024-08-17T02:25:45.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.553+0000 7f5867fff700 1 -- start start 2024-08-17T02:25:45.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58680ad6f0 0x7f58680adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f586815b740 0x7f586815bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586815b2b0 con 0x7f586815ce20 2024-08-17T02:25:45.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58680ae410 con 0x7f586815b740 2024-08-17T02:25:45.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586815aca0 con 0x7f58680ad6f0 2024-08-17T02:25:45.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5866ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f586815ce20 0x7f586815d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50250/0 (socket says 172.21.15.31:50250) 2024-08-17T02:25:45.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5866ffd700 1 -- 172.21.15.31:0/2531483108 learned_addr learned my addr 172.21.15.31:0/2531483108 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:45.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f58667fc700 1 --2- 172.21.15.31:0/2531483108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58680ad6f0 0x7f58680adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f58677fe700 1 --2- 172.21.15.31:0/2531483108 >> v2:172.21.15.92:3300/0 conn(0x7f586815b740 0x7f586815bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5865ffb700 1 -- 172.21.15.31:0/2531483108 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206678392 0 0) 0x7f586815b2b0 con 0x7f586815ce20 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5865ffb700 1 -- 172.21.15.31:0/2531483108 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5850003570 con 0x7f586815ce20 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f58677fe700 1 -- 172.21.15.31:0/2531483108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58680ad6f0 msgr2=0x7f58680adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f58677fe700 1 --2- 172.21.15.31:0/2531483108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58680ad6f0 0x7f58680adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f58677fe700 1 -- 172.21.15.31:0/2531483108 >> v1:172.21.15.31:6789/0 conn(0x7f586815ce20 legacy=0x7f586815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f58677fe700 1 -- 172.21.15.31:0/2531483108 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680ae6b0 con 0x7f586815b740 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f58677fe700 1 --2- 172.21.15.31:0/2531483108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f586815b740 0x7f586815bbc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5860009e60 tx=0x7f5860009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f97f1e51ab468bc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5865ffb700 1 -- 172.21.15.31:0/2531483108 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000e070 con 0x7f586815b740 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5865ffb700 1 -- 172.21.15.31:0/2531483108 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000bab0 con 0x7f586815b740 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5865ffb700 1 -- 172.21.15.31:0/2531483108 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000be70 con 0x7f586815b740 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 -- 172.21.15.31:0/2531483108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f586815b740 msgr2=0x7f586815bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 --2- 172.21.15.31:0/2531483108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f586815b740 0x7f586815bbc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5860009e60 tx=0x7f5860009780 comp rx=0 tx=0).stop 2024-08-17T02:25:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 -- 172.21.15.31:0/2531483108 shutdown_connections 2024-08-17T02:25:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 --2- 172.21.15.31:0/2531483108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f586815b740 0x7f586815bbc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 --2- 172.21.15.31:0/2531483108 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f58680ad6f0 0x7f58680adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 -- 172.21.15.31:0/2531483108 >> 172.21.15.31:0/2531483108 conn(0x7f5868089cb0 msgr2=0x7f58680995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 -- 172.21.15.31:0/2531483108 shutdown_connections 2024-08-17T02:25:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.557+0000 7f5867fff700 1 -- 172.21.15.31:0/2531483108 wait complete. 2024-08-17T02:25:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5867fff700 1 Processor -- start 2024-08-17T02:25:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5867fff700 1 -- start start 2024-08-17T02:25:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5867fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58680ad6f0 0x7f5868152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5867fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f586815b740 0x7f586815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5867fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f586815ce20 0x7f586815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5867fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586816a6c0 con 0x7f58680ad6f0 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5867fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58681534a0 con 0x7f586815ce20 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5867fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586816a3e0 con 0x7f586815b740 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5866ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58680ad6f0 0x7f5868152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5866ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58680ad6f0 0x7f5868152880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39718/0 (socket says 172.21.15.31:39718) 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5866ffd700 1 -- 172.21.15.31:0/396872450 learned_addr learned my addr 172.21.15.31:0/396872450 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f58677fe700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f586815ce20 0x7f586815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f58667fc700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f586815b740 0x7f586815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5866ffd700 1 -- 172.21.15.31:0/396872450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f586815b740 msgr2=0x7f586815bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5866ffd700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f586815b740 0x7f586815bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5866ffd700 1 -- 172.21.15.31:0/396872450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f586815ce20 msgr2=0x7f586815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5866ffd700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f586815ce20 0x7f586815c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f5866ffd700 1 -- 172.21.15.31:0/396872450 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5860009a20 con 0x7f58680ad6f0 2024-08-17T02:25:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.561+0000 7f58667fc700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f586815b740 0x7f586815bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f5866ffd700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58680ad6f0 0x7f5868152880 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f585c00c7f0 tx=0x7f585c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f584effd700 1 -- 172.21.15.31:0/396872450 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c005b30 con 0x7f58680ad6f0 2024-08-17T02:25:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f584effd700 1 -- 172.21.15.31:0/396872450 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c005cb0 con 0x7f58680ad6f0 2024-08-17T02:25:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f5867fff700 1 -- 172.21.15.31:0/396872450 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586816cee0 con 0x7f58680ad6f0 2024-08-17T02:25:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f584effd700 1 -- 172.21.15.31:0/396872450 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c007320 con 0x7f58680ad6f0 2024-08-17T02:25:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f5867fff700 1 -- 172.21.15.31:0/396872450 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586816d4a0 con 0x7f58680ad6f0 2024-08-17T02:25:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f5867fff700 1 -- 172.21.15.31:0/396872450 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586816cd40 con 0x7f58680ad6f0 2024-08-17T02:25:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f584effd700 1 -- 172.21.15.31:0/396872450 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f585c01b3b0 con 0x7f58680ad6f0 2024-08-17T02:25:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f584effd700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5854060860 0x7f5854062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f584effd700 1 -- 172.21.15.31:0/396872450 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f585c07c100 con 0x7f58680ad6f0 2024-08-17T02:25:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.565+0000 7f58667fc700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5854060860 0x7f5854062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.569+0000 7f58667fc700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5854060860 0x7f5854062d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f586815a810 tx=0x7f5858008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.573+0000 7f584effd700 1 -- 172.21.15.31:0/396872450 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f586816cd40 con 0x7f58680ad6f0 2024-08-17T02:25:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.729+0000 7f5867fff700 1 -- 172.21.15.31:0/396872450 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f586816cd40 con 0x7f5854060860 2024-08-17T02:25:45.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.737+0000 7f584effd700 1 -- 172.21.15.31:0/396872450 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287047 (secure 0 0 0) 0x7f586816cd40 con 0x7f5854060860 2024-08-17T02:25:45.746 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 -- 172.21.15.31:0/396872450 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5854060860 msgr2=0x7f5854062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5854060860 0x7f5854062d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f586815a810 tx=0x7f5858008040 comp rx=0 tx=0).stop 2024-08-17T02:25:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 -- 172.21.15.31:0/396872450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58680ad6f0 msgr2=0x7f5868152880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58680ad6f0 0x7f5868152880 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f585c00c7f0 tx=0x7f585c007e00 comp rx=0 tx=0).stop 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 -- 172.21.15.31:0/396872450 shutdown_connections 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5854060860 0x7f5854062d10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f586815ce20 0x7f586815c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f586815b740 0x7f586815bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 --2- 172.21.15.31:0/396872450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58680ad6f0 0x7f5868152880 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 -- 172.21.15.31:0/396872450 >> 172.21.15.31:0/396872450 conn(0x7f5868089cb0 msgr2=0x7f5868153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 -- 172.21.15.31:0/396872450 shutdown_connections 2024-08-17T02:25:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.745+0000 7f5867fff700 1 -- 172.21.15.31:0/396872450 wait complete. 2024-08-17T02:25:45.750 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:25:45.761 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-08-17T02:25:45.600424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387188,"kb_used_data":4160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587532,"statfs":{"total":773094113280,"available":770649632768,"internally_reserved":0,"allocated":4259840,"data_stored":2335260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.219919"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429866+0000","last_change":"2024-08-17T02:25:42.429866+0000","last_active":"2024-08-17T02:25:42.429866+0000","last_peered":"2024-08-17T02:25:42.429866+0000","last_clean":"2024-08-17T02:25:42.429866+0000","last_became_active":"2024-08-17T02:25:42.429589+0000","last_became_peered":"2024-08-17T02:25:42.429589+0000","last_unstale":"2024-08-17T02:25:42.429866+0000","last_undegraded":"2024-08-17T02:25:42.429866+0000","last_fullsized":"2024-08-17T02:25:42.429866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404932+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:07.672234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418423+0000","last_change":"2024-08-17T02:25:42.418423+0000","last_active":"2024-08-17T02:25:42.418423+0000","last_peered":"2024-08-17T02:25:42.418423+0000","last_clean":"2024-08-17T02:25:42.418423+0000","last_became_active":"2024-08-17T02:25:42.418156+0000","last_became_peered":"2024-08-17T02:25:42.418156+0000","last_unstale":"2024-08-17T02:25:42.418423+0000","last_undegraded":"2024-08-17T02:25:42.418423+0000","last_fullsized":"2024-08-17T02:25:42.418423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:43.004563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420792+0000","last_change":"2024-08-17T02:25:42.420792+0000","last_active":"2024-08-17T02:25:42.420792+0000","last_peered":"2024-08-17T02:25:42.420792+0000","last_clean":"2024-08-17T02:25:42.420792+0000","last_became_active":"2024-08-17T02:25:42.420383+0000","last_became_peered":"2024-08-17T02:25:42.420383+0000","last_unstale":"2024-08-17T02:25:42.420792+0000","last_undegraded":"2024-08-17T02:25:42.420792+0000","last_fullsized":"2024-08-17T02:25:42.420792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:45.898859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.407547+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:49:35.652729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417300+0000","last_change":"2024-08-17T02:25:42.417300+0000","last_active":"2024-08-17T02:25:42.417300+0000","last_peered":"2024-08-17T02:25:42.417300+0000","last_clean":"2024-08-17T02:25:42.417300+0000","last_became_active":"2024-08-17T02:25:42.417005+0000","last_became_peered":"2024-08-17T02:25:42.417005+0000","last_unstale":"2024-08-17T02:25:42.417300+0000","last_undegraded":"2024-08-17T02:25:42.417300+0000","last_fullsized":"2024-08-17T02:25:42.417300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:35.329338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416534+0000","last_change":"2024-08-17T02:25:42.416534+0000","last_active":"2024-08-17T02:25:42.416534+0000","last_peered":"2024-08-17T02:25:42.416534+0000","last_clean":"2024-08-17T02:25:42.416534+0000","last_became_active":"2024-08-17T02:25:42.416145+0000","last_became_peered":"2024-08-17T02:25:42.416145+0000","last_unstale":"2024-08-17T02:25:42.416534+0000","last_undegraded":"2024-08-17T02:25:42.416534+0000","last_fullsized":"2024-08-17T02:25:42.416534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:36.767291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419906+0000","last_change":"2024-08-17T02:25:42.419906+0000","last_active":"2024-08-17T02:25:42.419906+0000","last_peered":"2024-08-17T02:25:42.419906+0000","last_clean":"2024-08-17T02:25:42.419906+0000","last_became_active":"2024-08-17T02:25:42.419605+0000","last_became_peered":"2024-08-17T02:25:42.419605+0000","last_unstale":"2024-08-17T02:25:42.419906+0000","last_undegraded":"2024-08-17T02:25:42.419906+0000","last_fullsized":"2024-08-17T02:25:42.419906+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:12.438819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418898+0000","last_change":"2024-08-17T02:25:42.418898+0000","last_active":"2024-08-17T02:25:42.418898+0000","last_peered":"2024-08-17T02:25:42.418898+0000","last_clean":"2024-08-17T02:25:42.418898+0000","last_became_active":"2024-08-17T02:25:42.418610+0000","last_became_peered":"2024-08-17T02:25:42.418610+0000","last_unstale":"2024-08-17T02:25:42.418898+0000","last_undegraded":"2024-08-17T02:25:42.418898+0000","last_fullsized":"2024-08-17T02:25:42.418898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:02.087099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416219+0000","last_change":"2024-08-17T02:25:42.416219+0000","last_active":"2024-08-17T02:25:42.416219+0000","last_peered":"2024-08-17T02:25:42.416219+0000","last_clean":"2024-08-17T02:25:42.416219+0000","last_became_active":"2024-08-17T02:25:42.415937+0000","last_became_peered":"2024-08-17T02:25:42.415937+0000","last_unstale":"2024-08-17T02:25:42.416219+0000","last_undegraded":"2024-08-17T02:25:42.416219+0000","last_fullsized":"2024-08-17T02:25:42.416219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:08.435265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421885+0000","last_change":"2024-08-17T02:25:42.421885+0000","last_active":"2024-08-17T02:25:42.421885+0000","last_peered":"2024-08-17T02:25:42.421885+0000","last_clean":"2024-08-17T02:25:42.421885+0000","last_became_active":"2024-08-17T02:25:42.421627+0000","last_became_peered":"2024-08-17T02:25:42.421627+0000","last_unstale":"2024-08-17T02:25:42.421885+0000","last_undegraded":"2024-08-17T02:25:42.421885+0000","last_fullsized":"2024-08-17T02:25:42.421885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:18.458775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.414237+0000","last_change":"2024-08-17T02:25:42.414237+0000","last_active":"2024-08-17T02:25:42.414237+0000","last_peered":"2024-08-17T02:25:42.414237+0000","last_clean":"2024-08-17T02:25:42.414237+0000","last_became_active":"2024-08-17T02:25:42.413842+0000","last_became_peered":"2024-08-17T02:25:42.413842+0000","last_unstale":"2024-08-17T02:25:42.414237+0000","last_undegraded":"2024-08-17T02:25:42.414237+0000","last_fullsized":"2024-08-17T02:25:42.414237+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:04.272280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418431+0000","last_change":"2024-08-17T02:25:42.418431+0000","last_active":"2024-08-17T02:25:42.418431+0000","last_peered":"2024-08-17T02:25:42.418431+0000","last_clean":"2024-08-17T02:25:42.418431+0000","last_became_active":"2024-08-17T02:25:42.418152+0000","last_became_peered":"2024-08-17T02:25:42.418152+0000","last_unstale":"2024-08-17T02:25:42.418431+0000","last_undegraded":"2024-08-17T02:25:42.418431+0000","last_fullsized":"2024-08-17T02:25:42.418431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418167+0000","last_change":"2024-08-17T02:25:42.418167+0000","last_active":"2024-08-17T02:25:42.418167+0000","last_peered":"2024-08-17T02:25:42.418167+0000","last_clean":"2024-08-17T02:25:42.418167+0000","last_became_active":"2024-08-17T02:25:42.417535+0000","last_became_peered":"2024-08-17T02:25:42.417535+0000","last_unstale":"2024-08-17T02:25:42.418167+0000","last_undegraded":"2024-08-17T02:25:42.418167+0000","last_fullsized":"2024-08-17T02:25:42.418167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:22:16.256006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423733+0000","last_change":"2024-08-17T02:25:42.423733+0000","last_active":"2024-08-17T02:25:42.423733+0000","last_peered":"2024-08-17T02:25:42.423733+0000","last_clean":"2024-08-17T02:25:42.423733+0000","last_became_active":"2024-08-17T02:25:42.423437+0000","last_became_peered":"2024-08-17T02:25:42.423437+0000","last_unstale":"2024-08-17T02:25:42.423733+0000","last_undegraded":"2024-08-17T02:25:42.423733+0000","last_fullsized":"2024-08-17T02:25:42.423733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:01.372278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423980+0000","last_change":"2024-08-17T02:25:42.423980+0000","last_active":"2024-08-17T02:25:42.423980+0000","last_peered":"2024-08-17T02:25:42.423980+0000","last_clean":"2024-08-17T02:25:42.423980+0000","last_became_active":"2024-08-17T02:25:42.422527+0000","last_became_peered":"2024-08-17T02:25:42.422527+0000","last_unstale":"2024-08-17T02:25:42.423980+0000","last_undegraded":"2024-08-17T02:25:42.423980+0000","last_fullsized":"2024-08-17T02:25:42.423980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:10.073499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421044+0000","last_change":"2024-08-17T02:25:42.421044+0000","last_active":"2024-08-17T02:25:42.421044+0000","last_peered":"2024-08-17T02:25:42.421044+0000","last_clean":"2024-08-17T02:25:42.421044+0000","last_became_active":"2024-08-17T02:25:42.420760+0000","last_became_peered":"2024-08-17T02:25:42.420760+0000","last_unstale":"2024-08-17T02:25:42.421044+0000","last_undegraded":"2024-08-17T02:25:42.421044+0000","last_fullsized":"2024-08-17T02:25:42.421044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:54.517688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.406076+0000","last_change":"2024-08-17T02:25:42.406076+0000","last_active":"2024-08-17T02:25:42.406076+0000","last_peered":"2024-08-17T02:25:42.406076+0000","last_clean":"2024-08-17T02:25:42.406076+0000","last_became_active":"2024-08-17T02:25:42.405724+0000","last_became_peered":"2024-08-17T02:25:42.405724+0000","last_unstale":"2024-08-17T02:25:42.406076+0000","last_undegraded":"2024-08-17T02:25:42.406076+0000","last_fullsized":"2024-08-17T02:25:42.406076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:15.820514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416984+0000","last_change":"2024-08-17T02:25:42.416984+0000","last_active":"2024-08-17T02:25:42.416984+0000","last_peered":"2024-08-17T02:25:42.416984+0000","last_clean":"2024-08-17T02:25:42.416984+0000","last_became_active":"2024-08-17T02:25:42.415956+0000","last_became_peered":"2024-08-17T02:25:42.415956+0000","last_unstale":"2024-08-17T02:25:42.416984+0000","last_undegraded":"2024-08-17T02:25:42.416984+0000","last_fullsized":"2024-08-17T02:25:42.416984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:06.955772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.407630+0000","last_change":"2024-08-17T02:25:42.407630+0000","last_active":"2024-08-17T02:25:42.407630+0000","last_peered":"2024-08-17T02:25:42.407630+0000","last_clean":"2024-08-17T02:25:42.407630+0000","last_became_active":"2024-08-17T02:25:42.407237+0000","last_became_peered":"2024-08-17T02:25:42.407237+0000","last_unstale":"2024-08-17T02:25:42.407630+0000","last_undegraded":"2024-08-17T02:25:42.407630+0000","last_fullsized":"2024-08-17T02:25:42.407630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:22.134006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.415635+0000","last_change":"2024-08-17T02:25:42.415635+0000","last_active":"2024-08-17T02:25:42.415635+0000","last_peered":"2024-08-17T02:25:42.415635+0000","last_clean":"2024-08-17T02:25:42.415635+0000","last_became_active":"2024-08-17T02:25:42.406945+0000","last_became_peered":"2024-08-17T02:25:42.406945+0000","last_unstale":"2024-08-17T02:25:42.415635+0000","last_undegraded":"2024-08-17T02:25:42.415635+0000","last_fullsized":"2024-08-17T02:25:42.415635+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419390+0000","last_change":"2024-08-17T02:25:42.419390+0000","last_active":"2024-08-17T02:25:42.419390+0000","last_peered":"2024-08-17T02:25:42.419390+0000","last_clean":"2024-08-17T02:25:42.419390+0000","last_became_active":"2024-08-17T02:25:42.419015+0000","last_became_peered":"2024-08-17T02:25:42.419015+0000","last_unstale":"2024-08-17T02:25:42.419390+0000","last_undegraded":"2024-08-17T02:25:42.419390+0000","last_fullsized":"2024-08-17T02:25:42.419390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:53.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416037+0000","last_change":"2024-08-17T02:25:42.416037+0000","last_active":"2024-08-17T02:25:42.416037+0000","last_peered":"2024-08-17T02:25:42.416037+0000","last_clean":"2024-08-17T02:25:42.416037+0000","last_became_active":"2024-08-17T02:25:42.415756+0000","last_became_peered":"2024-08-17T02:25:42.415756+0000","last_unstale":"2024-08-17T02:25:42.416037+0000","last_undegraded":"2024-08-17T02:25:42.416037+0000","last_fullsized":"2024-08-17T02:25:42.416037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:43.554521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421864+0000","last_change":"2024-08-17T02:25:42.421864+0000","last_active":"2024-08-17T02:25:42.421864+0000","last_peered":"2024-08-17T02:25:42.421864+0000","last_clean":"2024-08-17T02:25:42.421864+0000","last_became_active":"2024-08-17T02:25:42.421396+0000","last_became_peered":"2024-08-17T02:25:42.421396+0000","last_unstale":"2024-08-17T02:25:42.421864+0000","last_undegraded":"2024-08-17T02:25:42.421864+0000","last_fullsized":"2024-08-17T02:25:42.421864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:53:59.660258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420428+0000","last_change":"2024-08-17T02:25:42.420428+0000","last_active":"2024-08-17T02:25:42.420428+0000","last_peered":"2024-08-17T02:25:42.420428+0000","last_clean":"2024-08-17T02:25:42.420428+0000","last_became_active":"2024-08-17T02:25:42.419860+0000","last_became_peered":"2024-08-17T02:25:42.419860+0000","last_unstale":"2024-08-17T02:25:42.420428+0000","last_undegraded":"2024-08-17T02:25:42.420428+0000","last_fullsized":"2024-08-17T02:25:42.420428+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:50.507537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.427962+0000","last_change":"2024-08-17T02:25:42.427962+0000","last_active":"2024-08-17T02:25:42.427962+0000","last_peered":"2024-08-17T02:25:42.427962+0000","last_clean":"2024-08-17T02:25:42.427962+0000","last_became_active":"2024-08-17T02:25:42.427683+0000","last_became_peered":"2024-08-17T02:25:42.427683+0000","last_unstale":"2024-08-17T02:25:42.427962+0000","last_undegraded":"2024-08-17T02:25:42.427962+0000","last_fullsized":"2024-08-17T02:25:42.427962+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:39.859919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404414+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:16.638589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417839+0000","last_change":"2024-08-17T02:25:42.417839+0000","last_active":"2024-08-17T02:25:42.417839+0000","last_peered":"2024-08-17T02:25:42.417839+0000","last_clean":"2024-08-17T02:25:42.417839+0000","last_became_active":"2024-08-17T02:25:42.417570+0000","last_became_peered":"2024-08-17T02:25:42.417570+0000","last_unstale":"2024-08-17T02:25:42.417839+0000","last_undegraded":"2024-08-17T02:25:42.417839+0000","last_fullsized":"2024-08-17T02:25:42.417839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:44.235619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417567+0000","last_change":"2024-08-17T02:25:42.417567+0000","last_active":"2024-08-17T02:25:42.417567+0000","last_peered":"2024-08-17T02:25:42.417567+0000","last_clean":"2024-08-17T02:25:42.417567+0000","last_became_active":"2024-08-17T02:25:42.417216+0000","last_became_peered":"2024-08-17T02:25:42.417216+0000","last_unstale":"2024-08-17T02:25:42.417567+0000","last_undegraded":"2024-08-17T02:25:42.417567+0000","last_fullsized":"2024-08-17T02:25:42.417567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:41.195953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422296+0000","last_change":"2024-08-17T02:25:42.422296+0000","last_active":"2024-08-17T02:25:42.422296+0000","last_peered":"2024-08-17T02:25:42.422296+0000","last_clean":"2024-08-17T02:25:42.422296+0000","last_became_active":"2024-08-17T02:25:42.407208+0000","last_became_peered":"2024-08-17T02:25:42.407208+0000","last_unstale":"2024-08-17T02:25:42.422296+0000","last_undegraded":"2024-08-17T02:25:42.422296+0000","last_fullsized":"2024-08-17T02:25:42.422296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420013+0000","last_change":"2024-08-17T02:25:42.420013+0000","last_active":"2024-08-17T02:25:42.420013+0000","last_peered":"2024-08-17T02:25:42.420013+0000","last_clean":"2024-08-17T02:25:42.420013+0000","last_became_active":"2024-08-17T02:25:42.419638+0000","last_became_peered":"2024-08-17T02:25:42.419638+0000","last_unstale":"2024-08-17T02:25:42.420013+0000","last_undegraded":"2024-08-17T02:25:42.420013+0000","last_fullsized":"2024-08-17T02:25:42.420013+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:10.073499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420835+0000","last_change":"2024-08-17T02:25:42.420835+0000","last_active":"2024-08-17T02:25:42.420835+0000","last_peered":"2024-08-17T02:25:42.420835+0000","last_clean":"2024-08-17T02:25:42.420835+0000","last_became_active":"2024-08-17T02:25:42.420623+0000","last_became_peered":"2024-08-17T02:25:42.420623+0000","last_unstale":"2024-08-17T02:25:42.420835+0000","last_undegraded":"2024-08-17T02:25:42.420835+0000","last_fullsized":"2024-08-17T02:25:42.420835+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:08.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.410144+0000","last_change":"2024-08-17T02:25:42.410144+0000","last_active":"2024-08-17T02:25:42.410144+0000","last_peered":"2024-08-17T02:25:42.410144+0000","last_clean":"2024-08-17T02:25:42.410144+0000","last_became_active":"2024-08-17T02:25:42.408813+0000","last_became_peered":"2024-08-17T02:25:42.408813+0000","last_unstale":"2024-08-17T02:25:42.410144+0000","last_undegraded":"2024-08-17T02:25:42.410144+0000","last_fullsized":"2024-08-17T02:25:42.410144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:55.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.436617+0000","last_change":"2024-08-17T02:25:41.414400+0000","last_active":"2024-08-17T02:25:42.436617+0000","last_peered":"2024-08-17T02:25:42.436617+0000","last_clean":"2024-08-17T02:25:42.436617+0000","last_became_active":"2024-08-17T02:25:41.413990+0000","last_became_peered":"2024-08-17T02:25:41.413990+0000","last_unstale":"2024-08-17T02:25:42.436617+0000","last_undegraded":"2024-08-17T02:25:42.436617+0000","last_fullsized":"2024-08-17T02:25:42.436617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:09.064759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417423+0000","last_change":"2024-08-17T02:25:42.417423+0000","last_active":"2024-08-17T02:25:42.417423+0000","last_peered":"2024-08-17T02:25:42.417423+0000","last_clean":"2024-08-17T02:25:42.417423+0000","last_became_active":"2024-08-17T02:25:42.417172+0000","last_became_peered":"2024-08-17T02:25:42.417172+0000","last_unstale":"2024-08-17T02:25:42.417423+0000","last_undegraded":"2024-08-17T02:25:42.417423+0000","last_fullsized":"2024-08-17T02:25:42.417423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:47.035562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.413880+0000","last_change":"2024-08-17T02:25:41.412731+0000","last_active":"2024-08-17T02:25:42.413880+0000","last_peered":"2024-08-17T02:25:42.413880+0000","last_clean":"2024-08-17T02:25:42.413880+0000","last_became_active":"2024-08-17T02:25:41.412451+0000","last_became_peered":"2024-08-17T02:25:41.412451+0000","last_unstale":"2024-08-17T02:25:42.413880+0000","last_undegraded":"2024-08-17T02:25:42.413880+0000","last_fullsized":"2024-08-17T02:25:42.413880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:54.301346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423308+0000","last_change":"2024-08-17T02:25:42.423308+0000","last_active":"2024-08-17T02:25:42.423308+0000","last_peered":"2024-08-17T02:25:42.423308+0000","last_clean":"2024-08-17T02:25:42.423308+0000","last_became_active":"2024-08-17T02:25:42.422988+0000","last_became_peered":"2024-08-17T02:25:42.422988+0000","last_unstale":"2024-08-17T02:25:42.423308+0000","last_undegraded":"2024-08-17T02:25:42.423308+0000","last_fullsized":"2024-08-17T02:25:42.423308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:00:06.810017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434405+0000","last_change":"2024-08-17T02:25:41.414749+0000","last_active":"2024-08-17T02:25:42.434405+0000","last_peered":"2024-08-17T02:25:42.434405+0000","last_clean":"2024-08-17T02:25:42.434405+0000","last_became_active":"2024-08-17T02:25:41.414484+0000","last_became_peered":"2024-08-17T02:25:41.414484+0000","last_unstale":"2024-08-17T02:25:42.434405+0000","last_undegraded":"2024-08-17T02:25:42.434405+0000","last_fullsized":"2024-08-17T02:25:42.434405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:48:43.410239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416685+0000","last_change":"2024-08-17T02:25:42.416685+0000","last_active":"2024-08-17T02:25:42.416685+0000","last_peered":"2024-08-17T02:25:42.416685+0000","last_clean":"2024-08-17T02:25:42.416685+0000","last_became_active":"2024-08-17T02:25:42.416113+0000","last_became_peered":"2024-08-17T02:25:42.416113+0000","last_unstale":"2024-08-17T02:25:42.416685+0000","last_undegraded":"2024-08-17T02:25:42.416685+0000","last_fullsized":"2024-08-17T02:25:42.416685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:41.832444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434872+0000","last_change":"2024-08-17T02:25:41.419882+0000","last_active":"2024-08-17T02:25:42.434872+0000","last_peered":"2024-08-17T02:25:42.434872+0000","last_clean":"2024-08-17T02:25:42.434872+0000","last_became_active":"2024-08-17T02:25:41.419595+0000","last_became_peered":"2024-08-17T02:25:41.419595+0000","last_unstale":"2024-08-17T02:25:42.434872+0000","last_undegraded":"2024-08-17T02:25:42.434872+0000","last_fullsized":"2024-08-17T02:25:42.434872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:28.023006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418376+0000","last_change":"2024-08-17T02:25:42.418376+0000","last_active":"2024-08-17T02:25:42.418376+0000","last_peered":"2024-08-17T02:25:42.418376+0000","last_clean":"2024-08-17T02:25:42.418376+0000","last_became_active":"2024-08-17T02:25:42.417769+0000","last_became_peered":"2024-08-17T02:25:42.417769+0000","last_unstale":"2024-08-17T02:25:42.418376+0000","last_undegraded":"2024-08-17T02:25:42.418376+0000","last_fullsized":"2024-08-17T02:25:42.418376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:57.975103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.412210+0000","last_change":"2024-08-17T02:25:41.413895+0000","last_active":"2024-08-17T02:25:42.412210+0000","last_peered":"2024-08-17T02:25:42.412210+0000","last_clean":"2024-08-17T02:25:42.412210+0000","last_became_active":"2024-08-17T02:25:41.413485+0000","last_became_peered":"2024-08-17T02:25:41.413485+0000","last_unstale":"2024-08-17T02:25:42.412210+0000","last_undegraded":"2024-08-17T02:25:42.412210+0000","last_fullsized":"2024-08-17T02:25:42.412210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:56.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419203+0000","last_change":"2024-08-17T02:25:42.419203+0000","last_active":"2024-08-17T02:25:42.419203+0000","last_peered":"2024-08-17T02:25:42.419203+0000","last_clean":"2024-08-17T02:25:42.419203+0000","last_became_active":"2024-08-17T02:25:42.418852+0000","last_became_peered":"2024-08-17T02:25:42.418852+0000","last_unstale":"2024-08-17T02:25:42.419203+0000","last_undegraded":"2024-08-17T02:25:42.419203+0000","last_fullsized":"2024-08-17T02:25:42.419203+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:01.372278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.411348+0000","last_change":"2024-08-17T02:25:41.416539+0000","last_active":"2024-08-17T02:25:42.411348+0000","last_peered":"2024-08-17T02:25:42.411348+0000","last_clean":"2024-08-17T02:25:42.411348+0000","last_became_active":"2024-08-17T02:25:41.416179+0000","last_became_peered":"2024-08-17T02:25:41.416179+0000","last_unstale":"2024-08-17T02:25:42.411348+0000","last_undegraded":"2024-08-17T02:25:42.411348+0000","last_fullsized":"2024-08-17T02:25:42.411348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:34.320598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429847+0000","last_change":"2024-08-17T02:25:42.429847+0000","last_active":"2024-08-17T02:25:42.429847+0000","last_peered":"2024-08-17T02:25:42.429847+0000","last_clean":"2024-08-17T02:25:42.429847+0000","last_became_active":"2024-08-17T02:25:42.429552+0000","last_became_peered":"2024-08-17T02:25:42.429552+0000","last_unstale":"2024-08-17T02:25:42.429847+0000","last_undegraded":"2024-08-17T02:25:42.429847+0000","last_fullsized":"2024-08-17T02:25:42.429847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:27.411778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416478+0000","last_change":"2024-08-17T02:25:41.413648+0000","last_active":"2024-08-17T02:25:41.416478+0000","last_peered":"2024-08-17T02:25:41.416478+0000","last_clean":"2024-08-17T02:25:41.416478+0000","last_became_active":"2024-08-17T02:25:41.413311+0000","last_became_peered":"2024-08-17T02:25:41.413311+0000","last_unstale":"2024-08-17T02:25:41.416478+0000","last_undegraded":"2024-08-17T02:25:41.416478+0000","last_fullsized":"2024-08-17T02:25:41.416478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:12.438714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420210+0000","last_change":"2024-08-17T02:25:42.420210+0000","last_active":"2024-08-17T02:25:42.420210+0000","last_peered":"2024-08-17T02:25:42.420210+0000","last_clean":"2024-08-17T02:25:42.420210+0000","last_became_active":"2024-08-17T02:25:42.419925+0000","last_became_peered":"2024-08-17T02:25:42.419925+0000","last_unstale":"2024-08-17T02:25:42.420210+0000","last_undegraded":"2024-08-17T02:25:42.420210+0000","last_fullsized":"2024-08-17T02:25:42.420210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:18.458775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.420278+0000","last_change":"2024-08-17T02:25:41.419672+0000","last_active":"2024-08-17T02:25:41.420278+0000","last_peered":"2024-08-17T02:25:41.420278+0000","last_clean":"2024-08-17T02:25:41.420278+0000","last_became_active":"2024-08-17T02:25:41.419363+0000","last_became_peered":"2024-08-17T02:25:41.419363+0000","last_unstale":"2024-08-17T02:25:41.420278+0000","last_undegraded":"2024-08-17T02:25:41.420278+0000","last_fullsized":"2024-08-17T02:25:41.420278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:03.263540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.414001+0000","last_change":"2024-08-17T02:25:42.414001+0000","last_active":"2024-08-17T02:25:42.414001+0000","last_peered":"2024-08-17T02:25:42.414001+0000","last_clean":"2024-08-17T02:25:42.414001+0000","last_became_active":"2024-08-17T02:25:42.413711+0000","last_became_peered":"2024-08-17T02:25:42.413711+0000","last_unstale":"2024-08-17T02:25:42.414001+0000","last_undegraded":"2024-08-17T02:25:42.414001+0000","last_fullsized":"2024-08-17T02:25:42.414001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:00.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.412465+0000","last_change":"2024-08-17T02:25:41.412465+0000","last_active":"2024-08-17T02:25:41.412465+0000","last_peered":"2024-08-17T02:25:41.412465+0000","last_clean":"2024-08-17T02:25:41.412465+0000","last_became_active":"2024-08-17T02:25:41.412180+0000","last_became_peered":"2024-08-17T02:25:41.412180+0000","last_unstale":"2024-08-17T02:25:41.412465+0000","last_undegraded":"2024-08-17T02:25:41.412465+0000","last_fullsized":"2024-08-17T02:25:41.412465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:40:41.453122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416127+0000","last_change":"2024-08-17T02:25:42.416127+0000","last_active":"2024-08-17T02:25:42.416127+0000","last_peered":"2024-08-17T02:25:42.416127+0000","last_clean":"2024-08-17T02:25:42.416127+0000","last_became_active":"2024-08-17T02:25:42.415840+0000","last_became_peered":"2024-08-17T02:25:42.415840+0000","last_unstale":"2024-08-17T02:25:42.416127+0000","last_undegraded":"2024-08-17T02:25:42.416127+0000","last_fullsized":"2024-08-17T02:25:42.416127+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:08.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416977+0000","last_change":"2024-08-17T02:25:41.416977+0000","last_active":"2024-08-17T02:25:41.416977+0000","last_peered":"2024-08-17T02:25:41.416977+0000","last_clean":"2024-08-17T02:25:41.416977+0000","last_became_active":"2024-08-17T02:25:41.416573+0000","last_became_peered":"2024-08-17T02:25:41.416573+0000","last_unstale":"2024-08-17T02:25:41.416977+0000","last_undegraded":"2024-08-17T02:25:41.416977+0000","last_fullsized":"2024-08-17T02:25:41.416977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:14.096901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420814+0000","last_change":"2024-08-17T02:25:42.420814+0000","last_active":"2024-08-17T02:25:42.420814+0000","last_peered":"2024-08-17T02:25:42.420814+0000","last_clean":"2024-08-17T02:25:42.420814+0000","last_became_active":"2024-08-17T02:25:42.420331+0000","last_became_peered":"2024-08-17T02:25:42.420331+0000","last_unstale":"2024-08-17T02:25:42.420814+0000","last_undegraded":"2024-08-17T02:25:42.420814+0000","last_fullsized":"2024-08-17T02:25:42.420814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:22.274775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433174+0000","last_change":"2024-08-17T02:25:41.406456+0000","last_active":"2024-08-17T02:25:42.433174+0000","last_peered":"2024-08-17T02:25:42.433174+0000","last_clean":"2024-08-17T02:25:42.433174+0000","last_became_active":"2024-08-17T02:25:41.406085+0000","last_became_peered":"2024-08-17T02:25:41.406085+0000","last_unstale":"2024-08-17T02:25:42.433174+0000","last_undegraded":"2024-08-17T02:25:42.433174+0000","last_fullsized":"2024-08-17T02:25:42.433174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:40.187213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419317+0000","last_change":"2024-08-17T02:25:42.419317+0000","last_active":"2024-08-17T02:25:42.419317+0000","last_peered":"2024-08-17T02:25:42.419317+0000","last_clean":"2024-08-17T02:25:42.419317+0000","last_became_active":"2024-08-17T02:25:42.418969+0000","last_became_peered":"2024-08-17T02:25:42.418969+0000","last_unstale":"2024-08-17T02:25:42.419317+0000","last_undegraded":"2024-08-17T02:25:42.419317+0000","last_fullsized":"2024-08-17T02:25:42.419317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:50.507537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434765+0000","last_change":"2024-08-17T02:25:41.419970+0000","last_active":"2024-08-17T02:25:42.434765+0000","last_peered":"2024-08-17T02:25:42.434765+0000","last_clean":"2024-08-17T02:25:42.434765+0000","last_became_active":"2024-08-17T02:25:41.419704+0000","last_became_peered":"2024-08-17T02:25:41.419704+0000","last_unstale":"2024-08-17T02:25:42.434765+0000","last_undegraded":"2024-08-17T02:25:42.434765+0000","last_fullsized":"2024-08-17T02:25:42.434765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:01.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416809+0000","last_change":"2024-08-17T02:25:42.416809+0000","last_active":"2024-08-17T02:25:42.416809+0000","last_peered":"2024-08-17T02:25:42.416809+0000","last_clean":"2024-08-17T02:25:42.416809+0000","last_became_active":"2024-08-17T02:25:42.416549+0000","last_became_peered":"2024-08-17T02:25:42.416549+0000","last_unstale":"2024-08-17T02:25:42.416809+0000","last_undegraded":"2024-08-17T02:25:42.416809+0000","last_fullsized":"2024-08-17T02:25:42.416809+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:18.471103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433055+0000","last_change":"2024-08-17T02:25:41.415123+0000","last_active":"2024-08-17T02:25:42.433055+0000","last_peered":"2024-08-17T02:25:42.433055+0000","last_clean":"2024-08-17T02:25:42.433055+0000","last_became_active":"2024-08-17T02:25:41.414783+0000","last_became_peered":"2024-08-17T02:25:41.414783+0000","last_unstale":"2024-08-17T02:25:42.433055+0000","last_undegraded":"2024-08-17T02:25:42.433055+0000","last_fullsized":"2024-08-17T02:25:42.433055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:06.176945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418728+0000","last_change":"2024-08-17T02:25:42.418728+0000","last_active":"2024-08-17T02:25:42.418728+0000","last_peered":"2024-08-17T02:25:42.418728+0000","last_clean":"2024-08-17T02:25:42.418728+0000","last_became_active":"2024-08-17T02:25:42.418446+0000","last_became_peered":"2024-08-17T02:25:42.418446+0000","last_unstale":"2024-08-17T02:25:42.418728+0000","last_undegraded":"2024-08-17T02:25:42.418728+0000","last_fullsized":"2024-08-17T02:25:42.418728+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:42.876425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.422123+0000","last_change":"2024-08-17T02:25:41.417738+0000","last_active":"2024-08-17T02:25:41.422123+0000","last_peered":"2024-08-17T02:25:41.422123+0000","last_clean":"2024-08-17T02:25:41.422123+0000","last_became_active":"2024-08-17T02:25:41.417458+0000","last_became_peered":"2024-08-17T02:25:41.417458+0000","last_unstale":"2024-08-17T02:25:41.422123+0000","last_undegraded":"2024-08-17T02:25:41.422123+0000","last_fullsized":"2024-08-17T02:25:41.422123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:42.545781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.426300+0000","last_change":"2024-08-17T02:25:42.426300+0000","last_active":"2024-08-17T02:25:42.426300+0000","last_peered":"2024-08-17T02:25:42.426300+0000","last_clean":"2024-08-17T02:25:42.426300+0000","last_became_active":"2024-08-17T02:25:42.425814+0000","last_became_peered":"2024-08-17T02:25:42.425814+0000","last_unstale":"2024-08-17T02:25:42.426300+0000","last_undegraded":"2024-08-17T02:25:42.426300+0000","last_fullsized":"2024-08-17T02:25:42.426300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.419395+0000","last_change":"2024-08-17T02:25:41.412269+0000","last_active":"2024-08-17T02:25:41.419395+0000","last_peered":"2024-08-17T02:25:41.419395+0000","last_clean":"2024-08-17T02:25:41.419395+0000","last_became_active":"2024-08-17T02:25:41.411996+0000","last_became_peered":"2024-08-17T02:25:41.411996+0000","last_unstale":"2024-08-17T02:25:41.419395+0000","last_undegraded":"2024-08-17T02:25:41.419395+0000","last_fullsized":"2024-08-17T02:25:41.419395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:26.990290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421316+0000","last_change":"2024-08-17T02:25:42.421316+0000","last_active":"2024-08-17T02:25:42.421316+0000","last_peered":"2024-08-17T02:25:42.421316+0000","last_clean":"2024-08-17T02:25:42.421316+0000","last_became_active":"2024-08-17T02:25:42.421027+0000","last_became_peered":"2024-08-17T02:25:42.421027+0000","last_unstale":"2024-08-17T02:25:42.421316+0000","last_undegraded":"2024-08-17T02:25:42.421316+0000","last_fullsized":"2024-08-17T02:25:42.421316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:22.274775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434466+0000","last_change":"2024-08-17T02:25:41.417196+0000","last_active":"2024-08-17T02:25:42.434466+0000","last_peered":"2024-08-17T02:25:42.434466+0000","last_clean":"2024-08-17T02:25:42.434466+0000","last_became_active":"2024-08-17T02:25:41.416884+0000","last_became_peered":"2024-08-17T02:25:41.416884+0000","last_unstale":"2024-08-17T02:25:42.434466+0000","last_undegraded":"2024-08-17T02:25:42.434466+0000","last_fullsized":"2024-08-17T02:25:42.434466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:51.323262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419706+0000","last_change":"2024-08-17T02:25:42.419706+0000","last_active":"2024-08-17T02:25:42.419706+0000","last_peered":"2024-08-17T02:25:42.419706+0000","last_clean":"2024-08-17T02:25:42.419706+0000","last_became_active":"2024-08-17T02:25:42.419419+0000","last_became_peered":"2024-08-17T02:25:42.419419+0000","last_unstale":"2024-08-17T02:25:42.419706+0000","last_undegraded":"2024-08-17T02:25:42.419706+0000","last_fullsized":"2024-08-17T02:25:42.419706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:45.898859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.401468+0000","last_change":"2024-08-17T02:25:41.413608+0000","last_active":"2024-08-17T02:25:42.401468+0000","last_peered":"2024-08-17T02:25:42.401468+0000","last_clean":"2024-08-17T02:25:42.401468+0000","last_became_active":"2024-08-17T02:25:41.413299+0000","last_became_peered":"2024-08-17T02:25:41.413299+0000","last_unstale":"2024-08-17T02:25:42.401468+0000","last_undegraded":"2024-08-17T02:25:42.401468+0000","last_fullsized":"2024-08-17T02:25:42.401468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:59.656053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429851+0000","last_change":"2024-08-17T02:25:42.429851+0000","last_active":"2024-08-17T02:25:42.429851+0000","last_peered":"2024-08-17T02:25:42.429851+0000","last_clean":"2024-08-17T02:25:42.429851+0000","last_became_active":"2024-08-17T02:25:42.429575+0000","last_became_peered":"2024-08-17T02:25:42.429575+0000","last_unstale":"2024-08-17T02:25:42.429851+0000","last_undegraded":"2024-08-17T02:25:42.429851+0000","last_fullsized":"2024-08-17T02:25:42.429851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:33.834531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433034+0000","last_change":"2024-08-17T02:25:41.416074+0000","last_active":"2024-08-17T02:25:42.433034+0000","last_peered":"2024-08-17T02:25:42.433034+0000","last_clean":"2024-08-17T02:25:42.433034+0000","last_became_active":"2024-08-17T02:25:41.415694+0000","last_became_peered":"2024-08-17T02:25:41.415694+0000","last_unstale":"2024-08-17T02:25:42.433034+0000","last_undegraded":"2024-08-17T02:25:42.433034+0000","last_fullsized":"2024-08-17T02:25:42.433034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:14.811773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404286+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:55.604947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.405428+0000","last_change":"2024-08-17T02:25:41.411845+0000","last_active":"2024-08-17T02:25:42.405428+0000","last_peered":"2024-08-17T02:25:42.405428+0000","last_clean":"2024-08-17T02:25:42.405428+0000","last_became_active":"2024-08-17T02:25:41.410319+0000","last_became_peered":"2024-08-17T02:25:41.410319+0000","last_unstale":"2024-08-17T02:25:42.405428+0000","last_undegraded":"2024-08-17T02:25:42.405428+0000","last_fullsized":"2024-08-17T02:25:42.405428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:26.741363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.410194+0000","last_change":"2024-08-17T02:25:42.410194+0000","last_active":"2024-08-17T02:25:42.410194+0000","last_peered":"2024-08-17T02:25:42.410194+0000","last_clean":"2024-08-17T02:25:42.410194+0000","last_became_active":"2024-08-17T02:25:42.409899+0000","last_became_peered":"2024-08-17T02:25:42.409899+0000","last_unstale":"2024-08-17T02:25:42.410194+0000","last_undegraded":"2024-08-17T02:25:42.410194+0000","last_fullsized":"2024-08-17T02:25:42.410194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:02.087099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.412888+0000","last_change":"2024-08-17T02:25:41.408140+0000","last_active":"2024-08-17T02:25:41.412888+0000","last_peered":"2024-08-17T02:25:41.412888+0000","last_clean":"2024-08-17T02:25:41.412888+0000","last_became_active":"2024-08-17T02:25:41.407869+0000","last_became_peered":"2024-08-17T02:25:41.407869+0000","last_unstale":"2024-08-17T02:25:41.412888+0000","last_undegraded":"2024-08-17T02:25:41.412888+0000","last_fullsized":"2024-08-17T02:25:41.412888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:22.195354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.407511+0000","last_change":"2024-08-17T02:25:42.407511+0000","last_active":"2024-08-17T02:25:42.407511+0000","last_peered":"2024-08-17T02:25:42.407511+0000","last_clean":"2024-08-17T02:25:42.407511+0000","last_became_active":"2024-08-17T02:25:42.407273+0000","last_became_peered":"2024-08-17T02:25:42.407273+0000","last_unstale":"2024-08-17T02:25:42.407511+0000","last_undegraded":"2024-08-17T02:25:42.407511+0000","last_fullsized":"2024-08-17T02:25:42.407511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:09.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.420302+0000","last_change":"2024-08-17T02:25:41.420302+0000","last_active":"2024-08-17T02:25:41.420302+0000","last_peered":"2024-08-17T02:25:41.420302+0000","last_clean":"2024-08-17T02:25:41.420302+0000","last_became_active":"2024-08-17T02:25:41.419958+0000","last_became_peered":"2024-08-17T02:25:41.419958+0000","last_unstale":"2024-08-17T02:25:41.420302+0000","last_undegraded":"2024-08-17T02:25:41.420302+0000","last_fullsized":"2024-08-17T02:25:41.420302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:53.300389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.407078+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:14.445941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416402+0000","last_change":"2024-08-17T02:25:41.412762+0000","last_active":"2024-08-17T02:25:41.416402+0000","last_peered":"2024-08-17T02:25:41.416402+0000","last_clean":"2024-08-17T02:25:41.416402+0000","last_became_active":"2024-08-17T02:25:41.412398+0000","last_became_peered":"2024-08-17T02:25:41.412398+0000","last_unstale":"2024-08-17T02:25:41.416402+0000","last_undegraded":"2024-08-17T02:25:41.416402+0000","last_fullsized":"2024-08-17T02:25:41.416402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:01.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422487+0000","last_change":"2024-08-17T02:25:42.422487+0000","last_active":"2024-08-17T02:25:42.422487+0000","last_peered":"2024-08-17T02:25:42.422487+0000","last_clean":"2024-08-17T02:25:42.422487+0000","last_became_active":"2024-08-17T02:25:42.422179+0000","last_became_peered":"2024-08-17T02:25:42.422179+0000","last_unstale":"2024-08-17T02:25:42.422487+0000","last_undegraded":"2024-08-17T02:25:42.422487+0000","last_fullsized":"2024-08-17T02:25:42.422487+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.411049+0000","last_change":"2024-08-17T02:25:41.408829+0000","last_active":"2024-08-17T02:25:41.411049+0000","last_peered":"2024-08-17T02:25:41.411049+0000","last_clean":"2024-08-17T02:25:41.411049+0000","last_became_active":"2024-08-17T02:25:41.408507+0000","last_became_peered":"2024-08-17T02:25:41.408507+0000","last_unstale":"2024-08-17T02:25:41.411049+0000","last_undegraded":"2024-08-17T02:25:41.411049+0000","last_fullsized":"2024-08-17T02:25:41.411049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:55.936904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.428934+0000","last_change":"2024-08-17T02:25:42.428934+0000","last_active":"2024-08-17T02:25:42.428934+0000","last_peered":"2024-08-17T02:25:42.428934+0000","last_clean":"2024-08-17T02:25:42.428934+0000","last_became_active":"2024-08-17T02:25:42.428579+0000","last_became_peered":"2024-08-17T02:25:42.428579+0000","last_unstale":"2024-08-17T02:25:42.428934+0000","last_undegraded":"2024-08-17T02:25:42.428934+0000","last_fullsized":"2024-08-17T02:25:42.428934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:01:35.750552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.405319+0000","last_change":"2024-08-17T02:25:41.404004+0000","last_active":"2024-08-17T02:25:41.405319+0000","last_peered":"2024-08-17T02:25:41.405319+0000","last_clean":"2024-08-17T02:25:41.405319+0000","last_became_active":"2024-08-17T02:25:41.403735+0000","last_became_peered":"2024-08-17T02:25:41.403735+0000","last_unstale":"2024-08-17T02:25:41.405319+0000","last_undegraded":"2024-08-17T02:25:41.405319+0000","last_fullsized":"2024-08-17T02:25:41.405319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:42.545781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.408344+0000","last_change":"2024-08-17T02:25:42.408344+0000","last_active":"2024-08-17T02:25:42.408344+0000","last_peered":"2024-08-17T02:25:42.408344+0000","last_clean":"2024-08-17T02:25:42.408344+0000","last_became_active":"2024-08-17T02:25:42.408053+0000","last_became_peered":"2024-08-17T02:25:42.408053+0000","last_unstale":"2024-08-17T02:25:42.408344+0000","last_undegraded":"2024-08-17T02:25:42.408344+0000","last_fullsized":"2024-08-17T02:25:42.408344+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:57.975103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.432007+0000","last_change":"2024-08-17T02:25:41.411005+0000","last_active":"2024-08-17T02:25:42.432007+0000","last_peered":"2024-08-17T02:25:42.432007+0000","last_clean":"2024-08-17T02:25:42.432007+0000","last_became_active":"2024-08-17T02:25:41.410680+0000","last_became_peered":"2024-08-17T02:25:41.410680+0000","last_unstale":"2024-08-17T02:25:42.432007+0000","last_undegraded":"2024-08-17T02:25:42.432007+0000","last_fullsized":"2024-08-17T02:25:42.432007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:41.995822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.408871+0000","last_change":"2024-08-17T02:25:42.408871+0000","last_active":"2024-08-17T02:25:42.408871+0000","last_peered":"2024-08-17T02:25:42.408871+0000","last_clean":"2024-08-17T02:25:42.408871+0000","last_became_active":"2024-08-17T02:25:42.408058+0000","last_became_peered":"2024-08-17T02:25:42.408058+0000","last_unstale":"2024-08-17T02:25:42.408871+0000","last_undegraded":"2024-08-17T02:25:42.408871+0000","last_fullsized":"2024-08-17T02:25:42.408871+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:41.832444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.415141+0000","last_change":"2024-08-17T02:25:41.415141+0000","last_active":"2024-08-17T02:25:41.415141+0000","last_peered":"2024-08-17T02:25:41.415141+0000","last_clean":"2024-08-17T02:25:41.415141+0000","last_became_active":"2024-08-17T02:25:41.414871+0000","last_became_peered":"2024-08-17T02:25:41.414871+0000","last_unstale":"2024-08-17T02:25:41.415141+0000","last_undegraded":"2024-08-17T02:25:41.415141+0000","last_fullsized":"2024-08-17T02:25:41.415141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:15.442741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418873+0000","last_change":"2024-08-17T02:25:42.418873+0000","last_active":"2024-08-17T02:25:42.418873+0000","last_peered":"2024-08-17T02:25:42.418873+0000","last_clean":"2024-08-17T02:25:42.418873+0000","last_became_active":"2024-08-17T02:25:42.418596+0000","last_became_peered":"2024-08-17T02:25:42.418596+0000","last_unstale":"2024-08-17T02:25:42.418873+0000","last_undegraded":"2024-08-17T02:25:42.418873+0000","last_fullsized":"2024-08-17T02:25:42.418873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:43.004563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.407774+0000","last_change":"2024-08-17T02:25:41.406162+0000","last_active":"2024-08-17T02:25:41.407774+0000","last_peered":"2024-08-17T02:25:41.407774+0000","last_clean":"2024-08-17T02:25:41.407774+0000","last_became_active":"2024-08-17T02:25:41.405855+0000","last_became_peered":"2024-08-17T02:25:41.405855+0000","last_unstale":"2024-08-17T02:25:41.407774+0000","last_undegraded":"2024-08-17T02:25:41.407774+0000","last_fullsized":"2024-08-17T02:25:41.407774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:05.947031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423499+0000","last_change":"2024-08-17T02:25:42.423499+0000","last_active":"2024-08-17T02:25:42.423499+0000","last_peered":"2024-08-17T02:25:42.423499+0000","last_clean":"2024-08-17T02:25:42.423499+0000","last_became_active":"2024-08-17T02:25:42.423157+0000","last_became_peered":"2024-08-17T02:25:42.423157+0000","last_unstale":"2024-08-17T02:25:42.423499+0000","last_undegraded":"2024-08-17T02:25:42.423499+0000","last_fullsized":"2024-08-17T02:25:42.423499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:47.035562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416353+0000","last_change":"2024-08-17T02:25:41.411329+0000","last_active":"2024-08-17T02:25:41.416353+0000","last_peered":"2024-08-17T02:25:41.416353+0000","last_clean":"2024-08-17T02:25:41.416353+0000","last_became_active":"2024-08-17T02:25:41.410916+0000","last_became_peered":"2024-08-17T02:25:41.410916+0000","last_unstale":"2024-08-17T02:25:41.416353+0000","last_undegraded":"2024-08-17T02:25:41.416353+0000","last_fullsized":"2024-08-17T02:25:41.416353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:56.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416987+0000","last_change":"2024-08-17T02:25:42.416987+0000","last_active":"2024-08-17T02:25:42.416987+0000","last_peered":"2024-08-17T02:25:42.416987+0000","last_clean":"2024-08-17T02:25:42.416987+0000","last_became_active":"2024-08-17T02:25:42.416662+0000","last_became_peered":"2024-08-17T02:25:42.416662+0000","last_unstale":"2024-08-17T02:25:42.416987+0000","last_undegraded":"2024-08-17T02:25:42.416987+0000","last_fullsized":"2024-08-17T02:25:42.416987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:00.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416400+0000","last_change":"2024-08-17T02:25:41.411479+0000","last_active":"2024-08-17T02:25:41.416400+0000","last_peered":"2024-08-17T02:25:41.416400+0000","last_clean":"2024-08-17T02:25:41.416400+0000","last_became_active":"2024-08-17T02:25:41.411185+0000","last_became_peered":"2024-08-17T02:25:41.411185+0000","last_unstale":"2024-08-17T02:25:41.416400+0000","last_undegraded":"2024-08-17T02:25:41.416400+0000","last_fullsized":"2024-08-17T02:25:41.416400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:14.811773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.426045+0000","last_change":"2024-08-17T02:25:42.426045+0000","last_active":"2024-08-17T02:25:42.426045+0000","last_peered":"2024-08-17T02:25:42.426045+0000","last_clean":"2024-08-17T02:25:42.426045+0000","last_became_active":"2024-08-17T02:25:42.425767+0000","last_became_peered":"2024-08-17T02:25:42.425767+0000","last_unstale":"2024-08-17T02:25:42.426045+0000","last_undegraded":"2024-08-17T02:25:42.426045+0000","last_fullsized":"2024-08-17T02:25:42.426045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:54.517688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.417303+0000","last_change":"2024-08-17T02:25:41.416245+0000","last_active":"2024-08-17T02:25:41.417303+0000","last_peered":"2024-08-17T02:25:41.417303+0000","last_clean":"2024-08-17T02:25:41.417303+0000","last_became_active":"2024-08-17T02:25:41.415762+0000","last_became_peered":"2024-08-17T02:25:41.415762+0000","last_unstale":"2024-08-17T02:25:41.417303+0000","last_undegraded":"2024-08-17T02:25:41.417303+0000","last_fullsized":"2024-08-17T02:25:41.417303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:05.947031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.409630+0000","last_change":"2024-08-17T02:25:42.409630+0000","last_active":"2024-08-17T02:25:42.409630+0000","last_peered":"2024-08-17T02:25:42.409630+0000","last_clean":"2024-08-17T02:25:42.409630+0000","last_became_active":"2024-08-17T02:25:42.409370+0000","last_became_peered":"2024-08-17T02:25:42.409370+0000","last_unstale":"2024-08-17T02:25:42.409630+0000","last_undegraded":"2024-08-17T02:25:42.409630+0000","last_fullsized":"2024-08-17T02:25:42.409630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:42.876425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.419542+0000","last_change":"2024-08-17T02:25:41.413754+0000","last_active":"2024-08-17T02:25:41.419542+0000","last_peered":"2024-08-17T02:25:41.419542+0000","last_clean":"2024-08-17T02:25:41.419542+0000","last_became_active":"2024-08-17T02:25:41.413461+0000","last_became_peered":"2024-08-17T02:25:41.413461+0000","last_unstale":"2024-08-17T02:25:41.419542+0000","last_undegraded":"2024-08-17T02:25:41.419542+0000","last_fullsized":"2024-08-17T02:25:41.419542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:21.125266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422150+0000","last_change":"2024-08-17T02:25:42.422150+0000","last_active":"2024-08-17T02:25:42.422150+0000","last_peered":"2024-08-17T02:25:42.422150+0000","last_clean":"2024-08-17T02:25:42.422150+0000","last_became_active":"2024-08-17T02:25:42.409094+0000","last_became_peered":"2024-08-17T02:25:42.409094+0000","last_unstale":"2024-08-17T02:25:42.422150+0000","last_undegraded":"2024-08-17T02:25:42.422150+0000","last_fullsized":"2024-08-17T02:25:42.422150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:44.235619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.415642+0000","last_change":"2024-08-17T02:25:41.413342+0000","last_active":"2024-08-17T02:25:41.415642+0000","last_peered":"2024-08-17T02:25:41.415642+0000","last_clean":"2024-08-17T02:25:41.415642+0000","last_became_active":"2024-08-17T02:25:41.411807+0000","last_became_peered":"2024-08-17T02:25:41.411807+0000","last_unstale":"2024-08-17T02:25:41.415642+0000","last_undegraded":"2024-08-17T02:25:41.415642+0000","last_fullsized":"2024-08-17T02:25:41.415642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:58.112071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.397663+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:25:41.397663+0000","last_peered":"2024-08-17T02:25:41.397663+0000","last_clean":"2024-08-17T02:25:41.397663+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:25:41.397663+0000","last_undegraded":"2024-08-17T02:25:41.397663+0000","last_fullsized":"2024-08-17T02:25:41.397663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":393216,"data_stored":149055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.804},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.66300000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.746},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.0449999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":2.0259999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.099}]},{"osd":6,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.165},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":2.073}]}]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297748,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074092,"statfs":{"total":96636764160,"available":96331870208,"internally_reserved":0,"allocated":401408,"data_stored":150585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.008}]},{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.083}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.85599999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.1739999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.212},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.2330000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.135}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.113},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1799999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.0549999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0840000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297760,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074080,"statfs":{"total":96636764160,"available":96331857920,"internally_reserved":0,"allocated":405504,"data_stored":149797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.82699999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.78300000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.621},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.74399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.296}]},{"osd":5,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.3640000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.391},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.337}]},{"osd":7,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.47}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.75700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.44},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.91200000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.099}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":970752,"data_stored":732638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.95199999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.083},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.89600000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.02}]},{"osd":7,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.137},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1719999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.1140000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.014},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.79300000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.208}]},{"osd":4,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.054}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.25},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.325}]},{"osd":6,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.399},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.2769999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.361},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.304}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":958464,"data_stored":726375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.60699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.026},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.91700000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.0609999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.115}]},{"osd":7,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.135},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.095}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:45.766 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:45.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.873+0000 7fee4ffff700 1 Processor -- start 2024-08-17T02:25:45.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.873+0000 7fee4ffff700 1 -- start start 2024-08-17T02:25:45.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50069580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fee5015da80 0x7fee501422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee50141e40 con 0x7fee50161e80 2024-08-17T02:25:45.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee50141230 con 0x7fee5015da80 2024-08-17T02:25:45.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee50141510 con 0x7fee500691b0 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4e7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fee50161e80 0x7fee5015d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50266/0 (socket says 172.21.15.31:50266) 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4e7fc700 1 -- 172.21.15.31:0/1592506648 learned_addr learned my addr 172.21.15.31:0/1592506648 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4f7fe700 1 --2- 172.21.15.31:0/1592506648 >> v2:172.21.15.92:3300/0 conn(0x7fee5015da80 0x7fee501422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4effd700 1 --2- 172.21.15.31:0/1592506648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4dffb700 1 -- 172.21.15.31:0/1592506648 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929891183 0 0) 0x7fee50141e40 con 0x7fee50161e80 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4dffb700 1 -- 172.21.15.31:0/1592506648 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee3c003570 con 0x7fee50161e80 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4effd700 1 -- 172.21.15.31:0/1592506648 >> v2:172.21.15.92:3300/0 conn(0x7fee5015da80 msgr2=0x7fee501422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4effd700 1 --2- 172.21.15.31:0/1592506648 >> v2:172.21.15.92:3300/0 conn(0x7fee5015da80 0x7fee501422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4effd700 1 -- 172.21.15.31:0/1592506648 >> v1:172.21.15.31:6789/0 conn(0x7fee50161e80 legacy=0x7fee5015d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4effd700 1 -- 172.21.15.31:0/1592506648 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee501417f0 con 0x7fee500691b0 2024-08-17T02:25:45.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4effd700 1 --2- 172.21.15.31:0/1592506648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50069580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fee48009e60 tx=0x7fee48009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=911faa9fa7795102 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4dffb700 1 -- 172.21.15.31:0/1592506648 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800e070 con 0x7fee500691b0 2024-08-17T02:25:45.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4dffb700 1 -- 172.21.15.31:0/1592506648 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4800bab0 con 0x7fee500691b0 2024-08-17T02:25:45.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4dffb700 1 -- 172.21.15.31:0/1592506648 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800be30 con 0x7fee500691b0 2024-08-17T02:25:45.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 -- 172.21.15.31:0/1592506648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 msgr2=0x7fee50069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 --2- 172.21.15.31:0/1592506648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50069580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fee48009e60 tx=0x7fee48009780 comp rx=0 tx=0).stop 2024-08-17T02:25:45.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 -- 172.21.15.31:0/1592506648 shutdown_connections 2024-08-17T02:25:45.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 --2- 172.21.15.31:0/1592506648 >> v2:172.21.15.92:3300/0 conn(0x7fee5015da80 0x7fee501422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 --2- 172.21.15.31:0/1592506648 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50069580 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 -- 172.21.15.31:0/1592506648 >> 172.21.15.31:0/1592506648 conn(0x7fee50067400 msgr2=0x7fee50067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 -- 172.21.15.31:0/1592506648 shutdown_connections 2024-08-17T02:25:45.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.877+0000 7fee4ffff700 1 -- 172.21.15.31:0/1592506648 wait complete. 2024-08-17T02:25:45.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4ffff700 1 Processor -- start 2024-08-17T02:25:45.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4ffff700 1 -- start start 2024-08-17T02:25:45.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee5015da80 0x7fee500aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee50161e80 0x7fee500677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5015ccc0 con 0x7fee50161e80 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4ffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50144da0 con 0x7fee5015da80 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4ffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee50159c80 con 0x7fee500691b0 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee50161e80 0x7fee500677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4e7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee5015da80 0x7fee500aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:51878/0 (socket says 172.21.15.31:51878) 2024-08-17T02:25:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4effd700 1 -- 172.21.15.31:0/2896014248 learned_addr learned my addr 172.21.15.31:0/2896014248 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4effd700 1 -- 172.21.15.31:0/2896014248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee5015da80 msgr2=0x7fee500aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4effd700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee5015da80 0x7fee500aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4effd700 1 -- 172.21.15.31:0/2896014248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee50161e80 msgr2=0x7fee500677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4effd700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee50161e80 0x7fee500677d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4effd700 1 -- 172.21.15.31:0/2896014248 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48009a20 con 0x7fee500691b0 2024-08-17T02:25:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.881+0000 7fee4effd700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50159740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee50141650 tx=0x7fee48019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee46ffd700 1 -- 172.21.15.31:0/2896014248 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48012b60 con 0x7fee500691b0 2024-08-17T02:25:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee46ffd700 1 -- 172.21.15.31:0/2896014248 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee48012ce0 con 0x7fee500691b0 2024-08-17T02:25:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee4ffff700 1 -- 172.21.15.31:0/2896014248 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee50144190 con 0x7fee500691b0 2024-08-17T02:25:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee46ffd700 1 -- 172.21.15.31:0/2896014248 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee480276c0 con 0x7fee500691b0 2024-08-17T02:25:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee4ffff700 1 -- 172.21.15.31:0/2896014248 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee50144750 con 0x7fee500691b0 2024-08-17T02:25:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee4ffff700 1 -- 172.21.15.31:0/2896014248 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee500712b0 con 0x7fee500691b0 2024-08-17T02:25:45.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee46ffd700 1 -- 172.21.15.31:0/2896014248 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fee48024070 con 0x7fee500691b0 2024-08-17T02:25:45.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee46ffd700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee30060860 0x7fee30062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee46ffd700 1 -- 172.21.15.31:0/2896014248 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee4807f000 con 0x7fee500691b0 2024-08-17T02:25:45.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee4e7fc700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee30060860 0x7fee30062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.885+0000 7fee4e7fc700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee30060860 0x7fee30062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee500ae5e0 tx=0x7fee38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:45.897+0000 7fee46ffd700 1 -- 172.21.15.31:0/2896014248 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fee4804f450 con 0x7fee500691b0 2024-08-17T02:25:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.057+0000 7fee4ffff700 1 -- 172.21.15.31:0/2896014248 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fee50144ee0 con 0x7fee30060860 2024-08-17T02:25:46.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.073+0000 7fee46ffd700 1 -- 172.21.15.31:0/2896014248 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287047 (secure 0 0 0) 0x7fee3800f620 con 0x7fee30060860 2024-08-17T02:25:46.081 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 -- 172.21.15.31:0/2896014248 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee30060860 msgr2=0x7fee30062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee30060860 0x7fee30062d10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee500ae5e0 tx=0x7fee38009040 comp rx=0 tx=0).stop 2024-08-17T02:25:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 -- 172.21.15.31:0/2896014248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 msgr2=0x7fee50159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50159740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee50141650 tx=0x7fee48019000 comp rx=0 tx=0).stop 2024-08-17T02:25:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 -- 172.21.15.31:0/2896014248 shutdown_connections 2024-08-17T02:25:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fee30060860 0x7fee30062d10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee50161e80 0x7fee500677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee5015da80 0x7fee500aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 --2- 172.21.15.31:0/2896014248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fee500691b0 0x7fee50159740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 -- 172.21.15.31:0/2896014248 >> 172.21.15.31:0/2896014248 conn(0x7fee50067400 msgr2=0x7fee5006d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 -- 172.21.15.31:0/2896014248 shutdown_connections 2024-08-17T02:25:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.081+0000 7fee4ffff700 1 -- 172.21.15.31:0/2896014248 wait complete. 2024-08-17T02:25:46.085 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:25:46.097 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-08-17T02:25:45.600424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387188,"kb_used_data":4160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587532,"statfs":{"total":773094113280,"available":770649632768,"internally_reserved":0,"allocated":4259840,"data_stored":2335260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.219919"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429866+0000","last_change":"2024-08-17T02:25:42.429866+0000","last_active":"2024-08-17T02:25:42.429866+0000","last_peered":"2024-08-17T02:25:42.429866+0000","last_clean":"2024-08-17T02:25:42.429866+0000","last_became_active":"2024-08-17T02:25:42.429589+0000","last_became_peered":"2024-08-17T02:25:42.429589+0000","last_unstale":"2024-08-17T02:25:42.429866+0000","last_undegraded":"2024-08-17T02:25:42.429866+0000","last_fullsized":"2024-08-17T02:25:42.429866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404932+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:07.672234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418423+0000","last_change":"2024-08-17T02:25:42.418423+0000","last_active":"2024-08-17T02:25:42.418423+0000","last_peered":"2024-08-17T02:25:42.418423+0000","last_clean":"2024-08-17T02:25:42.418423+0000","last_became_active":"2024-08-17T02:25:42.418156+0000","last_became_peered":"2024-08-17T02:25:42.418156+0000","last_unstale":"2024-08-17T02:25:42.418423+0000","last_undegraded":"2024-08-17T02:25:42.418423+0000","last_fullsized":"2024-08-17T02:25:42.418423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:43.004563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420792+0000","last_change":"2024-08-17T02:25:42.420792+0000","last_active":"2024-08-17T02:25:42.420792+0000","last_peered":"2024-08-17T02:25:42.420792+0000","last_clean":"2024-08-17T02:25:42.420792+0000","last_became_active":"2024-08-17T02:25:42.420383+0000","last_became_peered":"2024-08-17T02:25:42.420383+0000","last_unstale":"2024-08-17T02:25:42.420792+0000","last_undegraded":"2024-08-17T02:25:42.420792+0000","last_fullsized":"2024-08-17T02:25:42.420792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:45.898859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.407547+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:49:35.652729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417300+0000","last_change":"2024-08-17T02:25:42.417300+0000","last_active":"2024-08-17T02:25:42.417300+0000","last_peered":"2024-08-17T02:25:42.417300+0000","last_clean":"2024-08-17T02:25:42.417300+0000","last_became_active":"2024-08-17T02:25:42.417005+0000","last_became_peered":"2024-08-17T02:25:42.417005+0000","last_unstale":"2024-08-17T02:25:42.417300+0000","last_undegraded":"2024-08-17T02:25:42.417300+0000","last_fullsized":"2024-08-17T02:25:42.417300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:35.329338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416534+0000","last_change":"2024-08-17T02:25:42.416534+0000","last_active":"2024-08-17T02:25:42.416534+0000","last_peered":"2024-08-17T02:25:42.416534+0000","last_clean":"2024-08-17T02:25:42.416534+0000","last_became_active":"2024-08-17T02:25:42.416145+0000","last_became_peered":"2024-08-17T02:25:42.416145+0000","last_unstale":"2024-08-17T02:25:42.416534+0000","last_undegraded":"2024-08-17T02:25:42.416534+0000","last_fullsized":"2024-08-17T02:25:42.416534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:36.767291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419906+0000","last_change":"2024-08-17T02:25:42.419906+0000","last_active":"2024-08-17T02:25:42.419906+0000","last_peered":"2024-08-17T02:25:42.419906+0000","last_clean":"2024-08-17T02:25:42.419906+0000","last_became_active":"2024-08-17T02:25:42.419605+0000","last_became_peered":"2024-08-17T02:25:42.419605+0000","last_unstale":"2024-08-17T02:25:42.419906+0000","last_undegraded":"2024-08-17T02:25:42.419906+0000","last_fullsized":"2024-08-17T02:25:42.419906+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:12.438819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418898+0000","last_change":"2024-08-17T02:25:42.418898+0000","last_active":"2024-08-17T02:25:42.418898+0000","last_peered":"2024-08-17T02:25:42.418898+0000","last_clean":"2024-08-17T02:25:42.418898+0000","last_became_active":"2024-08-17T02:25:42.418610+0000","last_became_peered":"2024-08-17T02:25:42.418610+0000","last_unstale":"2024-08-17T02:25:42.418898+0000","last_undegraded":"2024-08-17T02:25:42.418898+0000","last_fullsized":"2024-08-17T02:25:42.418898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:02.087099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416219+0000","last_change":"2024-08-17T02:25:42.416219+0000","last_active":"2024-08-17T02:25:42.416219+0000","last_peered":"2024-08-17T02:25:42.416219+0000","last_clean":"2024-08-17T02:25:42.416219+0000","last_became_active":"2024-08-17T02:25:42.415937+0000","last_became_peered":"2024-08-17T02:25:42.415937+0000","last_unstale":"2024-08-17T02:25:42.416219+0000","last_undegraded":"2024-08-17T02:25:42.416219+0000","last_fullsized":"2024-08-17T02:25:42.416219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:08.435265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421885+0000","last_change":"2024-08-17T02:25:42.421885+0000","last_active":"2024-08-17T02:25:42.421885+0000","last_peered":"2024-08-17T02:25:42.421885+0000","last_clean":"2024-08-17T02:25:42.421885+0000","last_became_active":"2024-08-17T02:25:42.421627+0000","last_became_peered":"2024-08-17T02:25:42.421627+0000","last_unstale":"2024-08-17T02:25:42.421885+0000","last_undegraded":"2024-08-17T02:25:42.421885+0000","last_fullsized":"2024-08-17T02:25:42.421885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:18.458775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.414237+0000","last_change":"2024-08-17T02:25:42.414237+0000","last_active":"2024-08-17T02:25:42.414237+0000","last_peered":"2024-08-17T02:25:42.414237+0000","last_clean":"2024-08-17T02:25:42.414237+0000","last_became_active":"2024-08-17T02:25:42.413842+0000","last_became_peered":"2024-08-17T02:25:42.413842+0000","last_unstale":"2024-08-17T02:25:42.414237+0000","last_undegraded":"2024-08-17T02:25:42.414237+0000","last_fullsized":"2024-08-17T02:25:42.414237+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:04.272280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418431+0000","last_change":"2024-08-17T02:25:42.418431+0000","last_active":"2024-08-17T02:25:42.418431+0000","last_peered":"2024-08-17T02:25:42.418431+0000","last_clean":"2024-08-17T02:25:42.418431+0000","last_became_active":"2024-08-17T02:25:42.418152+0000","last_became_peered":"2024-08-17T02:25:42.418152+0000","last_unstale":"2024-08-17T02:25:42.418431+0000","last_undegraded":"2024-08-17T02:25:42.418431+0000","last_fullsized":"2024-08-17T02:25:42.418431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418167+0000","last_change":"2024-08-17T02:25:42.418167+0000","last_active":"2024-08-17T02:25:42.418167+0000","last_peered":"2024-08-17T02:25:42.418167+0000","last_clean":"2024-08-17T02:25:42.418167+0000","last_became_active":"2024-08-17T02:25:42.417535+0000","last_became_peered":"2024-08-17T02:25:42.417535+0000","last_unstale":"2024-08-17T02:25:42.418167+0000","last_undegraded":"2024-08-17T02:25:42.418167+0000","last_fullsized":"2024-08-17T02:25:42.418167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:22:16.256006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423733+0000","last_change":"2024-08-17T02:25:42.423733+0000","last_active":"2024-08-17T02:25:42.423733+0000","last_peered":"2024-08-17T02:25:42.423733+0000","last_clean":"2024-08-17T02:25:42.423733+0000","last_became_active":"2024-08-17T02:25:42.423437+0000","last_became_peered":"2024-08-17T02:25:42.423437+0000","last_unstale":"2024-08-17T02:25:42.423733+0000","last_undegraded":"2024-08-17T02:25:42.423733+0000","last_fullsized":"2024-08-17T02:25:42.423733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:01.372278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423980+0000","last_change":"2024-08-17T02:25:42.423980+0000","last_active":"2024-08-17T02:25:42.423980+0000","last_peered":"2024-08-17T02:25:42.423980+0000","last_clean":"2024-08-17T02:25:42.423980+0000","last_became_active":"2024-08-17T02:25:42.422527+0000","last_became_peered":"2024-08-17T02:25:42.422527+0000","last_unstale":"2024-08-17T02:25:42.423980+0000","last_undegraded":"2024-08-17T02:25:42.423980+0000","last_fullsized":"2024-08-17T02:25:42.423980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:10.073499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421044+0000","last_change":"2024-08-17T02:25:42.421044+0000","last_active":"2024-08-17T02:25:42.421044+0000","last_peered":"2024-08-17T02:25:42.421044+0000","last_clean":"2024-08-17T02:25:42.421044+0000","last_became_active":"2024-08-17T02:25:42.420760+0000","last_became_peered":"2024-08-17T02:25:42.420760+0000","last_unstale":"2024-08-17T02:25:42.421044+0000","last_undegraded":"2024-08-17T02:25:42.421044+0000","last_fullsized":"2024-08-17T02:25:42.421044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:54.517688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.406076+0000","last_change":"2024-08-17T02:25:42.406076+0000","last_active":"2024-08-17T02:25:42.406076+0000","last_peered":"2024-08-17T02:25:42.406076+0000","last_clean":"2024-08-17T02:25:42.406076+0000","last_became_active":"2024-08-17T02:25:42.405724+0000","last_became_peered":"2024-08-17T02:25:42.405724+0000","last_unstale":"2024-08-17T02:25:42.406076+0000","last_undegraded":"2024-08-17T02:25:42.406076+0000","last_fullsized":"2024-08-17T02:25:42.406076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:15.820514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416984+0000","last_change":"2024-08-17T02:25:42.416984+0000","last_active":"2024-08-17T02:25:42.416984+0000","last_peered":"2024-08-17T02:25:42.416984+0000","last_clean":"2024-08-17T02:25:42.416984+0000","last_became_active":"2024-08-17T02:25:42.415956+0000","last_became_peered":"2024-08-17T02:25:42.415956+0000","last_unstale":"2024-08-17T02:25:42.416984+0000","last_undegraded":"2024-08-17T02:25:42.416984+0000","last_fullsized":"2024-08-17T02:25:42.416984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:06.955772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.407630+0000","last_change":"2024-08-17T02:25:42.407630+0000","last_active":"2024-08-17T02:25:42.407630+0000","last_peered":"2024-08-17T02:25:42.407630+0000","last_clean":"2024-08-17T02:25:42.407630+0000","last_became_active":"2024-08-17T02:25:42.407237+0000","last_became_peered":"2024-08-17T02:25:42.407237+0000","last_unstale":"2024-08-17T02:25:42.407630+0000","last_undegraded":"2024-08-17T02:25:42.407630+0000","last_fullsized":"2024-08-17T02:25:42.407630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:22.134006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.415635+0000","last_change":"2024-08-17T02:25:42.415635+0000","last_active":"2024-08-17T02:25:42.415635+0000","last_peered":"2024-08-17T02:25:42.415635+0000","last_clean":"2024-08-17T02:25:42.415635+0000","last_became_active":"2024-08-17T02:25:42.406945+0000","last_became_peered":"2024-08-17T02:25:42.406945+0000","last_unstale":"2024-08-17T02:25:42.415635+0000","last_undegraded":"2024-08-17T02:25:42.415635+0000","last_fullsized":"2024-08-17T02:25:42.415635+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419390+0000","last_change":"2024-08-17T02:25:42.419390+0000","last_active":"2024-08-17T02:25:42.419390+0000","last_peered":"2024-08-17T02:25:42.419390+0000","last_clean":"2024-08-17T02:25:42.419390+0000","last_became_active":"2024-08-17T02:25:42.419015+0000","last_became_peered":"2024-08-17T02:25:42.419015+0000","last_unstale":"2024-08-17T02:25:42.419390+0000","last_undegraded":"2024-08-17T02:25:42.419390+0000","last_fullsized":"2024-08-17T02:25:42.419390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:53.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416037+0000","last_change":"2024-08-17T02:25:42.416037+0000","last_active":"2024-08-17T02:25:42.416037+0000","last_peered":"2024-08-17T02:25:42.416037+0000","last_clean":"2024-08-17T02:25:42.416037+0000","last_became_active":"2024-08-17T02:25:42.415756+0000","last_became_peered":"2024-08-17T02:25:42.415756+0000","last_unstale":"2024-08-17T02:25:42.416037+0000","last_undegraded":"2024-08-17T02:25:42.416037+0000","last_fullsized":"2024-08-17T02:25:42.416037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:43.554521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421864+0000","last_change":"2024-08-17T02:25:42.421864+0000","last_active":"2024-08-17T02:25:42.421864+0000","last_peered":"2024-08-17T02:25:42.421864+0000","last_clean":"2024-08-17T02:25:42.421864+0000","last_became_active":"2024-08-17T02:25:42.421396+0000","last_became_peered":"2024-08-17T02:25:42.421396+0000","last_unstale":"2024-08-17T02:25:42.421864+0000","last_undegraded":"2024-08-17T02:25:42.421864+0000","last_fullsized":"2024-08-17T02:25:42.421864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:53:59.660258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420428+0000","last_change":"2024-08-17T02:25:42.420428+0000","last_active":"2024-08-17T02:25:42.420428+0000","last_peered":"2024-08-17T02:25:42.420428+0000","last_clean":"2024-08-17T02:25:42.420428+0000","last_became_active":"2024-08-17T02:25:42.419860+0000","last_became_peered":"2024-08-17T02:25:42.419860+0000","last_unstale":"2024-08-17T02:25:42.420428+0000","last_undegraded":"2024-08-17T02:25:42.420428+0000","last_fullsized":"2024-08-17T02:25:42.420428+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:50.507537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.427962+0000","last_change":"2024-08-17T02:25:42.427962+0000","last_active":"2024-08-17T02:25:42.427962+0000","last_peered":"2024-08-17T02:25:42.427962+0000","last_clean":"2024-08-17T02:25:42.427962+0000","last_became_active":"2024-08-17T02:25:42.427683+0000","last_became_peered":"2024-08-17T02:25:42.427683+0000","last_unstale":"2024-08-17T02:25:42.427962+0000","last_undegraded":"2024-08-17T02:25:42.427962+0000","last_fullsized":"2024-08-17T02:25:42.427962+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:39.859919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404414+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:16.638589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417839+0000","last_change":"2024-08-17T02:25:42.417839+0000","last_active":"2024-08-17T02:25:42.417839+0000","last_peered":"2024-08-17T02:25:42.417839+0000","last_clean":"2024-08-17T02:25:42.417839+0000","last_became_active":"2024-08-17T02:25:42.417570+0000","last_became_peered":"2024-08-17T02:25:42.417570+0000","last_unstale":"2024-08-17T02:25:42.417839+0000","last_undegraded":"2024-08-17T02:25:42.417839+0000","last_fullsized":"2024-08-17T02:25:42.417839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:44.235619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417567+0000","last_change":"2024-08-17T02:25:42.417567+0000","last_active":"2024-08-17T02:25:42.417567+0000","last_peered":"2024-08-17T02:25:42.417567+0000","last_clean":"2024-08-17T02:25:42.417567+0000","last_became_active":"2024-08-17T02:25:42.417216+0000","last_became_peered":"2024-08-17T02:25:42.417216+0000","last_unstale":"2024-08-17T02:25:42.417567+0000","last_undegraded":"2024-08-17T02:25:42.417567+0000","last_fullsized":"2024-08-17T02:25:42.417567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:41.195953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422296+0000","last_change":"2024-08-17T02:25:42.422296+0000","last_active":"2024-08-17T02:25:42.422296+0000","last_peered":"2024-08-17T02:25:42.422296+0000","last_clean":"2024-08-17T02:25:42.422296+0000","last_became_active":"2024-08-17T02:25:42.407208+0000","last_became_peered":"2024-08-17T02:25:42.407208+0000","last_unstale":"2024-08-17T02:25:42.422296+0000","last_undegraded":"2024-08-17T02:25:42.422296+0000","last_fullsized":"2024-08-17T02:25:42.422296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420013+0000","last_change":"2024-08-17T02:25:42.420013+0000","last_active":"2024-08-17T02:25:42.420013+0000","last_peered":"2024-08-17T02:25:42.420013+0000","last_clean":"2024-08-17T02:25:42.420013+0000","last_became_active":"2024-08-17T02:25:42.419638+0000","last_became_peered":"2024-08-17T02:25:42.419638+0000","last_unstale":"2024-08-17T02:25:42.420013+0000","last_undegraded":"2024-08-17T02:25:42.420013+0000","last_fullsized":"2024-08-17T02:25:42.420013+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:10.073499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420835+0000","last_change":"2024-08-17T02:25:42.420835+0000","last_active":"2024-08-17T02:25:42.420835+0000","last_peered":"2024-08-17T02:25:42.420835+0000","last_clean":"2024-08-17T02:25:42.420835+0000","last_became_active":"2024-08-17T02:25:42.420623+0000","last_became_peered":"2024-08-17T02:25:42.420623+0000","last_unstale":"2024-08-17T02:25:42.420835+0000","last_undegraded":"2024-08-17T02:25:42.420835+0000","last_fullsized":"2024-08-17T02:25:42.420835+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:08.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.410144+0000","last_change":"2024-08-17T02:25:42.410144+0000","last_active":"2024-08-17T02:25:42.410144+0000","last_peered":"2024-08-17T02:25:42.410144+0000","last_clean":"2024-08-17T02:25:42.410144+0000","last_became_active":"2024-08-17T02:25:42.408813+0000","last_became_peered":"2024-08-17T02:25:42.408813+0000","last_unstale":"2024-08-17T02:25:42.410144+0000","last_undegraded":"2024-08-17T02:25:42.410144+0000","last_fullsized":"2024-08-17T02:25:42.410144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:55.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.436617+0000","last_change":"2024-08-17T02:25:41.414400+0000","last_active":"2024-08-17T02:25:42.436617+0000","last_peered":"2024-08-17T02:25:42.436617+0000","last_clean":"2024-08-17T02:25:42.436617+0000","last_became_active":"2024-08-17T02:25:41.413990+0000","last_became_peered":"2024-08-17T02:25:41.413990+0000","last_unstale":"2024-08-17T02:25:42.436617+0000","last_undegraded":"2024-08-17T02:25:42.436617+0000","last_fullsized":"2024-08-17T02:25:42.436617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:09.064759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417423+0000","last_change":"2024-08-17T02:25:42.417423+0000","last_active":"2024-08-17T02:25:42.417423+0000","last_peered":"2024-08-17T02:25:42.417423+0000","last_clean":"2024-08-17T02:25:42.417423+0000","last_became_active":"2024-08-17T02:25:42.417172+0000","last_became_peered":"2024-08-17T02:25:42.417172+0000","last_unstale":"2024-08-17T02:25:42.417423+0000","last_undegraded":"2024-08-17T02:25:42.417423+0000","last_fullsized":"2024-08-17T02:25:42.417423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:47.035562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.413880+0000","last_change":"2024-08-17T02:25:41.412731+0000","last_active":"2024-08-17T02:25:42.413880+0000","last_peered":"2024-08-17T02:25:42.413880+0000","last_clean":"2024-08-17T02:25:42.413880+0000","last_became_active":"2024-08-17T02:25:41.412451+0000","last_became_peered":"2024-08-17T02:25:41.412451+0000","last_unstale":"2024-08-17T02:25:42.413880+0000","last_undegraded":"2024-08-17T02:25:42.413880+0000","last_fullsized":"2024-08-17T02:25:42.413880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:54.301346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423308+0000","last_change":"2024-08-17T02:25:42.423308+0000","last_active":"2024-08-17T02:25:42.423308+0000","last_peered":"2024-08-17T02:25:42.423308+0000","last_clean":"2024-08-17T02:25:42.423308+0000","last_became_active":"2024-08-17T02:25:42.422988+0000","last_became_peered":"2024-08-17T02:25:42.422988+0000","last_unstale":"2024-08-17T02:25:42.423308+0000","last_undegraded":"2024-08-17T02:25:42.423308+0000","last_fullsized":"2024-08-17T02:25:42.423308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:00:06.810017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434405+0000","last_change":"2024-08-17T02:25:41.414749+0000","last_active":"2024-08-17T02:25:42.434405+0000","last_peered":"2024-08-17T02:25:42.434405+0000","last_clean":"2024-08-17T02:25:42.434405+0000","last_became_active":"2024-08-17T02:25:41.414484+0000","last_became_peered":"2024-08-17T02:25:41.414484+0000","last_unstale":"2024-08-17T02:25:42.434405+0000","last_undegraded":"2024-08-17T02:25:42.434405+0000","last_fullsized":"2024-08-17T02:25:42.434405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:48:43.410239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416685+0000","last_change":"2024-08-17T02:25:42.416685+0000","last_active":"2024-08-17T02:25:42.416685+0000","last_peered":"2024-08-17T02:25:42.416685+0000","last_clean":"2024-08-17T02:25:42.416685+0000","last_became_active":"2024-08-17T02:25:42.416113+0000","last_became_peered":"2024-08-17T02:25:42.416113+0000","last_unstale":"2024-08-17T02:25:42.416685+0000","last_undegraded":"2024-08-17T02:25:42.416685+0000","last_fullsized":"2024-08-17T02:25:42.416685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:41.832444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434872+0000","last_change":"2024-08-17T02:25:41.419882+0000","last_active":"2024-08-17T02:25:42.434872+0000","last_peered":"2024-08-17T02:25:42.434872+0000","last_clean":"2024-08-17T02:25:42.434872+0000","last_became_active":"2024-08-17T02:25:41.419595+0000","last_became_peered":"2024-08-17T02:25:41.419595+0000","last_unstale":"2024-08-17T02:25:42.434872+0000","last_undegraded":"2024-08-17T02:25:42.434872+0000","last_fullsized":"2024-08-17T02:25:42.434872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:28.023006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418376+0000","last_change":"2024-08-17T02:25:42.418376+0000","last_active":"2024-08-17T02:25:42.418376+0000","last_peered":"2024-08-17T02:25:42.418376+0000","last_clean":"2024-08-17T02:25:42.418376+0000","last_became_active":"2024-08-17T02:25:42.417769+0000","last_became_peered":"2024-08-17T02:25:42.417769+0000","last_unstale":"2024-08-17T02:25:42.418376+0000","last_undegraded":"2024-08-17T02:25:42.418376+0000","last_fullsized":"2024-08-17T02:25:42.418376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:57.975103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.412210+0000","last_change":"2024-08-17T02:25:41.413895+0000","last_active":"2024-08-17T02:25:42.412210+0000","last_peered":"2024-08-17T02:25:42.412210+0000","last_clean":"2024-08-17T02:25:42.412210+0000","last_became_active":"2024-08-17T02:25:41.413485+0000","last_became_peered":"2024-08-17T02:25:41.413485+0000","last_unstale":"2024-08-17T02:25:42.412210+0000","last_undegraded":"2024-08-17T02:25:42.412210+0000","last_fullsized":"2024-08-17T02:25:42.412210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:56.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419203+0000","last_change":"2024-08-17T02:25:42.419203+0000","last_active":"2024-08-17T02:25:42.419203+0000","last_peered":"2024-08-17T02:25:42.419203+0000","last_clean":"2024-08-17T02:25:42.419203+0000","last_became_active":"2024-08-17T02:25:42.418852+0000","last_became_peered":"2024-08-17T02:25:42.418852+0000","last_unstale":"2024-08-17T02:25:42.419203+0000","last_undegraded":"2024-08-17T02:25:42.419203+0000","last_fullsized":"2024-08-17T02:25:42.419203+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:01.372278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.411348+0000","last_change":"2024-08-17T02:25:41.416539+0000","last_active":"2024-08-17T02:25:42.411348+0000","last_peered":"2024-08-17T02:25:42.411348+0000","last_clean":"2024-08-17T02:25:42.411348+0000","last_became_active":"2024-08-17T02:25:41.416179+0000","last_became_peered":"2024-08-17T02:25:41.416179+0000","last_unstale":"2024-08-17T02:25:42.411348+0000","last_undegraded":"2024-08-17T02:25:42.411348+0000","last_fullsized":"2024-08-17T02:25:42.411348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:34.320598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429847+0000","last_change":"2024-08-17T02:25:42.429847+0000","last_active":"2024-08-17T02:25:42.429847+0000","last_peered":"2024-08-17T02:25:42.429847+0000","last_clean":"2024-08-17T02:25:42.429847+0000","last_became_active":"2024-08-17T02:25:42.429552+0000","last_became_peered":"2024-08-17T02:25:42.429552+0000","last_unstale":"2024-08-17T02:25:42.429847+0000","last_undegraded":"2024-08-17T02:25:42.429847+0000","last_fullsized":"2024-08-17T02:25:42.429847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:27.411778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416478+0000","last_change":"2024-08-17T02:25:41.413648+0000","last_active":"2024-08-17T02:25:41.416478+0000","last_peered":"2024-08-17T02:25:41.416478+0000","last_clean":"2024-08-17T02:25:41.416478+0000","last_became_active":"2024-08-17T02:25:41.413311+0000","last_became_peered":"2024-08-17T02:25:41.413311+0000","last_unstale":"2024-08-17T02:25:41.416478+0000","last_undegraded":"2024-08-17T02:25:41.416478+0000","last_fullsized":"2024-08-17T02:25:41.416478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:12.438714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420210+0000","last_change":"2024-08-17T02:25:42.420210+0000","last_active":"2024-08-17T02:25:42.420210+0000","last_peered":"2024-08-17T02:25:42.420210+0000","last_clean":"2024-08-17T02:25:42.420210+0000","last_became_active":"2024-08-17T02:25:42.419925+0000","last_became_peered":"2024-08-17T02:25:42.419925+0000","last_unstale":"2024-08-17T02:25:42.420210+0000","last_undegraded":"2024-08-17T02:25:42.420210+0000","last_fullsized":"2024-08-17T02:25:42.420210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:18.458775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.420278+0000","last_change":"2024-08-17T02:25:41.419672+0000","last_active":"2024-08-17T02:25:41.420278+0000","last_peered":"2024-08-17T02:25:41.420278+0000","last_clean":"2024-08-17T02:25:41.420278+0000","last_became_active":"2024-08-17T02:25:41.419363+0000","last_became_peered":"2024-08-17T02:25:41.419363+0000","last_unstale":"2024-08-17T02:25:41.420278+0000","last_undegraded":"2024-08-17T02:25:41.420278+0000","last_fullsized":"2024-08-17T02:25:41.420278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:03.263540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.414001+0000","last_change":"2024-08-17T02:25:42.414001+0000","last_active":"2024-08-17T02:25:42.414001+0000","last_peered":"2024-08-17T02:25:42.414001+0000","last_clean":"2024-08-17T02:25:42.414001+0000","last_became_active":"2024-08-17T02:25:42.413711+0000","last_became_peered":"2024-08-17T02:25:42.413711+0000","last_unstale":"2024-08-17T02:25:42.414001+0000","last_undegraded":"2024-08-17T02:25:42.414001+0000","last_fullsized":"2024-08-17T02:25:42.414001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:00.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.412465+0000","last_change":"2024-08-17T02:25:41.412465+0000","last_active":"2024-08-17T02:25:41.412465+0000","last_peered":"2024-08-17T02:25:41.412465+0000","last_clean":"2024-08-17T02:25:41.412465+0000","last_became_active":"2024-08-17T02:25:41.412180+0000","last_became_peered":"2024-08-17T02:25:41.412180+0000","last_unstale":"2024-08-17T02:25:41.412465+0000","last_undegraded":"2024-08-17T02:25:41.412465+0000","last_fullsized":"2024-08-17T02:25:41.412465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:40:41.453122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416127+0000","last_change":"2024-08-17T02:25:42.416127+0000","last_active":"2024-08-17T02:25:42.416127+0000","last_peered":"2024-08-17T02:25:42.416127+0000","last_clean":"2024-08-17T02:25:42.416127+0000","last_became_active":"2024-08-17T02:25:42.415840+0000","last_became_peered":"2024-08-17T02:25:42.415840+0000","last_unstale":"2024-08-17T02:25:42.416127+0000","last_undegraded":"2024-08-17T02:25:42.416127+0000","last_fullsized":"2024-08-17T02:25:42.416127+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:08.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416977+0000","last_change":"2024-08-17T02:25:41.416977+0000","last_active":"2024-08-17T02:25:41.416977+0000","last_peered":"2024-08-17T02:25:41.416977+0000","last_clean":"2024-08-17T02:25:41.416977+0000","last_became_active":"2024-08-17T02:25:41.416573+0000","last_became_peered":"2024-08-17T02:25:41.416573+0000","last_unstale":"2024-08-17T02:25:41.416977+0000","last_undegraded":"2024-08-17T02:25:41.416977+0000","last_fullsized":"2024-08-17T02:25:41.416977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:14.096901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420814+0000","last_change":"2024-08-17T02:25:42.420814+0000","last_active":"2024-08-17T02:25:42.420814+0000","last_peered":"2024-08-17T02:25:42.420814+0000","last_clean":"2024-08-17T02:25:42.420814+0000","last_became_active":"2024-08-17T02:25:42.420331+0000","last_became_peered":"2024-08-17T02:25:42.420331+0000","last_unstale":"2024-08-17T02:25:42.420814+0000","last_undegraded":"2024-08-17T02:25:42.420814+0000","last_fullsized":"2024-08-17T02:25:42.420814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:22.274775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433174+0000","last_change":"2024-08-17T02:25:41.406456+0000","last_active":"2024-08-17T02:25:42.433174+0000","last_peered":"2024-08-17T02:25:42.433174+0000","last_clean":"2024-08-17T02:25:42.433174+0000","last_became_active":"2024-08-17T02:25:41.406085+0000","last_became_peered":"2024-08-17T02:25:41.406085+0000","last_unstale":"2024-08-17T02:25:42.433174+0000","last_undegraded":"2024-08-17T02:25:42.433174+0000","last_fullsized":"2024-08-17T02:25:42.433174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:40.187213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419317+0000","last_change":"2024-08-17T02:25:42.419317+0000","last_active":"2024-08-17T02:25:42.419317+0000","last_peered":"2024-08-17T02:25:42.419317+0000","last_clean":"2024-08-17T02:25:42.419317+0000","last_became_active":"2024-08-17T02:25:42.418969+0000","last_became_peered":"2024-08-17T02:25:42.418969+0000","last_unstale":"2024-08-17T02:25:42.419317+0000","last_undegraded":"2024-08-17T02:25:42.419317+0000","last_fullsized":"2024-08-17T02:25:42.419317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:50.507537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434765+0000","last_change":"2024-08-17T02:25:41.419970+0000","last_active":"2024-08-17T02:25:42.434765+0000","last_peered":"2024-08-17T02:25:42.434765+0000","last_clean":"2024-08-17T02:25:42.434765+0000","last_became_active":"2024-08-17T02:25:41.419704+0000","last_became_peered":"2024-08-17T02:25:41.419704+0000","last_unstale":"2024-08-17T02:25:42.434765+0000","last_undegraded":"2024-08-17T02:25:42.434765+0000","last_fullsized":"2024-08-17T02:25:42.434765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:01.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416809+0000","last_change":"2024-08-17T02:25:42.416809+0000","last_active":"2024-08-17T02:25:42.416809+0000","last_peered":"2024-08-17T02:25:42.416809+0000","last_clean":"2024-08-17T02:25:42.416809+0000","last_became_active":"2024-08-17T02:25:42.416549+0000","last_became_peered":"2024-08-17T02:25:42.416549+0000","last_unstale":"2024-08-17T02:25:42.416809+0000","last_undegraded":"2024-08-17T02:25:42.416809+0000","last_fullsized":"2024-08-17T02:25:42.416809+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:18.471103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433055+0000","last_change":"2024-08-17T02:25:41.415123+0000","last_active":"2024-08-17T02:25:42.433055+0000","last_peered":"2024-08-17T02:25:42.433055+0000","last_clean":"2024-08-17T02:25:42.433055+0000","last_became_active":"2024-08-17T02:25:41.414783+0000","last_became_peered":"2024-08-17T02:25:41.414783+0000","last_unstale":"2024-08-17T02:25:42.433055+0000","last_undegraded":"2024-08-17T02:25:42.433055+0000","last_fullsized":"2024-08-17T02:25:42.433055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:06.176945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418728+0000","last_change":"2024-08-17T02:25:42.418728+0000","last_active":"2024-08-17T02:25:42.418728+0000","last_peered":"2024-08-17T02:25:42.418728+0000","last_clean":"2024-08-17T02:25:42.418728+0000","last_became_active":"2024-08-17T02:25:42.418446+0000","last_became_peered":"2024-08-17T02:25:42.418446+0000","last_unstale":"2024-08-17T02:25:42.418728+0000","last_undegraded":"2024-08-17T02:25:42.418728+0000","last_fullsized":"2024-08-17T02:25:42.418728+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:42.876425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.422123+0000","last_change":"2024-08-17T02:25:41.417738+0000","last_active":"2024-08-17T02:25:41.422123+0000","last_peered":"2024-08-17T02:25:41.422123+0000","last_clean":"2024-08-17T02:25:41.422123+0000","last_became_active":"2024-08-17T02:25:41.417458+0000","last_became_peered":"2024-08-17T02:25:41.417458+0000","last_unstale":"2024-08-17T02:25:41.422123+0000","last_undegraded":"2024-08-17T02:25:41.422123+0000","last_fullsized":"2024-08-17T02:25:41.422123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:42.545781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.426300+0000","last_change":"2024-08-17T02:25:42.426300+0000","last_active":"2024-08-17T02:25:42.426300+0000","last_peered":"2024-08-17T02:25:42.426300+0000","last_clean":"2024-08-17T02:25:42.426300+0000","last_became_active":"2024-08-17T02:25:42.425814+0000","last_became_peered":"2024-08-17T02:25:42.425814+0000","last_unstale":"2024-08-17T02:25:42.426300+0000","last_undegraded":"2024-08-17T02:25:42.426300+0000","last_fullsized":"2024-08-17T02:25:42.426300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.419395+0000","last_change":"2024-08-17T02:25:41.412269+0000","last_active":"2024-08-17T02:25:41.419395+0000","last_peered":"2024-08-17T02:25:41.419395+0000","last_clean":"2024-08-17T02:25:41.419395+0000","last_became_active":"2024-08-17T02:25:41.411996+0000","last_became_peered":"2024-08-17T02:25:41.411996+0000","last_unstale":"2024-08-17T02:25:41.419395+0000","last_undegraded":"2024-08-17T02:25:41.419395+0000","last_fullsized":"2024-08-17T02:25:41.419395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:26.990290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421316+0000","last_change":"2024-08-17T02:25:42.421316+0000","last_active":"2024-08-17T02:25:42.421316+0000","last_peered":"2024-08-17T02:25:42.421316+0000","last_clean":"2024-08-17T02:25:42.421316+0000","last_became_active":"2024-08-17T02:25:42.421027+0000","last_became_peered":"2024-08-17T02:25:42.421027+0000","last_unstale":"2024-08-17T02:25:42.421316+0000","last_undegraded":"2024-08-17T02:25:42.421316+0000","last_fullsized":"2024-08-17T02:25:42.421316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:22.274775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434466+0000","last_change":"2024-08-17T02:25:41.417196+0000","last_active":"2024-08-17T02:25:42.434466+0000","last_peered":"2024-08-17T02:25:42.434466+0000","last_clean":"2024-08-17T02:25:42.434466+0000","last_became_active":"2024-08-17T02:25:41.416884+0000","last_became_peered":"2024-08-17T02:25:41.416884+0000","last_unstale":"2024-08-17T02:25:42.434466+0000","last_undegraded":"2024-08-17T02:25:42.434466+0000","last_fullsized":"2024-08-17T02:25:42.434466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:51.323262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419706+0000","last_change":"2024-08-17T02:25:42.419706+0000","last_active":"2024-08-17T02:25:42.419706+0000","last_peered":"2024-08-17T02:25:42.419706+0000","last_clean":"2024-08-17T02:25:42.419706+0000","last_became_active":"2024-08-17T02:25:42.419419+0000","last_became_peered":"2024-08-17T02:25:42.419419+0000","last_unstale":"2024-08-17T02:25:42.419706+0000","last_undegraded":"2024-08-17T02:25:42.419706+0000","last_fullsized":"2024-08-17T02:25:42.419706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:45.898859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.401468+0000","last_change":"2024-08-17T02:25:41.413608+0000","last_active":"2024-08-17T02:25:42.401468+0000","last_peered":"2024-08-17T02:25:42.401468+0000","last_clean":"2024-08-17T02:25:42.401468+0000","last_became_active":"2024-08-17T02:25:41.413299+0000","last_became_peered":"2024-08-17T02:25:41.413299+0000","last_unstale":"2024-08-17T02:25:42.401468+0000","last_undegraded":"2024-08-17T02:25:42.401468+0000","last_fullsized":"2024-08-17T02:25:42.401468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:59.656053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429851+0000","last_change":"2024-08-17T02:25:42.429851+0000","last_active":"2024-08-17T02:25:42.429851+0000","last_peered":"2024-08-17T02:25:42.429851+0000","last_clean":"2024-08-17T02:25:42.429851+0000","last_became_active":"2024-08-17T02:25:42.429575+0000","last_became_peered":"2024-08-17T02:25:42.429575+0000","last_unstale":"2024-08-17T02:25:42.429851+0000","last_undegraded":"2024-08-17T02:25:42.429851+0000","last_fullsized":"2024-08-17T02:25:42.429851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:33.834531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433034+0000","last_change":"2024-08-17T02:25:41.416074+0000","last_active":"2024-08-17T02:25:42.433034+0000","last_peered":"2024-08-17T02:25:42.433034+0000","last_clean":"2024-08-17T02:25:42.433034+0000","last_became_active":"2024-08-17T02:25:41.415694+0000","last_became_peered":"2024-08-17T02:25:41.415694+0000","last_unstale":"2024-08-17T02:25:42.433034+0000","last_undegraded":"2024-08-17T02:25:42.433034+0000","last_fullsized":"2024-08-17T02:25:42.433034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:14.811773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404286+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:55.604947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.405428+0000","last_change":"2024-08-17T02:25:41.411845+0000","last_active":"2024-08-17T02:25:42.405428+0000","last_peered":"2024-08-17T02:25:42.405428+0000","last_clean":"2024-08-17T02:25:42.405428+0000","last_became_active":"2024-08-17T02:25:41.410319+0000","last_became_peered":"2024-08-17T02:25:41.410319+0000","last_unstale":"2024-08-17T02:25:42.405428+0000","last_undegraded":"2024-08-17T02:25:42.405428+0000","last_fullsized":"2024-08-17T02:25:42.405428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:26.741363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.410194+0000","last_change":"2024-08-17T02:25:42.410194+0000","last_active":"2024-08-17T02:25:42.410194+0000","last_peered":"2024-08-17T02:25:42.410194+0000","last_clean":"2024-08-17T02:25:42.410194+0000","last_became_active":"2024-08-17T02:25:42.409899+0000","last_became_peered":"2024-08-17T02:25:42.409899+0000","last_unstale":"2024-08-17T02:25:42.410194+0000","last_undegraded":"2024-08-17T02:25:42.410194+0000","last_fullsized":"2024-08-17T02:25:42.410194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:02.087099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.412888+0000","last_change":"2024-08-17T02:25:41.408140+0000","last_active":"2024-08-17T02:25:41.412888+0000","last_peered":"2024-08-17T02:25:41.412888+0000","last_clean":"2024-08-17T02:25:41.412888+0000","last_became_active":"2024-08-17T02:25:41.407869+0000","last_became_peered":"2024-08-17T02:25:41.407869+0000","last_unstale":"2024-08-17T02:25:41.412888+0000","last_undegraded":"2024-08-17T02:25:41.412888+0000","last_fullsized":"2024-08-17T02:25:41.412888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:22.195354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.407511+0000","last_change":"2024-08-17T02:25:42.407511+0000","last_active":"2024-08-17T02:25:42.407511+0000","last_peered":"2024-08-17T02:25:42.407511+0000","last_clean":"2024-08-17T02:25:42.407511+0000","last_became_active":"2024-08-17T02:25:42.407273+0000","last_became_peered":"2024-08-17T02:25:42.407273+0000","last_unstale":"2024-08-17T02:25:42.407511+0000","last_undegraded":"2024-08-17T02:25:42.407511+0000","last_fullsized":"2024-08-17T02:25:42.407511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:09.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.420302+0000","last_change":"2024-08-17T02:25:41.420302+0000","last_active":"2024-08-17T02:25:41.420302+0000","last_peered":"2024-08-17T02:25:41.420302+0000","last_clean":"2024-08-17T02:25:41.420302+0000","last_became_active":"2024-08-17T02:25:41.419958+0000","last_became_peered":"2024-08-17T02:25:41.419958+0000","last_unstale":"2024-08-17T02:25:41.420302+0000","last_undegraded":"2024-08-17T02:25:41.420302+0000","last_fullsized":"2024-08-17T02:25:41.420302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:53.300389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.407078+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:14.445941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416402+0000","last_change":"2024-08-17T02:25:41.412762+0000","last_active":"2024-08-17T02:25:41.416402+0000","last_peered":"2024-08-17T02:25:41.416402+0000","last_clean":"2024-08-17T02:25:41.416402+0000","last_became_active":"2024-08-17T02:25:41.412398+0000","last_became_peered":"2024-08-17T02:25:41.412398+0000","last_unstale":"2024-08-17T02:25:41.416402+0000","last_undegraded":"2024-08-17T02:25:41.416402+0000","last_fullsized":"2024-08-17T02:25:41.416402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:01.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422487+0000","last_change":"2024-08-17T02:25:42.422487+0000","last_active":"2024-08-17T02:25:42.422487+0000","last_peered":"2024-08-17T02:25:42.422487+0000","last_clean":"2024-08-17T02:25:42.422487+0000","last_became_active":"2024-08-17T02:25:42.422179+0000","last_became_peered":"2024-08-17T02:25:42.422179+0000","last_unstale":"2024-08-17T02:25:42.422487+0000","last_undegraded":"2024-08-17T02:25:42.422487+0000","last_fullsized":"2024-08-17T02:25:42.422487+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.411049+0000","last_change":"2024-08-17T02:25:41.408829+0000","last_active":"2024-08-17T02:25:41.411049+0000","last_peered":"2024-08-17T02:25:41.411049+0000","last_clean":"2024-08-17T02:25:41.411049+0000","last_became_active":"2024-08-17T02:25:41.408507+0000","last_became_peered":"2024-08-17T02:25:41.408507+0000","last_unstale":"2024-08-17T02:25:41.411049+0000","last_undegraded":"2024-08-17T02:25:41.411049+0000","last_fullsized":"2024-08-17T02:25:41.411049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:55.936904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.428934+0000","last_change":"2024-08-17T02:25:42.428934+0000","last_active":"2024-08-17T02:25:42.428934+0000","last_peered":"2024-08-17T02:25:42.428934+0000","last_clean":"2024-08-17T02:25:42.428934+0000","last_became_active":"2024-08-17T02:25:42.428579+0000","last_became_peered":"2024-08-17T02:25:42.428579+0000","last_unstale":"2024-08-17T02:25:42.428934+0000","last_undegraded":"2024-08-17T02:25:42.428934+0000","last_fullsized":"2024-08-17T02:25:42.428934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:01:35.750552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.405319+0000","last_change":"2024-08-17T02:25:41.404004+0000","last_active":"2024-08-17T02:25:41.405319+0000","last_peered":"2024-08-17T02:25:41.405319+0000","last_clean":"2024-08-17T02:25:41.405319+0000","last_became_active":"2024-08-17T02:25:41.403735+0000","last_became_peered":"2024-08-17T02:25:41.403735+0000","last_unstale":"2024-08-17T02:25:41.405319+0000","last_undegraded":"2024-08-17T02:25:41.405319+0000","last_fullsized":"2024-08-17T02:25:41.405319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:42.545781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.408344+0000","last_change":"2024-08-17T02:25:42.408344+0000","last_active":"2024-08-17T02:25:42.408344+0000","last_peered":"2024-08-17T02:25:42.408344+0000","last_clean":"2024-08-17T02:25:42.408344+0000","last_became_active":"2024-08-17T02:25:42.408053+0000","last_became_peered":"2024-08-17T02:25:42.408053+0000","last_unstale":"2024-08-17T02:25:42.408344+0000","last_undegraded":"2024-08-17T02:25:42.408344+0000","last_fullsized":"2024-08-17T02:25:42.408344+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:57.975103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.432007+0000","last_change":"2024-08-17T02:25:41.411005+0000","last_active":"2024-08-17T02:25:42.432007+0000","last_peered":"2024-08-17T02:25:42.432007+0000","last_clean":"2024-08-17T02:25:42.432007+0000","last_became_active":"2024-08-17T02:25:41.410680+0000","last_became_peered":"2024-08-17T02:25:41.410680+0000","last_unstale":"2024-08-17T02:25:42.432007+0000","last_undegraded":"2024-08-17T02:25:42.432007+0000","last_fullsized":"2024-08-17T02:25:42.432007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:41.995822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.408871+0000","last_change":"2024-08-17T02:25:42.408871+0000","last_active":"2024-08-17T02:25:42.408871+0000","last_peered":"2024-08-17T02:25:42.408871+0000","last_clean":"2024-08-17T02:25:42.408871+0000","last_became_active":"2024-08-17T02:25:42.408058+0000","last_became_peered":"2024-08-17T02:25:42.408058+0000","last_unstale":"2024-08-17T02:25:42.408871+0000","last_undegraded":"2024-08-17T02:25:42.408871+0000","last_fullsized":"2024-08-17T02:25:42.408871+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:41.832444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.415141+0000","last_change":"2024-08-17T02:25:41.415141+0000","last_active":"2024-08-17T02:25:41.415141+0000","last_peered":"2024-08-17T02:25:41.415141+0000","last_clean":"2024-08-17T02:25:41.415141+0000","last_became_active":"2024-08-17T02:25:41.414871+0000","last_became_peered":"2024-08-17T02:25:41.414871+0000","last_unstale":"2024-08-17T02:25:41.415141+0000","last_undegraded":"2024-08-17T02:25:41.415141+0000","last_fullsized":"2024-08-17T02:25:41.415141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:15.442741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418873+0000","last_change":"2024-08-17T02:25:42.418873+0000","last_active":"2024-08-17T02:25:42.418873+0000","last_peered":"2024-08-17T02:25:42.418873+0000","last_clean":"2024-08-17T02:25:42.418873+0000","last_became_active":"2024-08-17T02:25:42.418596+0000","last_became_peered":"2024-08-17T02:25:42.418596+0000","last_unstale":"2024-08-17T02:25:42.418873+0000","last_undegraded":"2024-08-17T02:25:42.418873+0000","last_fullsized":"2024-08-17T02:25:42.418873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:43.004563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.407774+0000","last_change":"2024-08-17T02:25:41.406162+0000","last_active":"2024-08-17T02:25:41.407774+0000","last_peered":"2024-08-17T02:25:41.407774+0000","last_clean":"2024-08-17T02:25:41.407774+0000","last_became_active":"2024-08-17T02:25:41.405855+0000","last_became_peered":"2024-08-17T02:25:41.405855+0000","last_unstale":"2024-08-17T02:25:41.407774+0000","last_undegraded":"2024-08-17T02:25:41.407774+0000","last_fullsized":"2024-08-17T02:25:41.407774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:05.947031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423499+0000","last_change":"2024-08-17T02:25:42.423499+0000","last_active":"2024-08-17T02:25:42.423499+0000","last_peered":"2024-08-17T02:25:42.423499+0000","last_clean":"2024-08-17T02:25:42.423499+0000","last_became_active":"2024-08-17T02:25:42.423157+0000","last_became_peered":"2024-08-17T02:25:42.423157+0000","last_unstale":"2024-08-17T02:25:42.423499+0000","last_undegraded":"2024-08-17T02:25:42.423499+0000","last_fullsized":"2024-08-17T02:25:42.423499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:47.035562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416353+0000","last_change":"2024-08-17T02:25:41.411329+0000","last_active":"2024-08-17T02:25:41.416353+0000","last_peered":"2024-08-17T02:25:41.416353+0000","last_clean":"2024-08-17T02:25:41.416353+0000","last_became_active":"2024-08-17T02:25:41.410916+0000","last_became_peered":"2024-08-17T02:25:41.410916+0000","last_unstale":"2024-08-17T02:25:41.416353+0000","last_undegraded":"2024-08-17T02:25:41.416353+0000","last_fullsized":"2024-08-17T02:25:41.416353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:56.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416987+0000","last_change":"2024-08-17T02:25:42.416987+0000","last_active":"2024-08-17T02:25:42.416987+0000","last_peered":"2024-08-17T02:25:42.416987+0000","last_clean":"2024-08-17T02:25:42.416987+0000","last_became_active":"2024-08-17T02:25:42.416662+0000","last_became_peered":"2024-08-17T02:25:42.416662+0000","last_unstale":"2024-08-17T02:25:42.416987+0000","last_undegraded":"2024-08-17T02:25:42.416987+0000","last_fullsized":"2024-08-17T02:25:42.416987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:00.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416400+0000","last_change":"2024-08-17T02:25:41.411479+0000","last_active":"2024-08-17T02:25:41.416400+0000","last_peered":"2024-08-17T02:25:41.416400+0000","last_clean":"2024-08-17T02:25:41.416400+0000","last_became_active":"2024-08-17T02:25:41.411185+0000","last_became_peered":"2024-08-17T02:25:41.411185+0000","last_unstale":"2024-08-17T02:25:41.416400+0000","last_undegraded":"2024-08-17T02:25:41.416400+0000","last_fullsized":"2024-08-17T02:25:41.416400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:14.811773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.426045+0000","last_change":"2024-08-17T02:25:42.426045+0000","last_active":"2024-08-17T02:25:42.426045+0000","last_peered":"2024-08-17T02:25:42.426045+0000","last_clean":"2024-08-17T02:25:42.426045+0000","last_became_active":"2024-08-17T02:25:42.425767+0000","last_became_peered":"2024-08-17T02:25:42.425767+0000","last_unstale":"2024-08-17T02:25:42.426045+0000","last_undegraded":"2024-08-17T02:25:42.426045+0000","last_fullsized":"2024-08-17T02:25:42.426045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:54.517688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.417303+0000","last_change":"2024-08-17T02:25:41.416245+0000","last_active":"2024-08-17T02:25:41.417303+0000","last_peered":"2024-08-17T02:25:41.417303+0000","last_clean":"2024-08-17T02:25:41.417303+0000","last_became_active":"2024-08-17T02:25:41.415762+0000","last_became_peered":"2024-08-17T02:25:41.415762+0000","last_unstale":"2024-08-17T02:25:41.417303+0000","last_undegraded":"2024-08-17T02:25:41.417303+0000","last_fullsized":"2024-08-17T02:25:41.417303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:05.947031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.409630+0000","last_change":"2024-08-17T02:25:42.409630+0000","last_active":"2024-08-17T02:25:42.409630+0000","last_peered":"2024-08-17T02:25:42.409630+0000","last_clean":"2024-08-17T02:25:42.409630+0000","last_became_active":"2024-08-17T02:25:42.409370+0000","last_became_peered":"2024-08-17T02:25:42.409370+0000","last_unstale":"2024-08-17T02:25:42.409630+0000","last_undegraded":"2024-08-17T02:25:42.409630+0000","last_fullsized":"2024-08-17T02:25:42.409630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:42.876425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.419542+0000","last_change":"2024-08-17T02:25:41.413754+0000","last_active":"2024-08-17T02:25:41.419542+0000","last_peered":"2024-08-17T02:25:41.419542+0000","last_clean":"2024-08-17T02:25:41.419542+0000","last_became_active":"2024-08-17T02:25:41.413461+0000","last_became_peered":"2024-08-17T02:25:41.413461+0000","last_unstale":"2024-08-17T02:25:41.419542+0000","last_undegraded":"2024-08-17T02:25:41.419542+0000","last_fullsized":"2024-08-17T02:25:41.419542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:21.125266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422150+0000","last_change":"2024-08-17T02:25:42.422150+0000","last_active":"2024-08-17T02:25:42.422150+0000","last_peered":"2024-08-17T02:25:42.422150+0000","last_clean":"2024-08-17T02:25:42.422150+0000","last_became_active":"2024-08-17T02:25:42.409094+0000","last_became_peered":"2024-08-17T02:25:42.409094+0000","last_unstale":"2024-08-17T02:25:42.422150+0000","last_undegraded":"2024-08-17T02:25:42.422150+0000","last_fullsized":"2024-08-17T02:25:42.422150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:44.235619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.415642+0000","last_change":"2024-08-17T02:25:41.413342+0000","last_active":"2024-08-17T02:25:41.415642+0000","last_peered":"2024-08-17T02:25:41.415642+0000","last_clean":"2024-08-17T02:25:41.415642+0000","last_became_active":"2024-08-17T02:25:41.411807+0000","last_became_peered":"2024-08-17T02:25:41.411807+0000","last_unstale":"2024-08-17T02:25:41.415642+0000","last_undegraded":"2024-08-17T02:25:41.415642+0000","last_fullsized":"2024-08-17T02:25:41.415642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:58.112071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.397663+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:25:41.397663+0000","last_peered":"2024-08-17T02:25:41.397663+0000","last_clean":"2024-08-17T02:25:41.397663+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:25:41.397663+0000","last_undegraded":"2024-08-17T02:25:41.397663+0000","last_fullsized":"2024-08-17T02:25:41.397663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":393216,"data_stored":149055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.804},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.66300000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.746},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.0449999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":2.0259999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.099}]},{"osd":6,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.165},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":2.073}]}]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297748,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074092,"statfs":{"total":96636764160,"available":96331870208,"internally_reserved":0,"allocated":401408,"data_stored":150585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.008}]},{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.083}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.85599999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.1739999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.212},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.2330000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.135}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.113},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1799999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.0549999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0840000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297760,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074080,"statfs":{"total":96636764160,"available":96331857920,"internally_reserved":0,"allocated":405504,"data_stored":149797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.82699999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.78300000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.621},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.74399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.296}]},{"osd":5,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.3640000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.391},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.337}]},{"osd":7,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.47}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.75700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.44},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.91200000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.099}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":970752,"data_stored":732638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.95199999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.083},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.89600000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.02}]},{"osd":7,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.137},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1719999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.1140000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.014},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.79300000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.208}]},{"osd":4,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.054}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.25},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.325}]},{"osd":6,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.399},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.2769999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.361},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.304}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":958464,"data_stored":726375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.60699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.026},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.91700000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.0609999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.115}]},{"osd":7,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.135},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.095}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:46.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-08-17T02:25:46.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:41.379334+0000', 'last_change': '2024-08-17T02:25:41.404932+0000', 'last_active': '2024-08-17T02:25:41.379334+0000', 'last_peered': '2024-08-17T02:25:41.379334+0000', 'last_clean': '2024-08-17T02:25:41.379334+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:41.379334+0000', 'last_undegraded': '2024-08-17T02:25:41.379334+0000', 'last_fullsized': '2024-08-17T02:25:41.379334+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:09:07.672234+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:25:46.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-08-17T02:25:46.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:41.379334+0000', 'last_change': '2024-08-17T02:25:41.407547+0000', 'last_active': '2024-08-17T02:25:41.379334+0000', 'last_peered': '2024-08-17T02:25:41.379334+0000', 'last_clean': '2024-08-17T02:25:41.379334+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:41.379334+0000', 'last_undegraded': '2024-08-17T02:25:41.379334+0000', 'last_fullsized': '2024-08-17T02:25:41.379334+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:49:35.652729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:25:46.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-08-17T02:25:46.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:41.379334+0000', 'last_change': '2024-08-17T02:25:41.404414+0000', 'last_active': '2024-08-17T02:25:41.379334+0000', 'last_peered': '2024-08-17T02:25:41.379334+0000', 'last_clean': '2024-08-17T02:25:41.379334+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:41.379334+0000', 'last_undegraded': '2024-08-17T02:25:41.379334+0000', 'last_fullsized': '2024-08-17T02:25:41.379334+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T12:04:16.638589+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:25:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-08-17T02:25:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:41.379334+0000', 'last_change': '2024-08-17T02:25:41.404286+0000', 'last_active': '2024-08-17T02:25:41.379334+0000', 'last_peered': '2024-08-17T02:25:41.379334+0000', 'last_clean': '2024-08-17T02:25:41.379334+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:41.379334+0000', 'last_undegraded': '2024-08-17T02:25:41.379334+0000', 'last_fullsized': '2024-08-17T02:25:41.379334+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T04:01:55.604947+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:25:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-08-17T02:25:46.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-08-17T02:25:41.379334+0000', 'last_change': '2024-08-17T02:25:41.407078+0000', 'last_active': '2024-08-17T02:25:41.379334+0000', 'last_peered': '2024-08-17T02:25:41.379334+0000', 'last_clean': '2024-08-17T02:25:41.379334+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-17T02:25:41.379334+0000', 'last_undegraded': '2024-08-17T02:25:41.379334+0000', 'last_fullsized': '2024-08-17T02:25:41.379334+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'last_clean_scrub_stamp': '2024-08-17T02:25:41.379334+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-08-18T10:51:14.445941+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-17T02:25:46.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-17T02:25:46.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb49813b700 1 Processor -- start 2024-08-17T02:25:46.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb49813b700 1 -- start start 2024-08-17T02:25:46.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb49813b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb490155600 0x7fb4900b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb49813b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4900aff70 0x7fb490156990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb49813b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb490156500 con 0x7fb4901559d0 2024-08-17T02:25:46.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb49813b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4900ae860 con 0x7fb490155600 2024-08-17T02:25:46.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb49813b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb490155eb0 con 0x7fb4900aff70 2024-08-17T02:25:46.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb4966d8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4900aff70 0x7fb490156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb495ed7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb490155600 0x7fb4900b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb4966d8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4900aff70 0x7fb490156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:51888/0 (socket says 172.21.15.31:51888) 2024-08-17T02:25:46.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb4966d8700 1 -- 172.21.15.31:0/4152883808 learned_addr learned my addr 172.21.15.31:0/4152883808 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:46.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb4956d6700 1 --1- 172.21.15.31:0/4152883808 >> v1:172.21.15.92:6789/0 conn(0x7fb4901559d0 0x7fb4900af860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:43310/0 (socket says 172.21.15.31:43310) 2024-08-17T02:25:46.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb4966d8700 1 -- 172.21.15.31:0/4152883808 >> v2:172.21.15.92:3300/0 conn(0x7fb490155600 msgr2=0x7fb4900b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:46.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb4966d8700 1 --2- 172.21.15.31:0/4152883808 >> v2:172.21.15.92:3300/0 conn(0x7fb490155600 0x7fb4900b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb4966d8700 1 -- 172.21.15.31:0/4152883808 >> v1:172.21.15.92:6789/0 conn(0x7fb4901559d0 legacy=0x7fb4900af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb4966d8700 1 -- 172.21.15.31:0/4152883808 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490156190 con 0x7fb4900aff70 2024-08-17T02:25:46.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb4966d8700 1 --2- 172.21.15.31:0/4152883808 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4900aff70 0x7fb490156990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb488009f20 tx=0x7fb488009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4df80675f50196af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb494ed5700 1 -- 172.21.15.31:0/4152883808 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48800e070 con 0x7fb4900aff70 2024-08-17T02:25:46.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb494ed5700 1 -- 172.21.15.31:0/4152883808 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48800b9d0 con 0x7fb4900aff70 2024-08-17T02:25:46.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.209+0000 7fb494ed5700 1 -- 172.21.15.31:0/4152883808 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4880092e0 con 0x7fb4900aff70 2024-08-17T02:25:46.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.213+0000 7fb49813b700 1 -- 172.21.15.31:0/4152883808 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4900aff70 msgr2=0x7fb490156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.213+0000 7fb49813b700 1 --2- 172.21.15.31:0/4152883808 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4900aff70 0x7fb490156990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb488009f20 tx=0x7fb488009840 comp rx=0 tx=0).stop 2024-08-17T02:25:46.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.213+0000 7fb49813b700 1 -- 172.21.15.31:0/4152883808 shutdown_connections 2024-08-17T02:25:46.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.213+0000 7fb49813b700 1 --2- 172.21.15.31:0/4152883808 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4900aff70 0x7fb490156990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.213+0000 7fb49813b700 1 --2- 172.21.15.31:0/4152883808 >> v2:172.21.15.92:3300/0 conn(0x7fb490155600 0x7fb4900b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.213+0000 7fb49813b700 1 -- 172.21.15.31:0/4152883808 >> 172.21.15.31:0/4152883808 conn(0x7fb4900cc990 msgr2=0x7fb490067400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.213+0000 7fb49813b700 1 -- 172.21.15.31:0/4152883808 shutdown_connections 2024-08-17T02:25:46.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.213+0000 7fb49813b700 1 -- 172.21.15.31:0/4152883808 wait complete. 2024-08-17T02:25:46.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.213+0000 7fb49813b700 1 Processor -- start 2024-08-17T02:25:46.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.213+0000 7fb49813b700 1 -- start start 2024-08-17T02:25:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb49813b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4900aff70 0x7fb490145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb49813b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb490155600 0x7fb490148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb49813b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4901559d0 0x7fb490143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb49813b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb490143de0 con 0x7fb4900aff70 2024-08-17T02:25:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb49813b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb490145860 con 0x7fb490155600 2024-08-17T02:25:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb49813b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb490145b20 con 0x7fb4901559d0 2024-08-17T02:25:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb495ed7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4900aff70 0x7fb490145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb495ed7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4900aff70 0x7fb490145320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39742/0 (socket says 172.21.15.31:39742) 2024-08-17T02:25:46.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb495ed7700 1 -- 172.21.15.31:0/1010859134 learned_addr learned my addr 172.21.15.31:0/1010859134 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb4956d6700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb490155600 0x7fb490148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb4966d8700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4901559d0 0x7fb490143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb4956d6700 1 -- 172.21.15.31:0/1010859134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4901559d0 msgr2=0x7fb490143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb4956d6700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4901559d0 0x7fb490143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb4956d6700 1 -- 172.21.15.31:0/1010859134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4900aff70 msgr2=0x7fb490145320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb4956d6700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4900aff70 0x7fb490145320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb4956d6700 1 -- 172.21.15.31:0/1010859134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488009ae0 con 0x7fb490155600 2024-08-17T02:25:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb4956d6700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb490155600 0x7fb490148830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c590 tx=0x7fb480007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb485ffb700 1 -- 172.21.15.31:0/1010859134 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480005a70 con 0x7fb490155600 2024-08-17T02:25:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb485ffb700 1 -- 172.21.15.31:0/1010859134 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb480005bf0 con 0x7fb490155600 2024-08-17T02:25:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb49813b700 1 -- 172.21.15.31:0/1010859134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb490145e00 con 0x7fb490155600 2024-08-17T02:25:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb485ffb700 1 -- 172.21.15.31:0/1010859134 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800070d0 con 0x7fb490155600 2024-08-17T02:25:46.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb49813b700 1 -- 172.21.15.31:0/1010859134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4901463c0 con 0x7fb490155600 2024-08-17T02:25:46.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.217+0000 7fb49813b700 1 -- 172.21.15.31:0/1010859134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4900712b0 con 0x7fb490155600 2024-08-17T02:25:46.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.221+0000 7fb485ffb700 1 -- 172.21.15.31:0/1010859134 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb480007480 con 0x7fb490155600 2024-08-17T02:25:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.221+0000 7fb485ffb700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb474060860 0x7fb474062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.221+0000 7fb485ffb700 1 -- 172.21.15.31:0/1010859134 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb48007bf40 con 0x7fb490155600 2024-08-17T02:25:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.221+0000 7fb495ed7700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb474060860 0x7fb474062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.221+0000 7fb495ed7700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb474060860 0x7fb474062d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb490125060 tx=0x7fb48c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.229+0000 7fb485ffb700 1 -- 172.21.15.31:0/1010859134 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb48004c410 con 0x7fb490155600 2024-08-17T02:25:46.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.453+0000 7fb49813b700 1 -- 172.21.15.31:0/1010859134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb49006b4c0 con 0x7fb490155600 2024-08-17T02:25:46.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb485ffb700 1 -- 172.21.15.31:0/1010859134 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1648 (secure 0 0 0) 0x7fb480017080 con 0x7fb490155600 2024-08-17T02:25:46.458 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:46.458 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":85,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":36,"num_osds":8,"num_up_osds":8,"osd_up_since":1723861472,"num_in_osds":8,"osd_in_since":1723861463,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"creating+peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592706,"bytes_used":2444480512,"bytes_avail":770649632768,"bytes_total":773094113280,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2550,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5043}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-08-17T02:25:33.597634+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 -- 172.21.15.31:0/1010859134 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb474060860 msgr2=0x7fb474062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb474060860 0x7fb474062d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb490125060 tx=0x7fb48c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 -- 172.21.15.31:0/1010859134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb490155600 msgr2=0x7fb490148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb490155600 0x7fb490148830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c590 tx=0x7fb480007eb0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 -- 172.21.15.31:0/1010859134 shutdown_connections 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb474060860 0x7fb474062d10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb4901559d0 0x7fb490143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb490155600 0x7fb490148830 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 --2- 172.21.15.31:0/1010859134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4900aff70 0x7fb490145320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 -- 172.21.15.31:0/1010859134 >> 172.21.15.31:0/1010859134 conn(0x7fb4900cc990 msgr2=0x7fb4900cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 -- 172.21.15.31:0/1010859134 shutdown_connections 2024-08-17T02:25:46.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.457+0000 7fb49813b700 1 -- 172.21.15.31:0/1010859134 wait complete. 2024-08-17T02:25:46.472 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-17T02:25:46.473 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:46.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f205df75700 1 Processor -- start 2024-08-17T02:25:46.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f205df75700 1 -- start start 2024-08-17T02:25:46.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f205df75700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2058140780 0x7f2058140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f205df75700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20580ca7c0 con 0x7f20580b0fe0 2024-08-17T02:25:46.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f205df75700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20580ab690 con 0x7f20580ca340 2024-08-17T02:25:46.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f205df75700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20580caa00 con 0x7f2058140780 2024-08-17T02:25:46.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f2057fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f20580b0fe0 0x7f20580c9c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50272/0 (socket says 172.21.15.31:50272) 2024-08-17T02:25:46.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f2057fff700 1 -- 172.21.15.31:0/520969967 learned_addr learned my addr 172.21.15.31:0/520969967 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:46.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f205cf73700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2058140780 0x7f2058140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050132021 0 0) 0x7f2040001110 con 0x7f20580b0fe0 2024-08-17T02:25:46.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2044003570 con 0x7f20580b0fe0 2024-08-17T02:25:46.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031930769 0 0) 0x7f20580ab690 con 0x7f20580ca340 2024-08-17T02:25:46.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2040001110 con 0x7f20580ca340 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4059767260 0 0) 0x7f2044003570 con 0x7f20580b0fe0 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2058140780 msgr2=0x7f2058140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2058140780 0x7f2058140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 >> v1:172.21.15.92:6789/0 conn(0x7f20580ca340 legacy=0x7f20580abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20580cace0 con 0x7f20580b0fe0 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f2040001600 con 0x7f20580b0fe0 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.573+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 >> v1:172.21.15.31:6789/0 conn(0x7f20580b0fe0 legacy=0x7f20580c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f20577fe700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2044003c20 0x7f2044003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f20577fe700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2044004810 0x7f2044004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f20577fe700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2058140780 0x7f20440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580caa00 con 0x7f2044004810 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204400bb40 con 0x7f2044003c20 2024-08-17T02:25:46.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204400bd00 con 0x7f2058140780 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f2057fff700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2044004810 0x7f2044004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f205cf73700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2044003c20 0x7f2044003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f205d774700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2058140780 0x7f20440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f2057fff700 1 -- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2058140780 msgr2=0x7f20440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f2057fff700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2058140780 0x7f20440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f2057fff700 1 -- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2044003c20 msgr2=0x7f2044003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f2057fff700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2044003c20 0x7f2044003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f2057fff700 1 -- 172.21.15.31:0/520969967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044003570 con 0x7f2044004810 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f205d774700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2058140780 0x7f20440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f2057fff700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2044004810 0x7f2044004c80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2040005220 tx=0x7f2040008c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926a7e03d146dae3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040005920 con 0x7f2044004810 2024-08-17T02:25:46.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040005aa0 con 0x7f2044004810 2024-08-17T02:25:46.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f20577fe700 1 -- 172.21.15.31:0/520969967 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040005e60 con 0x7f2044004810 2024-08-17T02:25:46.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f205df75700 1 -- 172.21.15.31:0/520969967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2044004810 msgr2=0x7f2044004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f205df75700 1 --2- 172.21.15.31:0/520969967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2044004810 0x7f2044004c80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2040005220 tx=0x7f2040008c90 comp rx=0 tx=0).stop 2024-08-17T02:25:46.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f205d774700 1 -- 172.21.15.31:0/520969967 reap_dead start 2024-08-17T02:25:46.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f205df75700 1 -- 172.21.15.31:0/520969967 shutdown_connections 2024-08-17T02:25:46.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f205df75700 1 -- 172.21.15.31:0/520969967 >> 172.21.15.31:0/520969967 conn(0x7f2058067400 msgr2=0x7f2058067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f205df75700 1 -- 172.21.15.31:0/520969967 shutdown_connections 2024-08-17T02:25:46.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.577+0000 7f205df75700 1 -- 172.21.15.31:0/520969967 wait complete. 2024-08-17T02:25:46.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.581+0000 7f205df75700 1 Processor -- start 2024-08-17T02:25:46.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.581+0000 7f205df75700 1 -- start start 2024-08-17T02:25:46.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.581+0000 7f205df75700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2044004810 0x7f2058168240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.581+0000 7f205df75700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20580ab040 0x7f205813bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.581+0000 7f205df75700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205813e580 0x7f2058158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.581+0000 7f205df75700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205815b7d0 con 0x7f20580ab040 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.581+0000 7f205df75700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2058157b00 con 0x7f205813e580 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.581+0000 7f205df75700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205815b210 con 0x7f2044004810 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2057fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20580ab040 0x7f205813bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2057fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20580ab040 0x7f205813bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39758/0 (socket says 172.21.15.31:39758) 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2057fff700 1 -- 172.21.15.31:0/2652870078 learned_addr learned my addr 172.21.15.31:0/2652870078 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f205cf73700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2044004810 0x7f2058168240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f205d774700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205813e580 0x7f2058158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2057fff700 1 -- 172.21.15.31:0/2652870078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2044004810 msgr2=0x7f2058168240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2057fff700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2044004810 0x7f2058168240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2057fff700 1 -- 172.21.15.31:0/2652870078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205813e580 msgr2=0x7f2058158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2057fff700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205813e580 0x7f2058158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2057fff700 1 -- 172.21.15.31:0/2652870078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205815b4f0 con 0x7f20580ab040 2024-08-17T02:25:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f205d774700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205813e580 0x7f2058158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2057fff700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20580ab040 0x7f205813bcb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f204400bb10 tx=0x7f2040016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2054ff9700 1 -- 172.21.15.31:0/2652870078 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040024070 con 0x7f20580ab040 2024-08-17T02:25:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2054ff9700 1 -- 172.21.15.31:0/2652870078 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040001940 con 0x7f20580ab040 2024-08-17T02:25:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f205df75700 1 -- 172.21.15.31:0/2652870078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205813ea20 con 0x7f20580ab040 2024-08-17T02:25:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2054ff9700 1 -- 172.21.15.31:0/2652870078 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040008360 con 0x7f20580ab040 2024-08-17T02:25:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f205df75700 1 -- 172.21.15.31:0/2652870078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2058159410 con 0x7f20580ab040 2024-08-17T02:25:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f205df75700 1 -- 172.21.15.31:0/2652870078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2058157c40 con 0x7f20580ab040 2024-08-17T02:25:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.585+0000 7f2054ff9700 1 -- 172.21.15.31:0/2652870078 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f20400086f0 con 0x7f20580ab040 2024-08-17T02:25:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.589+0000 7f2054ff9700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2038060890 0x7f2038062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.589+0000 7f2054ff9700 1 -- 172.21.15.31:0/2652870078 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f204007dfe0 con 0x7f20580ab040 2024-08-17T02:25:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.589+0000 7f205cf73700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2038060890 0x7f2038062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.589+0000 7f205cf73700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2038060890 0x7f2038062d40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f205813f790 tx=0x7f20480091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.593+0000 7f2054ff9700 1 -- 172.21.15.31:0/2652870078 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2058157c40 con 0x7f20580ab040 2024-08-17T02:25:46.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.757+0000 7f205df75700 1 -- 172.21.15.31:0/2652870078 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20580ca7c0 con 0x7f2038060890 2024-08-17T02:25:46.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.773+0000 7f2054ff9700 1 -- 172.21.15.31:0/2652870078 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287047 (secure 0 0 0) 0x7f20580ca7c0 con 0x7f2038060890 2024-08-17T02:25:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:46.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 -- 172.21.15.31:0/2652870078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2038060890 msgr2=0x7f2038062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2038060890 0x7f2038062d40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f205813f790 tx=0x7f20480091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 -- 172.21.15.31:0/2652870078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20580ab040 msgr2=0x7f205813bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20580ab040 0x7f205813bcb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f204400bb10 tx=0x7f2040016000 comp rx=0 tx=0).stop 2024-08-17T02:25:46.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 -- 172.21.15.31:0/2652870078 shutdown_connections 2024-08-17T02:25:46.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2038060890 0x7f2038062d40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f205813e580 0x7f2058158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20580ab040 0x7f205813bcb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 --2- 172.21.15.31:0/2652870078 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2044004810 0x7f2058168240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 -- 172.21.15.31:0/2652870078 >> 172.21.15.31:0/2652870078 conn(0x7f2058067400 msgr2=0x7f20580c7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 -- 172.21.15.31:0/2652870078 shutdown_connections 2024-08-17T02:25:46.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:46.777+0000 7f205df75700 1 -- 172.21.15.31:0/2652870078 wait complete. 2024-08-17T02:25:46.783 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:25:46.794 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-08-17T02:25:45.600424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":202,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387188,"kb_used_data":4160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587532,"statfs":{"total":773094113280,"available":770649632768,"internally_reserved":0,"allocated":4259840,"data_stored":2335260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.219919"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429866+0000","last_change":"2024-08-17T02:25:42.429866+0000","last_active":"2024-08-17T02:25:42.429866+0000","last_peered":"2024-08-17T02:25:42.429866+0000","last_clean":"2024-08-17T02:25:42.429866+0000","last_became_active":"2024-08-17T02:25:42.429589+0000","last_became_peered":"2024-08-17T02:25:42.429589+0000","last_unstale":"2024-08-17T02:25:42.429866+0000","last_undegraded":"2024-08-17T02:25:42.429866+0000","last_fullsized":"2024-08-17T02:25:42.429866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404932+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:09:07.672234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418423+0000","last_change":"2024-08-17T02:25:42.418423+0000","last_active":"2024-08-17T02:25:42.418423+0000","last_peered":"2024-08-17T02:25:42.418423+0000","last_clean":"2024-08-17T02:25:42.418423+0000","last_became_active":"2024-08-17T02:25:42.418156+0000","last_became_peered":"2024-08-17T02:25:42.418156+0000","last_unstale":"2024-08-17T02:25:42.418423+0000","last_undegraded":"2024-08-17T02:25:42.418423+0000","last_fullsized":"2024-08-17T02:25:42.418423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:43.004563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420792+0000","last_change":"2024-08-17T02:25:42.420792+0000","last_active":"2024-08-17T02:25:42.420792+0000","last_peered":"2024-08-17T02:25:42.420792+0000","last_clean":"2024-08-17T02:25:42.420792+0000","last_became_active":"2024-08-17T02:25:42.420383+0000","last_became_peered":"2024-08-17T02:25:42.420383+0000","last_unstale":"2024-08-17T02:25:42.420792+0000","last_undegraded":"2024-08-17T02:25:42.420792+0000","last_fullsized":"2024-08-17T02:25:42.420792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:45.898859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.407547+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:49:35.652729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417300+0000","last_change":"2024-08-17T02:25:42.417300+0000","last_active":"2024-08-17T02:25:42.417300+0000","last_peered":"2024-08-17T02:25:42.417300+0000","last_clean":"2024-08-17T02:25:42.417300+0000","last_became_active":"2024-08-17T02:25:42.417005+0000","last_became_peered":"2024-08-17T02:25:42.417005+0000","last_unstale":"2024-08-17T02:25:42.417300+0000","last_undegraded":"2024-08-17T02:25:42.417300+0000","last_fullsized":"2024-08-17T02:25:42.417300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:35.329338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416534+0000","last_change":"2024-08-17T02:25:42.416534+0000","last_active":"2024-08-17T02:25:42.416534+0000","last_peered":"2024-08-17T02:25:42.416534+0000","last_clean":"2024-08-17T02:25:42.416534+0000","last_became_active":"2024-08-17T02:25:42.416145+0000","last_became_peered":"2024-08-17T02:25:42.416145+0000","last_unstale":"2024-08-17T02:25:42.416534+0000","last_undegraded":"2024-08-17T02:25:42.416534+0000","last_fullsized":"2024-08-17T02:25:42.416534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:36.767291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419906+0000","last_change":"2024-08-17T02:25:42.419906+0000","last_active":"2024-08-17T02:25:42.419906+0000","last_peered":"2024-08-17T02:25:42.419906+0000","last_clean":"2024-08-17T02:25:42.419906+0000","last_became_active":"2024-08-17T02:25:42.419605+0000","last_became_peered":"2024-08-17T02:25:42.419605+0000","last_unstale":"2024-08-17T02:25:42.419906+0000","last_undegraded":"2024-08-17T02:25:42.419906+0000","last_fullsized":"2024-08-17T02:25:42.419906+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:12.438819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418898+0000","last_change":"2024-08-17T02:25:42.418898+0000","last_active":"2024-08-17T02:25:42.418898+0000","last_peered":"2024-08-17T02:25:42.418898+0000","last_clean":"2024-08-17T02:25:42.418898+0000","last_became_active":"2024-08-17T02:25:42.418610+0000","last_became_peered":"2024-08-17T02:25:42.418610+0000","last_unstale":"2024-08-17T02:25:42.418898+0000","last_undegraded":"2024-08-17T02:25:42.418898+0000","last_fullsized":"2024-08-17T02:25:42.418898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:02.087099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416219+0000","last_change":"2024-08-17T02:25:42.416219+0000","last_active":"2024-08-17T02:25:42.416219+0000","last_peered":"2024-08-17T02:25:42.416219+0000","last_clean":"2024-08-17T02:25:42.416219+0000","last_became_active":"2024-08-17T02:25:42.415937+0000","last_became_peered":"2024-08-17T02:25:42.415937+0000","last_unstale":"2024-08-17T02:25:42.416219+0000","last_undegraded":"2024-08-17T02:25:42.416219+0000","last_fullsized":"2024-08-17T02:25:42.416219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:08.435265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421885+0000","last_change":"2024-08-17T02:25:42.421885+0000","last_active":"2024-08-17T02:25:42.421885+0000","last_peered":"2024-08-17T02:25:42.421885+0000","last_clean":"2024-08-17T02:25:42.421885+0000","last_became_active":"2024-08-17T02:25:42.421627+0000","last_became_peered":"2024-08-17T02:25:42.421627+0000","last_unstale":"2024-08-17T02:25:42.421885+0000","last_undegraded":"2024-08-17T02:25:42.421885+0000","last_fullsized":"2024-08-17T02:25:42.421885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:18.458775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.414237+0000","last_change":"2024-08-17T02:25:42.414237+0000","last_active":"2024-08-17T02:25:42.414237+0000","last_peered":"2024-08-17T02:25:42.414237+0000","last_clean":"2024-08-17T02:25:42.414237+0000","last_became_active":"2024-08-17T02:25:42.413842+0000","last_became_peered":"2024-08-17T02:25:42.413842+0000","last_unstale":"2024-08-17T02:25:42.414237+0000","last_undegraded":"2024-08-17T02:25:42.414237+0000","last_fullsized":"2024-08-17T02:25:42.414237+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:04.272280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418431+0000","last_change":"2024-08-17T02:25:42.418431+0000","last_active":"2024-08-17T02:25:42.418431+0000","last_peered":"2024-08-17T02:25:42.418431+0000","last_clean":"2024-08-17T02:25:42.418431+0000","last_became_active":"2024-08-17T02:25:42.418152+0000","last_became_peered":"2024-08-17T02:25:42.418152+0000","last_unstale":"2024-08-17T02:25:42.418431+0000","last_undegraded":"2024-08-17T02:25:42.418431+0000","last_fullsized":"2024-08-17T02:25:42.418431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418167+0000","last_change":"2024-08-17T02:25:42.418167+0000","last_active":"2024-08-17T02:25:42.418167+0000","last_peered":"2024-08-17T02:25:42.418167+0000","last_clean":"2024-08-17T02:25:42.418167+0000","last_became_active":"2024-08-17T02:25:42.417535+0000","last_became_peered":"2024-08-17T02:25:42.417535+0000","last_unstale":"2024-08-17T02:25:42.418167+0000","last_undegraded":"2024-08-17T02:25:42.418167+0000","last_fullsized":"2024-08-17T02:25:42.418167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:22:16.256006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423733+0000","last_change":"2024-08-17T02:25:42.423733+0000","last_active":"2024-08-17T02:25:42.423733+0000","last_peered":"2024-08-17T02:25:42.423733+0000","last_clean":"2024-08-17T02:25:42.423733+0000","last_became_active":"2024-08-17T02:25:42.423437+0000","last_became_peered":"2024-08-17T02:25:42.423437+0000","last_unstale":"2024-08-17T02:25:42.423733+0000","last_undegraded":"2024-08-17T02:25:42.423733+0000","last_fullsized":"2024-08-17T02:25:42.423733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:01.372278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423980+0000","last_change":"2024-08-17T02:25:42.423980+0000","last_active":"2024-08-17T02:25:42.423980+0000","last_peered":"2024-08-17T02:25:42.423980+0000","last_clean":"2024-08-17T02:25:42.423980+0000","last_became_active":"2024-08-17T02:25:42.422527+0000","last_became_peered":"2024-08-17T02:25:42.422527+0000","last_unstale":"2024-08-17T02:25:42.423980+0000","last_undegraded":"2024-08-17T02:25:42.423980+0000","last_fullsized":"2024-08-17T02:25:42.423980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:10.073499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421044+0000","last_change":"2024-08-17T02:25:42.421044+0000","last_active":"2024-08-17T02:25:42.421044+0000","last_peered":"2024-08-17T02:25:42.421044+0000","last_clean":"2024-08-17T02:25:42.421044+0000","last_became_active":"2024-08-17T02:25:42.420760+0000","last_became_peered":"2024-08-17T02:25:42.420760+0000","last_unstale":"2024-08-17T02:25:42.421044+0000","last_undegraded":"2024-08-17T02:25:42.421044+0000","last_fullsized":"2024-08-17T02:25:42.421044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:54.517688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.406076+0000","last_change":"2024-08-17T02:25:42.406076+0000","last_active":"2024-08-17T02:25:42.406076+0000","last_peered":"2024-08-17T02:25:42.406076+0000","last_clean":"2024-08-17T02:25:42.406076+0000","last_became_active":"2024-08-17T02:25:42.405724+0000","last_became_peered":"2024-08-17T02:25:42.405724+0000","last_unstale":"2024-08-17T02:25:42.406076+0000","last_undegraded":"2024-08-17T02:25:42.406076+0000","last_fullsized":"2024-08-17T02:25:42.406076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:15.820514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416984+0000","last_change":"2024-08-17T02:25:42.416984+0000","last_active":"2024-08-17T02:25:42.416984+0000","last_peered":"2024-08-17T02:25:42.416984+0000","last_clean":"2024-08-17T02:25:42.416984+0000","last_became_active":"2024-08-17T02:25:42.415956+0000","last_became_peered":"2024-08-17T02:25:42.415956+0000","last_unstale":"2024-08-17T02:25:42.416984+0000","last_undegraded":"2024-08-17T02:25:42.416984+0000","last_fullsized":"2024-08-17T02:25:42.416984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:06.955772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.407630+0000","last_change":"2024-08-17T02:25:42.407630+0000","last_active":"2024-08-17T02:25:42.407630+0000","last_peered":"2024-08-17T02:25:42.407630+0000","last_clean":"2024-08-17T02:25:42.407630+0000","last_became_active":"2024-08-17T02:25:42.407237+0000","last_became_peered":"2024-08-17T02:25:42.407237+0000","last_unstale":"2024-08-17T02:25:42.407630+0000","last_undegraded":"2024-08-17T02:25:42.407630+0000","last_fullsized":"2024-08-17T02:25:42.407630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:22.134006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.415635+0000","last_change":"2024-08-17T02:25:42.415635+0000","last_active":"2024-08-17T02:25:42.415635+0000","last_peered":"2024-08-17T02:25:42.415635+0000","last_clean":"2024-08-17T02:25:42.415635+0000","last_became_active":"2024-08-17T02:25:42.406945+0000","last_became_peered":"2024-08-17T02:25:42.406945+0000","last_unstale":"2024-08-17T02:25:42.415635+0000","last_undegraded":"2024-08-17T02:25:42.415635+0000","last_fullsized":"2024-08-17T02:25:42.415635+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419390+0000","last_change":"2024-08-17T02:25:42.419390+0000","last_active":"2024-08-17T02:25:42.419390+0000","last_peered":"2024-08-17T02:25:42.419390+0000","last_clean":"2024-08-17T02:25:42.419390+0000","last_became_active":"2024-08-17T02:25:42.419015+0000","last_became_peered":"2024-08-17T02:25:42.419015+0000","last_unstale":"2024-08-17T02:25:42.419390+0000","last_undegraded":"2024-08-17T02:25:42.419390+0000","last_fullsized":"2024-08-17T02:25:42.419390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:53.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416037+0000","last_change":"2024-08-17T02:25:42.416037+0000","last_active":"2024-08-17T02:25:42.416037+0000","last_peered":"2024-08-17T02:25:42.416037+0000","last_clean":"2024-08-17T02:25:42.416037+0000","last_became_active":"2024-08-17T02:25:42.415756+0000","last_became_peered":"2024-08-17T02:25:42.415756+0000","last_unstale":"2024-08-17T02:25:42.416037+0000","last_undegraded":"2024-08-17T02:25:42.416037+0000","last_fullsized":"2024-08-17T02:25:42.416037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:43.554521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421864+0000","last_change":"2024-08-17T02:25:42.421864+0000","last_active":"2024-08-17T02:25:42.421864+0000","last_peered":"2024-08-17T02:25:42.421864+0000","last_clean":"2024-08-17T02:25:42.421864+0000","last_became_active":"2024-08-17T02:25:42.421396+0000","last_became_peered":"2024-08-17T02:25:42.421396+0000","last_unstale":"2024-08-17T02:25:42.421864+0000","last_undegraded":"2024-08-17T02:25:42.421864+0000","last_fullsized":"2024-08-17T02:25:42.421864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:53:59.660258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420428+0000","last_change":"2024-08-17T02:25:42.420428+0000","last_active":"2024-08-17T02:25:42.420428+0000","last_peered":"2024-08-17T02:25:42.420428+0000","last_clean":"2024-08-17T02:25:42.420428+0000","last_became_active":"2024-08-17T02:25:42.419860+0000","last_became_peered":"2024-08-17T02:25:42.419860+0000","last_unstale":"2024-08-17T02:25:42.420428+0000","last_undegraded":"2024-08-17T02:25:42.420428+0000","last_fullsized":"2024-08-17T02:25:42.420428+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:50.507537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.427962+0000","last_change":"2024-08-17T02:25:42.427962+0000","last_active":"2024-08-17T02:25:42.427962+0000","last_peered":"2024-08-17T02:25:42.427962+0000","last_clean":"2024-08-17T02:25:42.427962+0000","last_became_active":"2024-08-17T02:25:42.427683+0000","last_became_peered":"2024-08-17T02:25:42.427683+0000","last_unstale":"2024-08-17T02:25:42.427962+0000","last_undegraded":"2024-08-17T02:25:42.427962+0000","last_fullsized":"2024-08-17T02:25:42.427962+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:39.859919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404414+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:16.638589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417839+0000","last_change":"2024-08-17T02:25:42.417839+0000","last_active":"2024-08-17T02:25:42.417839+0000","last_peered":"2024-08-17T02:25:42.417839+0000","last_clean":"2024-08-17T02:25:42.417839+0000","last_became_active":"2024-08-17T02:25:42.417570+0000","last_became_peered":"2024-08-17T02:25:42.417570+0000","last_unstale":"2024-08-17T02:25:42.417839+0000","last_undegraded":"2024-08-17T02:25:42.417839+0000","last_fullsized":"2024-08-17T02:25:42.417839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:44.235619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417567+0000","last_change":"2024-08-17T02:25:42.417567+0000","last_active":"2024-08-17T02:25:42.417567+0000","last_peered":"2024-08-17T02:25:42.417567+0000","last_clean":"2024-08-17T02:25:42.417567+0000","last_became_active":"2024-08-17T02:25:42.417216+0000","last_became_peered":"2024-08-17T02:25:42.417216+0000","last_unstale":"2024-08-17T02:25:42.417567+0000","last_undegraded":"2024-08-17T02:25:42.417567+0000","last_fullsized":"2024-08-17T02:25:42.417567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:41.195953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422296+0000","last_change":"2024-08-17T02:25:42.422296+0000","last_active":"2024-08-17T02:25:42.422296+0000","last_peered":"2024-08-17T02:25:42.422296+0000","last_clean":"2024-08-17T02:25:42.422296+0000","last_became_active":"2024-08-17T02:25:42.407208+0000","last_became_peered":"2024-08-17T02:25:42.407208+0000","last_unstale":"2024-08-17T02:25:42.422296+0000","last_undegraded":"2024-08-17T02:25:42.422296+0000","last_fullsized":"2024-08-17T02:25:42.422296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420013+0000","last_change":"2024-08-17T02:25:42.420013+0000","last_active":"2024-08-17T02:25:42.420013+0000","last_peered":"2024-08-17T02:25:42.420013+0000","last_clean":"2024-08-17T02:25:42.420013+0000","last_became_active":"2024-08-17T02:25:42.419638+0000","last_became_peered":"2024-08-17T02:25:42.419638+0000","last_unstale":"2024-08-17T02:25:42.420013+0000","last_undegraded":"2024-08-17T02:25:42.420013+0000","last_fullsized":"2024-08-17T02:25:42.420013+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:10.073499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420835+0000","last_change":"2024-08-17T02:25:42.420835+0000","last_active":"2024-08-17T02:25:42.420835+0000","last_peered":"2024-08-17T02:25:42.420835+0000","last_clean":"2024-08-17T02:25:42.420835+0000","last_became_active":"2024-08-17T02:25:42.420623+0000","last_became_peered":"2024-08-17T02:25:42.420623+0000","last_unstale":"2024-08-17T02:25:42.420835+0000","last_undegraded":"2024-08-17T02:25:42.420835+0000","last_fullsized":"2024-08-17T02:25:42.420835+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:08.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.410144+0000","last_change":"2024-08-17T02:25:42.410144+0000","last_active":"2024-08-17T02:25:42.410144+0000","last_peered":"2024-08-17T02:25:42.410144+0000","last_clean":"2024-08-17T02:25:42.410144+0000","last_became_active":"2024-08-17T02:25:42.408813+0000","last_became_peered":"2024-08-17T02:25:42.408813+0000","last_unstale":"2024-08-17T02:25:42.410144+0000","last_undegraded":"2024-08-17T02:25:42.410144+0000","last_fullsized":"2024-08-17T02:25:42.410144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:55.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.436617+0000","last_change":"2024-08-17T02:25:41.414400+0000","last_active":"2024-08-17T02:25:42.436617+0000","last_peered":"2024-08-17T02:25:42.436617+0000","last_clean":"2024-08-17T02:25:42.436617+0000","last_became_active":"2024-08-17T02:25:41.413990+0000","last_became_peered":"2024-08-17T02:25:41.413990+0000","last_unstale":"2024-08-17T02:25:42.436617+0000","last_undegraded":"2024-08-17T02:25:42.436617+0000","last_fullsized":"2024-08-17T02:25:42.436617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:09.064759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417423+0000","last_change":"2024-08-17T02:25:42.417423+0000","last_active":"2024-08-17T02:25:42.417423+0000","last_peered":"2024-08-17T02:25:42.417423+0000","last_clean":"2024-08-17T02:25:42.417423+0000","last_became_active":"2024-08-17T02:25:42.417172+0000","last_became_peered":"2024-08-17T02:25:42.417172+0000","last_unstale":"2024-08-17T02:25:42.417423+0000","last_undegraded":"2024-08-17T02:25:42.417423+0000","last_fullsized":"2024-08-17T02:25:42.417423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:47.035562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.413880+0000","last_change":"2024-08-17T02:25:41.412731+0000","last_active":"2024-08-17T02:25:42.413880+0000","last_peered":"2024-08-17T02:25:42.413880+0000","last_clean":"2024-08-17T02:25:42.413880+0000","last_became_active":"2024-08-17T02:25:41.412451+0000","last_became_peered":"2024-08-17T02:25:41.412451+0000","last_unstale":"2024-08-17T02:25:42.413880+0000","last_undegraded":"2024-08-17T02:25:42.413880+0000","last_fullsized":"2024-08-17T02:25:42.413880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:54.301346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423308+0000","last_change":"2024-08-17T02:25:42.423308+0000","last_active":"2024-08-17T02:25:42.423308+0000","last_peered":"2024-08-17T02:25:42.423308+0000","last_clean":"2024-08-17T02:25:42.423308+0000","last_became_active":"2024-08-17T02:25:42.422988+0000","last_became_peered":"2024-08-17T02:25:42.422988+0000","last_unstale":"2024-08-17T02:25:42.423308+0000","last_undegraded":"2024-08-17T02:25:42.423308+0000","last_fullsized":"2024-08-17T02:25:42.423308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:00:06.810017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434405+0000","last_change":"2024-08-17T02:25:41.414749+0000","last_active":"2024-08-17T02:25:42.434405+0000","last_peered":"2024-08-17T02:25:42.434405+0000","last_clean":"2024-08-17T02:25:42.434405+0000","last_became_active":"2024-08-17T02:25:41.414484+0000","last_became_peered":"2024-08-17T02:25:41.414484+0000","last_unstale":"2024-08-17T02:25:42.434405+0000","last_undegraded":"2024-08-17T02:25:42.434405+0000","last_fullsized":"2024-08-17T02:25:42.434405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:48:43.410239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416685+0000","last_change":"2024-08-17T02:25:42.416685+0000","last_active":"2024-08-17T02:25:42.416685+0000","last_peered":"2024-08-17T02:25:42.416685+0000","last_clean":"2024-08-17T02:25:42.416685+0000","last_became_active":"2024-08-17T02:25:42.416113+0000","last_became_peered":"2024-08-17T02:25:42.416113+0000","last_unstale":"2024-08-17T02:25:42.416685+0000","last_undegraded":"2024-08-17T02:25:42.416685+0000","last_fullsized":"2024-08-17T02:25:42.416685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:41.832444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434872+0000","last_change":"2024-08-17T02:25:41.419882+0000","last_active":"2024-08-17T02:25:42.434872+0000","last_peered":"2024-08-17T02:25:42.434872+0000","last_clean":"2024-08-17T02:25:42.434872+0000","last_became_active":"2024-08-17T02:25:41.419595+0000","last_became_peered":"2024-08-17T02:25:41.419595+0000","last_unstale":"2024-08-17T02:25:42.434872+0000","last_undegraded":"2024-08-17T02:25:42.434872+0000","last_fullsized":"2024-08-17T02:25:42.434872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:28.023006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418376+0000","last_change":"2024-08-17T02:25:42.418376+0000","last_active":"2024-08-17T02:25:42.418376+0000","last_peered":"2024-08-17T02:25:42.418376+0000","last_clean":"2024-08-17T02:25:42.418376+0000","last_became_active":"2024-08-17T02:25:42.417769+0000","last_became_peered":"2024-08-17T02:25:42.417769+0000","last_unstale":"2024-08-17T02:25:42.418376+0000","last_undegraded":"2024-08-17T02:25:42.418376+0000","last_fullsized":"2024-08-17T02:25:42.418376+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:57.975103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.412210+0000","last_change":"2024-08-17T02:25:41.413895+0000","last_active":"2024-08-17T02:25:42.412210+0000","last_peered":"2024-08-17T02:25:42.412210+0000","last_clean":"2024-08-17T02:25:42.412210+0000","last_became_active":"2024-08-17T02:25:41.413485+0000","last_became_peered":"2024-08-17T02:25:41.413485+0000","last_unstale":"2024-08-17T02:25:42.412210+0000","last_undegraded":"2024-08-17T02:25:42.412210+0000","last_fullsized":"2024-08-17T02:25:42.412210+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:56.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419203+0000","last_change":"2024-08-17T02:25:42.419203+0000","last_active":"2024-08-17T02:25:42.419203+0000","last_peered":"2024-08-17T02:25:42.419203+0000","last_clean":"2024-08-17T02:25:42.419203+0000","last_became_active":"2024-08-17T02:25:42.418852+0000","last_became_peered":"2024-08-17T02:25:42.418852+0000","last_unstale":"2024-08-17T02:25:42.419203+0000","last_undegraded":"2024-08-17T02:25:42.419203+0000","last_fullsized":"2024-08-17T02:25:42.419203+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:01.372278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.411348+0000","last_change":"2024-08-17T02:25:41.416539+0000","last_active":"2024-08-17T02:25:42.411348+0000","last_peered":"2024-08-17T02:25:42.411348+0000","last_clean":"2024-08-17T02:25:42.411348+0000","last_became_active":"2024-08-17T02:25:41.416179+0000","last_became_peered":"2024-08-17T02:25:41.416179+0000","last_unstale":"2024-08-17T02:25:42.411348+0000","last_undegraded":"2024-08-17T02:25:42.411348+0000","last_fullsized":"2024-08-17T02:25:42.411348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:34.320598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429847+0000","last_change":"2024-08-17T02:25:42.429847+0000","last_active":"2024-08-17T02:25:42.429847+0000","last_peered":"2024-08-17T02:25:42.429847+0000","last_clean":"2024-08-17T02:25:42.429847+0000","last_became_active":"2024-08-17T02:25:42.429552+0000","last_became_peered":"2024-08-17T02:25:42.429552+0000","last_unstale":"2024-08-17T02:25:42.429847+0000","last_undegraded":"2024-08-17T02:25:42.429847+0000","last_fullsized":"2024-08-17T02:25:42.429847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:27.411778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416478+0000","last_change":"2024-08-17T02:25:41.413648+0000","last_active":"2024-08-17T02:25:41.416478+0000","last_peered":"2024-08-17T02:25:41.416478+0000","last_clean":"2024-08-17T02:25:41.416478+0000","last_became_active":"2024-08-17T02:25:41.413311+0000","last_became_peered":"2024-08-17T02:25:41.413311+0000","last_unstale":"2024-08-17T02:25:41.416478+0000","last_undegraded":"2024-08-17T02:25:41.416478+0000","last_fullsized":"2024-08-17T02:25:41.416478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:12.438714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420210+0000","last_change":"2024-08-17T02:25:42.420210+0000","last_active":"2024-08-17T02:25:42.420210+0000","last_peered":"2024-08-17T02:25:42.420210+0000","last_clean":"2024-08-17T02:25:42.420210+0000","last_became_active":"2024-08-17T02:25:42.419925+0000","last_became_peered":"2024-08-17T02:25:42.419925+0000","last_unstale":"2024-08-17T02:25:42.420210+0000","last_undegraded":"2024-08-17T02:25:42.420210+0000","last_fullsized":"2024-08-17T02:25:42.420210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:18.458775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.420278+0000","last_change":"2024-08-17T02:25:41.419672+0000","last_active":"2024-08-17T02:25:41.420278+0000","last_peered":"2024-08-17T02:25:41.420278+0000","last_clean":"2024-08-17T02:25:41.420278+0000","last_became_active":"2024-08-17T02:25:41.419363+0000","last_became_peered":"2024-08-17T02:25:41.419363+0000","last_unstale":"2024-08-17T02:25:41.420278+0000","last_undegraded":"2024-08-17T02:25:41.420278+0000","last_fullsized":"2024-08-17T02:25:41.420278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:03.263540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.414001+0000","last_change":"2024-08-17T02:25:42.414001+0000","last_active":"2024-08-17T02:25:42.414001+0000","last_peered":"2024-08-17T02:25:42.414001+0000","last_clean":"2024-08-17T02:25:42.414001+0000","last_became_active":"2024-08-17T02:25:42.413711+0000","last_became_peered":"2024-08-17T02:25:42.413711+0000","last_unstale":"2024-08-17T02:25:42.414001+0000","last_undegraded":"2024-08-17T02:25:42.414001+0000","last_fullsized":"2024-08-17T02:25:42.414001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:00.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.412465+0000","last_change":"2024-08-17T02:25:41.412465+0000","last_active":"2024-08-17T02:25:41.412465+0000","last_peered":"2024-08-17T02:25:41.412465+0000","last_clean":"2024-08-17T02:25:41.412465+0000","last_became_active":"2024-08-17T02:25:41.412180+0000","last_became_peered":"2024-08-17T02:25:41.412180+0000","last_unstale":"2024-08-17T02:25:41.412465+0000","last_undegraded":"2024-08-17T02:25:41.412465+0000","last_fullsized":"2024-08-17T02:25:41.412465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:40:41.453122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416127+0000","last_change":"2024-08-17T02:25:42.416127+0000","last_active":"2024-08-17T02:25:42.416127+0000","last_peered":"2024-08-17T02:25:42.416127+0000","last_clean":"2024-08-17T02:25:42.416127+0000","last_became_active":"2024-08-17T02:25:42.415840+0000","last_became_peered":"2024-08-17T02:25:42.415840+0000","last_unstale":"2024-08-17T02:25:42.416127+0000","last_undegraded":"2024-08-17T02:25:42.416127+0000","last_fullsized":"2024-08-17T02:25:42.416127+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:08.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416977+0000","last_change":"2024-08-17T02:25:41.416977+0000","last_active":"2024-08-17T02:25:41.416977+0000","last_peered":"2024-08-17T02:25:41.416977+0000","last_clean":"2024-08-17T02:25:41.416977+0000","last_became_active":"2024-08-17T02:25:41.416573+0000","last_became_peered":"2024-08-17T02:25:41.416573+0000","last_unstale":"2024-08-17T02:25:41.416977+0000","last_undegraded":"2024-08-17T02:25:41.416977+0000","last_fullsized":"2024-08-17T02:25:41.416977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:14.096901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.420814+0000","last_change":"2024-08-17T02:25:42.420814+0000","last_active":"2024-08-17T02:25:42.420814+0000","last_peered":"2024-08-17T02:25:42.420814+0000","last_clean":"2024-08-17T02:25:42.420814+0000","last_became_active":"2024-08-17T02:25:42.420331+0000","last_became_peered":"2024-08-17T02:25:42.420331+0000","last_unstale":"2024-08-17T02:25:42.420814+0000","last_undegraded":"2024-08-17T02:25:42.420814+0000","last_fullsized":"2024-08-17T02:25:42.420814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:22.274775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433174+0000","last_change":"2024-08-17T02:25:41.406456+0000","last_active":"2024-08-17T02:25:42.433174+0000","last_peered":"2024-08-17T02:25:42.433174+0000","last_clean":"2024-08-17T02:25:42.433174+0000","last_became_active":"2024-08-17T02:25:41.406085+0000","last_became_peered":"2024-08-17T02:25:41.406085+0000","last_unstale":"2024-08-17T02:25:42.433174+0000","last_undegraded":"2024-08-17T02:25:42.433174+0000","last_fullsized":"2024-08-17T02:25:42.433174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:40.187213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419317+0000","last_change":"2024-08-17T02:25:42.419317+0000","last_active":"2024-08-17T02:25:42.419317+0000","last_peered":"2024-08-17T02:25:42.419317+0000","last_clean":"2024-08-17T02:25:42.419317+0000","last_became_active":"2024-08-17T02:25:42.418969+0000","last_became_peered":"2024-08-17T02:25:42.418969+0000","last_unstale":"2024-08-17T02:25:42.419317+0000","last_undegraded":"2024-08-17T02:25:42.419317+0000","last_fullsized":"2024-08-17T02:25:42.419317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:50.507537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434765+0000","last_change":"2024-08-17T02:25:41.419970+0000","last_active":"2024-08-17T02:25:42.434765+0000","last_peered":"2024-08-17T02:25:42.434765+0000","last_clean":"2024-08-17T02:25:42.434765+0000","last_became_active":"2024-08-17T02:25:41.419704+0000","last_became_peered":"2024-08-17T02:25:41.419704+0000","last_unstale":"2024-08-17T02:25:42.434765+0000","last_undegraded":"2024-08-17T02:25:42.434765+0000","last_fullsized":"2024-08-17T02:25:42.434765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:01.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416809+0000","last_change":"2024-08-17T02:25:42.416809+0000","last_active":"2024-08-17T02:25:42.416809+0000","last_peered":"2024-08-17T02:25:42.416809+0000","last_clean":"2024-08-17T02:25:42.416809+0000","last_became_active":"2024-08-17T02:25:42.416549+0000","last_became_peered":"2024-08-17T02:25:42.416549+0000","last_unstale":"2024-08-17T02:25:42.416809+0000","last_undegraded":"2024-08-17T02:25:42.416809+0000","last_fullsized":"2024-08-17T02:25:42.416809+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:18.471103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433055+0000","last_change":"2024-08-17T02:25:41.415123+0000","last_active":"2024-08-17T02:25:42.433055+0000","last_peered":"2024-08-17T02:25:42.433055+0000","last_clean":"2024-08-17T02:25:42.433055+0000","last_became_active":"2024-08-17T02:25:41.414783+0000","last_became_peered":"2024-08-17T02:25:41.414783+0000","last_unstale":"2024-08-17T02:25:42.433055+0000","last_undegraded":"2024-08-17T02:25:42.433055+0000","last_fullsized":"2024-08-17T02:25:42.433055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:06.176945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418728+0000","last_change":"2024-08-17T02:25:42.418728+0000","last_active":"2024-08-17T02:25:42.418728+0000","last_peered":"2024-08-17T02:25:42.418728+0000","last_clean":"2024-08-17T02:25:42.418728+0000","last_became_active":"2024-08-17T02:25:42.418446+0000","last_became_peered":"2024-08-17T02:25:42.418446+0000","last_unstale":"2024-08-17T02:25:42.418728+0000","last_undegraded":"2024-08-17T02:25:42.418728+0000","last_fullsized":"2024-08-17T02:25:42.418728+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:42.876425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.422123+0000","last_change":"2024-08-17T02:25:41.417738+0000","last_active":"2024-08-17T02:25:41.422123+0000","last_peered":"2024-08-17T02:25:41.422123+0000","last_clean":"2024-08-17T02:25:41.422123+0000","last_became_active":"2024-08-17T02:25:41.417458+0000","last_became_peered":"2024-08-17T02:25:41.417458+0000","last_unstale":"2024-08-17T02:25:41.422123+0000","last_undegraded":"2024-08-17T02:25:41.422123+0000","last_fullsized":"2024-08-17T02:25:41.422123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:42.545781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.426300+0000","last_change":"2024-08-17T02:25:42.426300+0000","last_active":"2024-08-17T02:25:42.426300+0000","last_peered":"2024-08-17T02:25:42.426300+0000","last_clean":"2024-08-17T02:25:42.426300+0000","last_became_active":"2024-08-17T02:25:42.425814+0000","last_became_peered":"2024-08-17T02:25:42.425814+0000","last_unstale":"2024-08-17T02:25:42.426300+0000","last_undegraded":"2024-08-17T02:25:42.426300+0000","last_fullsized":"2024-08-17T02:25:42.426300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.419395+0000","last_change":"2024-08-17T02:25:41.412269+0000","last_active":"2024-08-17T02:25:41.419395+0000","last_peered":"2024-08-17T02:25:41.419395+0000","last_clean":"2024-08-17T02:25:41.419395+0000","last_became_active":"2024-08-17T02:25:41.411996+0000","last_became_peered":"2024-08-17T02:25:41.411996+0000","last_unstale":"2024-08-17T02:25:41.419395+0000","last_undegraded":"2024-08-17T02:25:41.419395+0000","last_fullsized":"2024-08-17T02:25:41.419395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:26.990290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421316+0000","last_change":"2024-08-17T02:25:42.421316+0000","last_active":"2024-08-17T02:25:42.421316+0000","last_peered":"2024-08-17T02:25:42.421316+0000","last_clean":"2024-08-17T02:25:42.421316+0000","last_became_active":"2024-08-17T02:25:42.421027+0000","last_became_peered":"2024-08-17T02:25:42.421027+0000","last_unstale":"2024-08-17T02:25:42.421316+0000","last_undegraded":"2024-08-17T02:25:42.421316+0000","last_fullsized":"2024-08-17T02:25:42.421316+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:22.274775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434466+0000","last_change":"2024-08-17T02:25:41.417196+0000","last_active":"2024-08-17T02:25:42.434466+0000","last_peered":"2024-08-17T02:25:42.434466+0000","last_clean":"2024-08-17T02:25:42.434466+0000","last_became_active":"2024-08-17T02:25:41.416884+0000","last_became_peered":"2024-08-17T02:25:41.416884+0000","last_unstale":"2024-08-17T02:25:42.434466+0000","last_undegraded":"2024-08-17T02:25:42.434466+0000","last_fullsized":"2024-08-17T02:25:42.434466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:51.323262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.419706+0000","last_change":"2024-08-17T02:25:42.419706+0000","last_active":"2024-08-17T02:25:42.419706+0000","last_peered":"2024-08-17T02:25:42.419706+0000","last_clean":"2024-08-17T02:25:42.419706+0000","last_became_active":"2024-08-17T02:25:42.419419+0000","last_became_peered":"2024-08-17T02:25:42.419419+0000","last_unstale":"2024-08-17T02:25:42.419706+0000","last_undegraded":"2024-08-17T02:25:42.419706+0000","last_fullsized":"2024-08-17T02:25:42.419706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:45.898859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.401468+0000","last_change":"2024-08-17T02:25:41.413608+0000","last_active":"2024-08-17T02:25:42.401468+0000","last_peered":"2024-08-17T02:25:42.401468+0000","last_clean":"2024-08-17T02:25:42.401468+0000","last_became_active":"2024-08-17T02:25:41.413299+0000","last_became_peered":"2024-08-17T02:25:41.413299+0000","last_unstale":"2024-08-17T02:25:42.401468+0000","last_undegraded":"2024-08-17T02:25:42.401468+0000","last_fullsized":"2024-08-17T02:25:42.401468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:59.656053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429851+0000","last_change":"2024-08-17T02:25:42.429851+0000","last_active":"2024-08-17T02:25:42.429851+0000","last_peered":"2024-08-17T02:25:42.429851+0000","last_clean":"2024-08-17T02:25:42.429851+0000","last_became_active":"2024-08-17T02:25:42.429575+0000","last_became_peered":"2024-08-17T02:25:42.429575+0000","last_unstale":"2024-08-17T02:25:42.429851+0000","last_undegraded":"2024-08-17T02:25:42.429851+0000","last_fullsized":"2024-08-17T02:25:42.429851+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:33.834531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433034+0000","last_change":"2024-08-17T02:25:41.416074+0000","last_active":"2024-08-17T02:25:42.433034+0000","last_peered":"2024-08-17T02:25:42.433034+0000","last_clean":"2024-08-17T02:25:42.433034+0000","last_became_active":"2024-08-17T02:25:41.415694+0000","last_became_peered":"2024-08-17T02:25:41.415694+0000","last_unstale":"2024-08-17T02:25:42.433034+0000","last_undegraded":"2024-08-17T02:25:42.433034+0000","last_fullsized":"2024-08-17T02:25:42.433034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:14.811773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.404286+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:55.604947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.405428+0000","last_change":"2024-08-17T02:25:41.411845+0000","last_active":"2024-08-17T02:25:42.405428+0000","last_peered":"2024-08-17T02:25:42.405428+0000","last_clean":"2024-08-17T02:25:42.405428+0000","last_became_active":"2024-08-17T02:25:41.410319+0000","last_became_peered":"2024-08-17T02:25:41.410319+0000","last_unstale":"2024-08-17T02:25:42.405428+0000","last_undegraded":"2024-08-17T02:25:42.405428+0000","last_fullsized":"2024-08-17T02:25:42.405428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:26.741363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.410194+0000","last_change":"2024-08-17T02:25:42.410194+0000","last_active":"2024-08-17T02:25:42.410194+0000","last_peered":"2024-08-17T02:25:42.410194+0000","last_clean":"2024-08-17T02:25:42.410194+0000","last_became_active":"2024-08-17T02:25:42.409899+0000","last_became_peered":"2024-08-17T02:25:42.409899+0000","last_unstale":"2024-08-17T02:25:42.410194+0000","last_undegraded":"2024-08-17T02:25:42.410194+0000","last_fullsized":"2024-08-17T02:25:42.410194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:02.087099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.412888+0000","last_change":"2024-08-17T02:25:41.408140+0000","last_active":"2024-08-17T02:25:41.412888+0000","last_peered":"2024-08-17T02:25:41.412888+0000","last_clean":"2024-08-17T02:25:41.412888+0000","last_became_active":"2024-08-17T02:25:41.407869+0000","last_became_peered":"2024-08-17T02:25:41.407869+0000","last_unstale":"2024-08-17T02:25:41.412888+0000","last_undegraded":"2024-08-17T02:25:41.412888+0000","last_fullsized":"2024-08-17T02:25:41.412888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:22.195354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.407511+0000","last_change":"2024-08-17T02:25:42.407511+0000","last_active":"2024-08-17T02:25:42.407511+0000","last_peered":"2024-08-17T02:25:42.407511+0000","last_clean":"2024-08-17T02:25:42.407511+0000","last_became_active":"2024-08-17T02:25:42.407273+0000","last_became_peered":"2024-08-17T02:25:42.407273+0000","last_unstale":"2024-08-17T02:25:42.407511+0000","last_undegraded":"2024-08-17T02:25:42.407511+0000","last_fullsized":"2024-08-17T02:25:42.407511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:09.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.420302+0000","last_change":"2024-08-17T02:25:41.420302+0000","last_active":"2024-08-17T02:25:41.420302+0000","last_peered":"2024-08-17T02:25:41.420302+0000","last_clean":"2024-08-17T02:25:41.420302+0000","last_became_active":"2024-08-17T02:25:41.419958+0000","last_became_peered":"2024-08-17T02:25:41.419958+0000","last_unstale":"2024-08-17T02:25:41.420302+0000","last_undegraded":"2024-08-17T02:25:41.420302+0000","last_fullsized":"2024-08-17T02:25:41.420302+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:53.300389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:41.379334+0000","last_change":"2024-08-17T02:25:41.407078+0000","last_active":"2024-08-17T02:25:41.379334+0000","last_peered":"2024-08-17T02:25:41.379334+0000","last_clean":"2024-08-17T02:25:41.379334+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:41.379334+0000","last_undegraded":"2024-08-17T02:25:41.379334+0000","last_fullsized":"2024-08-17T02:25:41.379334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:14.445941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416402+0000","last_change":"2024-08-17T02:25:41.412762+0000","last_active":"2024-08-17T02:25:41.416402+0000","last_peered":"2024-08-17T02:25:41.416402+0000","last_clean":"2024-08-17T02:25:41.416402+0000","last_became_active":"2024-08-17T02:25:41.412398+0000","last_became_peered":"2024-08-17T02:25:41.412398+0000","last_unstale":"2024-08-17T02:25:41.416402+0000","last_undegraded":"2024-08-17T02:25:41.416402+0000","last_fullsized":"2024-08-17T02:25:41.416402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:01.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422487+0000","last_change":"2024-08-17T02:25:42.422487+0000","last_active":"2024-08-17T02:25:42.422487+0000","last_peered":"2024-08-17T02:25:42.422487+0000","last_clean":"2024-08-17T02:25:42.422487+0000","last_became_active":"2024-08-17T02:25:42.422179+0000","last_became_peered":"2024-08-17T02:25:42.422179+0000","last_unstale":"2024-08-17T02:25:42.422487+0000","last_undegraded":"2024-08-17T02:25:42.422487+0000","last_fullsized":"2024-08-17T02:25:42.422487+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.411049+0000","last_change":"2024-08-17T02:25:41.408829+0000","last_active":"2024-08-17T02:25:41.411049+0000","last_peered":"2024-08-17T02:25:41.411049+0000","last_clean":"2024-08-17T02:25:41.411049+0000","last_became_active":"2024-08-17T02:25:41.408507+0000","last_became_peered":"2024-08-17T02:25:41.408507+0000","last_unstale":"2024-08-17T02:25:41.411049+0000","last_undegraded":"2024-08-17T02:25:41.411049+0000","last_fullsized":"2024-08-17T02:25:41.411049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:55.936904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.428934+0000","last_change":"2024-08-17T02:25:42.428934+0000","last_active":"2024-08-17T02:25:42.428934+0000","last_peered":"2024-08-17T02:25:42.428934+0000","last_clean":"2024-08-17T02:25:42.428934+0000","last_became_active":"2024-08-17T02:25:42.428579+0000","last_became_peered":"2024-08-17T02:25:42.428579+0000","last_unstale":"2024-08-17T02:25:42.428934+0000","last_undegraded":"2024-08-17T02:25:42.428934+0000","last_fullsized":"2024-08-17T02:25:42.428934+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:01:35.750552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.405319+0000","last_change":"2024-08-17T02:25:41.404004+0000","last_active":"2024-08-17T02:25:41.405319+0000","last_peered":"2024-08-17T02:25:41.405319+0000","last_clean":"2024-08-17T02:25:41.405319+0000","last_became_active":"2024-08-17T02:25:41.403735+0000","last_became_peered":"2024-08-17T02:25:41.403735+0000","last_unstale":"2024-08-17T02:25:41.405319+0000","last_undegraded":"2024-08-17T02:25:41.405319+0000","last_fullsized":"2024-08-17T02:25:41.405319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:42.545781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.408344+0000","last_change":"2024-08-17T02:25:42.408344+0000","last_active":"2024-08-17T02:25:42.408344+0000","last_peered":"2024-08-17T02:25:42.408344+0000","last_clean":"2024-08-17T02:25:42.408344+0000","last_became_active":"2024-08-17T02:25:42.408053+0000","last_became_peered":"2024-08-17T02:25:42.408053+0000","last_unstale":"2024-08-17T02:25:42.408344+0000","last_undegraded":"2024-08-17T02:25:42.408344+0000","last_fullsized":"2024-08-17T02:25:42.408344+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:57.975103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.432007+0000","last_change":"2024-08-17T02:25:41.411005+0000","last_active":"2024-08-17T02:25:42.432007+0000","last_peered":"2024-08-17T02:25:42.432007+0000","last_clean":"2024-08-17T02:25:42.432007+0000","last_became_active":"2024-08-17T02:25:41.410680+0000","last_became_peered":"2024-08-17T02:25:41.410680+0000","last_unstale":"2024-08-17T02:25:42.432007+0000","last_undegraded":"2024-08-17T02:25:42.432007+0000","last_fullsized":"2024-08-17T02:25:42.432007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:41.995822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.408871+0000","last_change":"2024-08-17T02:25:42.408871+0000","last_active":"2024-08-17T02:25:42.408871+0000","last_peered":"2024-08-17T02:25:42.408871+0000","last_clean":"2024-08-17T02:25:42.408871+0000","last_became_active":"2024-08-17T02:25:42.408058+0000","last_became_peered":"2024-08-17T02:25:42.408058+0000","last_unstale":"2024-08-17T02:25:42.408871+0000","last_undegraded":"2024-08-17T02:25:42.408871+0000","last_fullsized":"2024-08-17T02:25:42.408871+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:41.832444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.415141+0000","last_change":"2024-08-17T02:25:41.415141+0000","last_active":"2024-08-17T02:25:41.415141+0000","last_peered":"2024-08-17T02:25:41.415141+0000","last_clean":"2024-08-17T02:25:41.415141+0000","last_became_active":"2024-08-17T02:25:41.414871+0000","last_became_peered":"2024-08-17T02:25:41.414871+0000","last_unstale":"2024-08-17T02:25:41.415141+0000","last_undegraded":"2024-08-17T02:25:41.415141+0000","last_fullsized":"2024-08-17T02:25:41.415141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:15.442741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418873+0000","last_change":"2024-08-17T02:25:42.418873+0000","last_active":"2024-08-17T02:25:42.418873+0000","last_peered":"2024-08-17T02:25:42.418873+0000","last_clean":"2024-08-17T02:25:42.418873+0000","last_became_active":"2024-08-17T02:25:42.418596+0000","last_became_peered":"2024-08-17T02:25:42.418596+0000","last_unstale":"2024-08-17T02:25:42.418873+0000","last_undegraded":"2024-08-17T02:25:42.418873+0000","last_fullsized":"2024-08-17T02:25:42.418873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:43.004563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.407774+0000","last_change":"2024-08-17T02:25:41.406162+0000","last_active":"2024-08-17T02:25:41.407774+0000","last_peered":"2024-08-17T02:25:41.407774+0000","last_clean":"2024-08-17T02:25:41.407774+0000","last_became_active":"2024-08-17T02:25:41.405855+0000","last_became_peered":"2024-08-17T02:25:41.405855+0000","last_unstale":"2024-08-17T02:25:41.407774+0000","last_undegraded":"2024-08-17T02:25:41.407774+0000","last_fullsized":"2024-08-17T02:25:41.407774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:05.947031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423499+0000","last_change":"2024-08-17T02:25:42.423499+0000","last_active":"2024-08-17T02:25:42.423499+0000","last_peered":"2024-08-17T02:25:42.423499+0000","last_clean":"2024-08-17T02:25:42.423499+0000","last_became_active":"2024-08-17T02:25:42.423157+0000","last_became_peered":"2024-08-17T02:25:42.423157+0000","last_unstale":"2024-08-17T02:25:42.423499+0000","last_undegraded":"2024-08-17T02:25:42.423499+0000","last_fullsized":"2024-08-17T02:25:42.423499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:47.035562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416353+0000","last_change":"2024-08-17T02:25:41.411329+0000","last_active":"2024-08-17T02:25:41.416353+0000","last_peered":"2024-08-17T02:25:41.416353+0000","last_clean":"2024-08-17T02:25:41.416353+0000","last_became_active":"2024-08-17T02:25:41.410916+0000","last_became_peered":"2024-08-17T02:25:41.410916+0000","last_unstale":"2024-08-17T02:25:41.416353+0000","last_undegraded":"2024-08-17T02:25:41.416353+0000","last_fullsized":"2024-08-17T02:25:41.416353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:56.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.416987+0000","last_change":"2024-08-17T02:25:42.416987+0000","last_active":"2024-08-17T02:25:42.416987+0000","last_peered":"2024-08-17T02:25:42.416987+0000","last_clean":"2024-08-17T02:25:42.416987+0000","last_became_active":"2024-08-17T02:25:42.416662+0000","last_became_peered":"2024-08-17T02:25:42.416662+0000","last_unstale":"2024-08-17T02:25:42.416987+0000","last_undegraded":"2024-08-17T02:25:42.416987+0000","last_fullsized":"2024-08-17T02:25:42.416987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:00.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.416400+0000","last_change":"2024-08-17T02:25:41.411479+0000","last_active":"2024-08-17T02:25:41.416400+0000","last_peered":"2024-08-17T02:25:41.416400+0000","last_clean":"2024-08-17T02:25:41.416400+0000","last_became_active":"2024-08-17T02:25:41.411185+0000","last_became_peered":"2024-08-17T02:25:41.411185+0000","last_unstale":"2024-08-17T02:25:41.416400+0000","last_undegraded":"2024-08-17T02:25:41.416400+0000","last_fullsized":"2024-08-17T02:25:41.416400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:14.811773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.426045+0000","last_change":"2024-08-17T02:25:42.426045+0000","last_active":"2024-08-17T02:25:42.426045+0000","last_peered":"2024-08-17T02:25:42.426045+0000","last_clean":"2024-08-17T02:25:42.426045+0000","last_became_active":"2024-08-17T02:25:42.425767+0000","last_became_peered":"2024-08-17T02:25:42.425767+0000","last_unstale":"2024-08-17T02:25:42.426045+0000","last_undegraded":"2024-08-17T02:25:42.426045+0000","last_fullsized":"2024-08-17T02:25:42.426045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:54.517688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.417303+0000","last_change":"2024-08-17T02:25:41.416245+0000","last_active":"2024-08-17T02:25:41.417303+0000","last_peered":"2024-08-17T02:25:41.417303+0000","last_clean":"2024-08-17T02:25:41.417303+0000","last_became_active":"2024-08-17T02:25:41.415762+0000","last_became_peered":"2024-08-17T02:25:41.415762+0000","last_unstale":"2024-08-17T02:25:41.417303+0000","last_undegraded":"2024-08-17T02:25:41.417303+0000","last_fullsized":"2024-08-17T02:25:41.417303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:05.947031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.409630+0000","last_change":"2024-08-17T02:25:42.409630+0000","last_active":"2024-08-17T02:25:42.409630+0000","last_peered":"2024-08-17T02:25:42.409630+0000","last_clean":"2024-08-17T02:25:42.409630+0000","last_became_active":"2024-08-17T02:25:42.409370+0000","last_became_peered":"2024-08-17T02:25:42.409370+0000","last_unstale":"2024-08-17T02:25:42.409630+0000","last_undegraded":"2024-08-17T02:25:42.409630+0000","last_fullsized":"2024-08-17T02:25:42.409630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:42.876425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.419542+0000","last_change":"2024-08-17T02:25:41.413754+0000","last_active":"2024-08-17T02:25:41.419542+0000","last_peered":"2024-08-17T02:25:41.419542+0000","last_clean":"2024-08-17T02:25:41.419542+0000","last_became_active":"2024-08-17T02:25:41.413461+0000","last_became_peered":"2024-08-17T02:25:41.413461+0000","last_unstale":"2024-08-17T02:25:41.419542+0000","last_undegraded":"2024-08-17T02:25:41.419542+0000","last_fullsized":"2024-08-17T02:25:41.419542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:21.125266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422150+0000","last_change":"2024-08-17T02:25:42.422150+0000","last_active":"2024-08-17T02:25:42.422150+0000","last_peered":"2024-08-17T02:25:42.422150+0000","last_clean":"2024-08-17T02:25:42.422150+0000","last_became_active":"2024-08-17T02:25:42.409094+0000","last_became_peered":"2024-08-17T02:25:42.409094+0000","last_unstale":"2024-08-17T02:25:42.422150+0000","last_undegraded":"2024-08-17T02:25:42.422150+0000","last_fullsized":"2024-08-17T02:25:42.422150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:44.235619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.415642+0000","last_change":"2024-08-17T02:25:41.413342+0000","last_active":"2024-08-17T02:25:41.415642+0000","last_peered":"2024-08-17T02:25:41.415642+0000","last_clean":"2024-08-17T02:25:41.415642+0000","last_became_active":"2024-08-17T02:25:41.411807+0000","last_became_peered":"2024-08-17T02:25:41.411807+0000","last_unstale":"2024-08-17T02:25:41.415642+0000","last_undegraded":"2024-08-17T02:25:41.415642+0000","last_fullsized":"2024-08-17T02:25:41.415642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:58.112071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-08-17T02:25:41.397663+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:25:41.397663+0000","last_peered":"2024-08-17T02:25:41.397663+0000","last_clean":"2024-08-17T02:25:41.397663+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:25:41.397663+0000","last_undegraded":"2024-08-17T02:25:41.397663+0000","last_fullsized":"2024-08-17T02:25:41.397663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297740,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074100,"statfs":{"total":96636764160,"available":96331878400,"internally_reserved":0,"allocated":393216,"data_stored":149055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.804},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.66300000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.746},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.0449999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":1.7470000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":2.0259999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.099}]},{"osd":6,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.165},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":2.073}]}]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297748,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074092,"statfs":{"total":96636764160,"available":96331870208,"internally_reserved":0,"allocated":401408,"data_stored":150585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.008}]},{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.083}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.85599999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":1.1739999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.212},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.2330000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.135}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1.113},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1799999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.0549999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0840000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297760,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074080,"statfs":{"total":96636764160,"available":96331857920,"internally_reserved":0,"allocated":405504,"data_stored":149797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.82699999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.78300000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.621},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.74399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.296}]},{"osd":5,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.3640000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.391},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.337}]},{"osd":7,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.47}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.75700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.44},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.91200000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.099}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":970752,"data_stored":732638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.95199999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.083},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.89600000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.02}]},{"osd":7,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.137},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1719999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":142270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.1140000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.014},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.79300000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.208}]},{"osd":4,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.054}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.25},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.325}]},{"osd":6,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.399},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.2769999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.361},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.304}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":958464,"data_stored":726375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.75800000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.60699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.026},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.91700000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.0609999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.115}]},{"osd":7,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.135},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.095}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:49.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:49.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.913+0000 7f93c8bb5700 1 Processor -- start 2024-08-17T02:25:49.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c8bb5700 1 -- start start 2024-08-17T02:25:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c8bb5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93c4155d20 0x7f93c40afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c8bb5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f93c40b03a0 0x7f93c40c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c8bb5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c40b1430 con 0x7f93c40cce40 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c8bb5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c40b0820 con 0x7f93c4155d20 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c8bb5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c40b0b00 con 0x7f93c40b03a0 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93c4155d20 0x7f93c40afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c3fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f93c40b03a0 0x7f93c40c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f93c4155d20 0x7f93c40afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39764/0 (socket says 172.21.15.31:39764) 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c3fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f93c40b03a0 0x7f93c40c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:35022/0 (socket says 172.21.15.31:35022) 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c2ffd700 1 --1- 172.21.15.31:0/893552715 >> v1:172.21.15.92:6789/0 conn(0x7f93c40cce40 0x7f93c40aead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:43334/0 (socket says 172.21.15.31:43334) 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c37fe700 1 -- 172.21.15.31:0/893552715 learned_addr learned my addr 172.21.15.31:0/893552715 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c37fe700 1 -- 172.21.15.31:0/893552715 >> v2:172.21.15.92:3300/0 conn(0x7f93c40b03a0 msgr2=0x7f93c40c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c37fe700 1 --2- 172.21.15.31:0/893552715 >> v2:172.21.15.92:3300/0 conn(0x7f93c40b03a0 0x7f93c40c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c37fe700 1 -- 172.21.15.31:0/893552715 >> v1:172.21.15.92:6789/0 conn(0x7f93c40cce40 legacy=0x7f93c40aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c37fe700 1 -- 172.21.15.31:0/893552715 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c40b0de0 con 0x7f93c4155d20 2024-08-17T02:25:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.917+0000 7f93c37fe700 1 --2- 172.21.15.31:0/893552715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4155d20 0x7f93c40afe60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f93c406fa60 tx=0x7f93b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c8e1ee8fb10d95 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c27fc700 1 -- 172.21.15.31:0/893552715 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4009e70 con 0x7f93c4155d20 2024-08-17T02:25:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c27fc700 1 -- 172.21.15.31:0/893552715 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400b860 con 0x7f93c4155d20 2024-08-17T02:25:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c27fc700 1 -- 172.21.15.31:0/893552715 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400bc00 con 0x7f93c4155d20 2024-08-17T02:25:49.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c8bb5700 1 -- 172.21.15.31:0/893552715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4155d20 msgr2=0x7f93c40afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c8bb5700 1 --2- 172.21.15.31:0/893552715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4155d20 0x7f93c40afe60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f93c406fa60 tx=0x7f93b4009250 comp rx=0 tx=0).stop 2024-08-17T02:25:49.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c8bb5700 1 -- 172.21.15.31:0/893552715 shutdown_connections 2024-08-17T02:25:49.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c8bb5700 1 --2- 172.21.15.31:0/893552715 >> v2:172.21.15.92:3300/0 conn(0x7f93c40b03a0 0x7f93c40c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c8bb5700 1 --2- 172.21.15.31:0/893552715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4155d20 0x7f93c40afe60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c8bb5700 1 -- 172.21.15.31:0/893552715 >> 172.21.15.31:0/893552715 conn(0x7f93c4063b20 msgr2=0x7f93c406b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c8bb5700 1 -- 172.21.15.31:0/893552715 shutdown_connections 2024-08-17T02:25:49.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c8bb5700 1 -- 172.21.15.31:0/893552715 wait complete. 2024-08-17T02:25:49.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c8bb5700 1 Processor -- start 2024-08-17T02:25:49.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.921+0000 7f93c8bb5700 1 -- start start 2024-08-17T02:25:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c8bb5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c4155d20 0x7f93c40a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c8bb5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4147180 0x7f93c40c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c8bb5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93c40c3000 0x7f93c4067400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c8bb5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c41475f0 con 0x7f93c4147180 2024-08-17T02:25:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c8bb5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c40c2390 con 0x7f93c4155d20 2024-08-17T02:25:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c8bb5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c40ab370 con 0x7f93c40c3000 2024-08-17T02:25:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4147180 0x7f93c40c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c2ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4147180 0x7f93c40c1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39774/0 (socket says 172.21.15.31:39774) 2024-08-17T02:25:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c2ffd700 1 -- 172.21.15.31:0/1202093659 learned_addr learned my addr 172.21.15.31:0/1202093659 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c37fe700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c4155d20 0x7f93c40a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c3fff700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93c40c3000 0x7f93c4067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c2ffd700 1 -- 172.21.15.31:0/1202093659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93c40c3000 msgr2=0x7f93c4067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c2ffd700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93c40c3000 0x7f93c4067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c2ffd700 1 -- 172.21.15.31:0/1202093659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c4155d20 msgr2=0x7f93c40a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c2ffd700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c4155d20 0x7f93c40a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c2ffd700 1 -- 172.21.15.31:0/1202093659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b40094f0 con 0x7f93c4147180 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c2ffd700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4147180 0x7f93c40c1e50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93b800c7f0 tx=0x7f93b8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93ab7fe700 1 -- 172.21.15.31:0/1202093659 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8005a70 con 0x7f93c4147180 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93ab7fe700 1 -- 172.21.15.31:0/1202093659 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b8005bd0 con 0x7f93c4147180 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c8bb5700 1 -- 172.21.15.31:0/1202093659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c40a9d00 con 0x7f93c4147180 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93ab7fe700 1 -- 172.21.15.31:0/1202093659 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b80070d0 con 0x7f93c4147180 2024-08-17T02:25:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.925+0000 7f93c8bb5700 1 -- 172.21.15.31:0/1202093659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c40aa2c0 con 0x7f93c4147180 2024-08-17T02:25:49.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.929+0000 7f93c8bb5700 1 -- 172.21.15.31:0/1202093659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c40ab500 con 0x7f93c4147180 2024-08-17T02:25:49.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.929+0000 7f93ab7fe700 1 -- 172.21.15.31:0/1202093659 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f93b8007480 con 0x7f93c4147180 2024-08-17T02:25:49.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.929+0000 7f93ab7fe700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f93b0060860 0x7f93b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.929+0000 7f93ab7fe700 1 -- 172.21.15.31:0/1202093659 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f93b807c060 con 0x7f93c4147180 2024-08-17T02:25:49.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.929+0000 7f93c37fe700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f93b0060860 0x7f93b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.929+0000 7f93c37fe700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f93b0060860 0x7f93b0062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f93c406fa60 tx=0x7f93b4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:49.937+0000 7f93ab7fe700 1 -- 172.21.15.31:0/1202093659 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f93b804c4b0 con 0x7f93c4147180 2024-08-17T02:25:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.101+0000 7f93c8bb5700 1 -- 172.21.15.31:0/1202093659 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93c40712b0 con 0x7f93b0060860 2024-08-17T02:25:50.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.113+0000 7f93ab7fe700 1 -- 172.21.15.31:0/1202093659 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287317 (secure 0 0 0) 0x7f93c40712b0 con 0x7f93b0060860 2024-08-17T02:25:50.121 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 -- 172.21.15.31:0/1202093659 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f93b0060860 msgr2=0x7f93b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f93b0060860 0x7f93b0062d10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f93c406fa60 tx=0x7f93b4017000 comp rx=0 tx=0).stop 2024-08-17T02:25:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 -- 172.21.15.31:0/1202093659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4147180 msgr2=0x7f93c40c1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4147180 0x7f93c40c1e50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93b800c7f0 tx=0x7f93b8007f70 comp rx=0 tx=0).stop 2024-08-17T02:25:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 -- 172.21.15.31:0/1202093659 shutdown_connections 2024-08-17T02:25:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f93b0060860 0x7f93b0062d10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93c40c3000 0x7f93c4067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93c4147180 0x7f93c40c1e50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 --2- 172.21.15.31:0/1202093659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93c4155d20 0x7f93c40a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 -- 172.21.15.31:0/1202093659 >> 172.21.15.31:0/1202093659 conn(0x7f93c4063b20 msgr2=0x7f93c41564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 -- 172.21.15.31:0/1202093659 shutdown_connections 2024-08-17T02:25:50.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.121+0000 7f93c8bb5700 1 -- 172.21.15.31:0/1202093659 wait complete. 2024-08-17T02:25:50.125 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:25:50.135 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-08-17T02:25:49.601643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2387392,"kb_used_data":4360,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752587328,"statfs":{"total":773094113280,"available":770649423872,"internally_reserved":0,"allocated":4464640,"data_stored":2427980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002180"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433210+0000","last_change":"2024-08-17T02:25:42.429866+0000","last_active":"2024-08-17T02:25:42.433210+0000","last_peered":"2024-08-17T02:25:42.433210+0000","last_clean":"2024-08-17T02:25:42.433210+0000","last_became_active":"2024-08-17T02:25:42.429589+0000","last_became_peered":"2024-08-17T02:25:42.429589+0000","last_unstale":"2024-08-17T02:25:42.433210+0000","last_undegraded":"2024-08-17T02:25:42.433210+0000","last_fullsized":"2024-08-17T02:25:42.433210+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.424335+0000","last_change":"2024-08-17T02:25:42.419810+0000","last_active":"2024-08-17T02:25:42.424335+0000","last_peered":"2024-08-17T02:25:42.424335+0000","last_clean":"2024-08-17T02:25:42.424335+0000","last_became_active":"2024-08-17T02:25:42.419446+0000","last_became_peered":"2024-08-17T02:25:42.419446+0000","last_unstale":"2024-08-17T02:25:42.424335+0000","last_undegraded":"2024-08-17T02:25:42.424335+0000","last_fullsized":"2024-08-17T02:25:42.424335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:05.252879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425890+0000","last_change":"2024-08-17T02:25:42.418423+0000","last_active":"2024-08-17T02:25:42.425890+0000","last_peered":"2024-08-17T02:25:42.425890+0000","last_clean":"2024-08-17T02:25:42.425890+0000","last_became_active":"2024-08-17T02:25:42.418156+0000","last_became_peered":"2024-08-17T02:25:42.418156+0000","last_unstale":"2024-08-17T02:25:42.425890+0000","last_undegraded":"2024-08-17T02:25:42.425890+0000","last_fullsized":"2024-08-17T02:25:42.425890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:43.004563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423389+0000","last_change":"2024-08-17T02:25:42.420792+0000","last_active":"2024-08-17T02:25:42.423389+0000","last_peered":"2024-08-17T02:25:42.423389+0000","last_clean":"2024-08-17T02:25:42.423389+0000","last_became_active":"2024-08-17T02:25:42.420383+0000","last_became_peered":"2024-08-17T02:25:42.420383+0000","last_unstale":"2024-08-17T02:25:42.423389+0000","last_undegraded":"2024-08-17T02:25:42.423389+0000","last_fullsized":"2024-08-17T02:25:42.423389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:45.898859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418460+0000","last_change":"2024-08-17T02:25:42.414167+0000","last_active":"2024-08-17T02:25:42.418460+0000","last_peered":"2024-08-17T02:25:42.418460+0000","last_clean":"2024-08-17T02:25:42.418460+0000","last_became_active":"2024-08-17T02:25:42.413925+0000","last_became_peered":"2024-08-17T02:25:42.413925+0000","last_unstale":"2024-08-17T02:25:42.418460+0000","last_undegraded":"2024-08-17T02:25:42.418460+0000","last_fullsized":"2024-08-17T02:25:42.418460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:24:20.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425650+0000","last_change":"2024-08-17T02:25:42.417300+0000","last_active":"2024-08-17T02:25:42.425650+0000","last_peered":"2024-08-17T02:25:42.425650+0000","last_clean":"2024-08-17T02:25:42.425650+0000","last_became_active":"2024-08-17T02:25:42.417005+0000","last_became_peered":"2024-08-17T02:25:42.417005+0000","last_unstale":"2024-08-17T02:25:42.425650+0000","last_undegraded":"2024-08-17T02:25:42.425650+0000","last_fullsized":"2024-08-17T02:25:42.425650+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:35.329338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.424627+0000","last_change":"2024-08-17T02:25:42.416534+0000","last_active":"2024-08-17T02:25:42.424627+0000","last_peered":"2024-08-17T02:25:42.424627+0000","last_clean":"2024-08-17T02:25:42.424627+0000","last_became_active":"2024-08-17T02:25:42.416145+0000","last_became_peered":"2024-08-17T02:25:42.416145+0000","last_unstale":"2024-08-17T02:25:42.424627+0000","last_undegraded":"2024-08-17T02:25:42.424627+0000","last_fullsized":"2024-08-17T02:25:42.424627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:36.767291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425771+0000","last_change":"2024-08-17T02:25:42.419906+0000","last_active":"2024-08-17T02:25:42.425771+0000","last_peered":"2024-08-17T02:25:42.425771+0000","last_clean":"2024-08-17T02:25:42.425771+0000","last_became_active":"2024-08-17T02:25:42.419605+0000","last_became_peered":"2024-08-17T02:25:42.419605+0000","last_unstale":"2024-08-17T02:25:42.425771+0000","last_undegraded":"2024-08-17T02:25:42.425771+0000","last_fullsized":"2024-08-17T02:25:42.425771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:12.438819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425865+0000","last_change":"2024-08-17T02:25:42.418898+0000","last_active":"2024-08-17T02:25:42.425865+0000","last_peered":"2024-08-17T02:25:42.425865+0000","last_clean":"2024-08-17T02:25:42.425865+0000","last_became_active":"2024-08-17T02:25:42.418610+0000","last_became_peered":"2024-08-17T02:25:42.418610+0000","last_unstale":"2024-08-17T02:25:42.425865+0000","last_undegraded":"2024-08-17T02:25:42.425865+0000","last_fullsized":"2024-08-17T02:25:42.425865+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:02.087099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421564+0000","last_change":"2024-08-17T02:25:42.416219+0000","last_active":"2024-08-17T02:25:42.421564+0000","last_peered":"2024-08-17T02:25:42.421564+0000","last_clean":"2024-08-17T02:25:42.421564+0000","last_became_active":"2024-08-17T02:25:42.415937+0000","last_became_peered":"2024-08-17T02:25:42.415937+0000","last_unstale":"2024-08-17T02:25:42.421564+0000","last_undegraded":"2024-08-17T02:25:42.421564+0000","last_fullsized":"2024-08-17T02:25:42.421564+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:37:08.435265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.428832+0000","last_change":"2024-08-17T02:25:42.421885+0000","last_active":"2024-08-17T02:25:42.428832+0000","last_peered":"2024-08-17T02:25:42.428832+0000","last_clean":"2024-08-17T02:25:42.428832+0000","last_became_active":"2024-08-17T02:25:42.421627+0000","last_became_peered":"2024-08-17T02:25:42.421627+0000","last_unstale":"2024-08-17T02:25:42.428832+0000","last_undegraded":"2024-08-17T02:25:42.428832+0000","last_fullsized":"2024-08-17T02:25:42.428832+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:18.458775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.415172+0000","last_change":"2024-08-17T02:25:42.414237+0000","last_active":"2024-08-17T02:25:42.415172+0000","last_peered":"2024-08-17T02:25:42.415172+0000","last_clean":"2024-08-17T02:25:42.415172+0000","last_became_active":"2024-08-17T02:25:42.413842+0000","last_became_peered":"2024-08-17T02:25:42.413842+0000","last_unstale":"2024-08-17T02:25:42.415172+0000","last_undegraded":"2024-08-17T02:25:42.415172+0000","last_fullsized":"2024-08-17T02:25:42.415172+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:04.272280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.424295+0000","last_change":"2024-08-17T02:25:42.418431+0000","last_active":"2024-08-17T02:25:42.424295+0000","last_peered":"2024-08-17T02:25:42.424295+0000","last_clean":"2024-08-17T02:25:42.424295+0000","last_became_active":"2024-08-17T02:25:42.418152+0000","last_became_peered":"2024-08-17T02:25:42.418152+0000","last_unstale":"2024-08-17T02:25:42.424295+0000","last_undegraded":"2024-08-17T02:25:42.424295+0000","last_fullsized":"2024-08-17T02:25:42.424295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422724+0000","last_change":"2024-08-17T02:25:42.418167+0000","last_active":"2024-08-17T02:25:42.422724+0000","last_peered":"2024-08-17T02:25:42.422724+0000","last_clean":"2024-08-17T02:25:42.422724+0000","last_became_active":"2024-08-17T02:25:42.417535+0000","last_became_peered":"2024-08-17T02:25:42.417535+0000","last_unstale":"2024-08-17T02:25:42.422724+0000","last_undegraded":"2024-08-17T02:25:42.422724+0000","last_fullsized":"2024-08-17T02:25:42.422724+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:22:16.256006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429303+0000","last_change":"2024-08-17T02:25:42.423733+0000","last_active":"2024-08-17T02:25:42.429303+0000","last_peered":"2024-08-17T02:25:42.429303+0000","last_clean":"2024-08-17T02:25:42.429303+0000","last_became_active":"2024-08-17T02:25:42.423437+0000","last_became_peered":"2024-08-17T02:25:42.423437+0000","last_unstale":"2024-08-17T02:25:42.429303+0000","last_undegraded":"2024-08-17T02:25:42.429303+0000","last_fullsized":"2024-08-17T02:25:42.429303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:01.372278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429207+0000","last_change":"2024-08-17T02:25:42.423980+0000","last_active":"2024-08-17T02:25:42.429207+0000","last_peered":"2024-08-17T02:25:42.429207+0000","last_clean":"2024-08-17T02:25:42.429207+0000","last_became_active":"2024-08-17T02:25:42.422527+0000","last_became_peered":"2024-08-17T02:25:42.422527+0000","last_unstale":"2024-08-17T02:25:42.429207+0000","last_undegraded":"2024-08-17T02:25:42.429207+0000","last_fullsized":"2024-08-17T02:25:42.429207+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:10.073499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.426033+0000","last_change":"2024-08-17T02:25:42.421044+0000","last_active":"2024-08-17T02:25:42.426033+0000","last_peered":"2024-08-17T02:25:42.426033+0000","last_clean":"2024-08-17T02:25:42.426033+0000","last_became_active":"2024-08-17T02:25:42.420760+0000","last_became_peered":"2024-08-17T02:25:42.420760+0000","last_unstale":"2024-08-17T02:25:42.426033+0000","last_undegraded":"2024-08-17T02:25:42.426033+0000","last_fullsized":"2024-08-17T02:25:42.426033+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:54.517688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.409409+0000","last_change":"2024-08-17T02:25:42.406076+0000","last_active":"2024-08-17T02:25:42.409409+0000","last_peered":"2024-08-17T02:25:42.409409+0000","last_clean":"2024-08-17T02:25:42.409409+0000","last_became_active":"2024-08-17T02:25:42.405724+0000","last_became_peered":"2024-08-17T02:25:42.405724+0000","last_unstale":"2024-08-17T02:25:42.409409+0000","last_undegraded":"2024-08-17T02:25:42.409409+0000","last_fullsized":"2024-08-17T02:25:42.409409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:15.820514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425637+0000","last_change":"2024-08-17T02:25:42.416984+0000","last_active":"2024-08-17T02:25:42.425637+0000","last_peered":"2024-08-17T02:25:42.425637+0000","last_clean":"2024-08-17T02:25:42.425637+0000","last_became_active":"2024-08-17T02:25:42.415956+0000","last_became_peered":"2024-08-17T02:25:42.415956+0000","last_unstale":"2024-08-17T02:25:42.425637+0000","last_undegraded":"2024-08-17T02:25:42.425637+0000","last_fullsized":"2024-08-17T02:25:42.425637+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:06.955772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.411745+0000","last_change":"2024-08-17T02:25:42.407630+0000","last_active":"2024-08-17T02:25:42.411745+0000","last_peered":"2024-08-17T02:25:42.411745+0000","last_clean":"2024-08-17T02:25:42.411745+0000","last_became_active":"2024-08-17T02:25:42.407237+0000","last_became_peered":"2024-08-17T02:25:42.407237+0000","last_unstale":"2024-08-17T02:25:42.411745+0000","last_undegraded":"2024-08-17T02:25:42.411745+0000","last_fullsized":"2024-08-17T02:25:42.411745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:22.134006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421510+0000","last_change":"2024-08-17T02:25:42.415635+0000","last_active":"2024-08-17T02:25:42.421510+0000","last_peered":"2024-08-17T02:25:42.421510+0000","last_clean":"2024-08-17T02:25:42.421510+0000","last_became_active":"2024-08-17T02:25:42.406945+0000","last_became_peered":"2024-08-17T02:25:42.406945+0000","last_unstale":"2024-08-17T02:25:42.421510+0000","last_undegraded":"2024-08-17T02:25:42.421510+0000","last_fullsized":"2024-08-17T02:25:42.421510+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:27.750103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425373+0000","last_change":"2024-08-17T02:25:42.419390+0000","last_active":"2024-08-17T02:25:42.425373+0000","last_peered":"2024-08-17T02:25:42.425373+0000","last_clean":"2024-08-17T02:25:42.425373+0000","last_became_active":"2024-08-17T02:25:42.419015+0000","last_became_peered":"2024-08-17T02:25:42.419015+0000","last_unstale":"2024-08-17T02:25:42.425373+0000","last_undegraded":"2024-08-17T02:25:42.425373+0000","last_fullsized":"2024-08-17T02:25:42.425373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:53.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418822+0000","last_change":"2024-08-17T02:25:42.416037+0000","last_active":"2024-08-17T02:25:42.418822+0000","last_peered":"2024-08-17T02:25:42.418822+0000","last_clean":"2024-08-17T02:25:42.418822+0000","last_became_active":"2024-08-17T02:25:42.415756+0000","last_became_peered":"2024-08-17T02:25:42.415756+0000","last_unstale":"2024-08-17T02:25:42.418822+0000","last_undegraded":"2024-08-17T02:25:42.418822+0000","last_fullsized":"2024-08-17T02:25:42.418822+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:43.554521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.427336+0000","last_change":"2024-08-17T02:25:42.421864+0000","last_active":"2024-08-17T02:25:42.427336+0000","last_peered":"2024-08-17T02:25:42.427336+0000","last_clean":"2024-08-17T02:25:42.427336+0000","last_became_active":"2024-08-17T02:25:42.421396+0000","last_became_peered":"2024-08-17T02:25:42.421396+0000","last_unstale":"2024-08-17T02:25:42.427336+0000","last_undegraded":"2024-08-17T02:25:42.427336+0000","last_fullsized":"2024-08-17T02:25:42.427336+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:53:59.660258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423291+0000","last_change":"2024-08-17T02:25:42.420428+0000","last_active":"2024-08-17T02:25:42.423291+0000","last_peered":"2024-08-17T02:25:42.423291+0000","last_clean":"2024-08-17T02:25:42.423291+0000","last_became_active":"2024-08-17T02:25:42.419860+0000","last_became_peered":"2024-08-17T02:25:42.419860+0000","last_unstale":"2024-08-17T02:25:42.423291+0000","last_undegraded":"2024-08-17T02:25:42.423291+0000","last_fullsized":"2024-08-17T02:25:42.423291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:50.507537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.431298+0000","last_change":"2024-08-17T02:25:42.427962+0000","last_active":"2024-08-17T02:25:42.431298+0000","last_peered":"2024-08-17T02:25:42.431298+0000","last_clean":"2024-08-17T02:25:42.431298+0000","last_became_active":"2024-08-17T02:25:42.427683+0000","last_became_peered":"2024-08-17T02:25:42.427683+0000","last_unstale":"2024-08-17T02:25:42.431298+0000","last_undegraded":"2024-08-17T02:25:42.431298+0000","last_fullsized":"2024-08-17T02:25:42.431298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:39.859919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.436898+0000","last_change":"2024-08-17T02:25:42.430832+0000","last_active":"2024-08-17T02:25:42.436898+0000","last_peered":"2024-08-17T02:25:42.436898+0000","last_clean":"2024-08-17T02:25:42.436898+0000","last_became_active":"2024-08-17T02:25:42.430438+0000","last_became_peered":"2024-08-17T02:25:42.430438+0000","last_unstale":"2024-08-17T02:25:42.436898+0000","last_undegraded":"2024-08-17T02:25:42.436898+0000","last_fullsized":"2024-08-17T02:25:42.436898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:15:24.226764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.424725+0000","last_change":"2024-08-17T02:25:42.417839+0000","last_active":"2024-08-17T02:25:42.424725+0000","last_peered":"2024-08-17T02:25:42.424725+0000","last_clean":"2024-08-17T02:25:42.424725+0000","last_became_active":"2024-08-17T02:25:42.417570+0000","last_became_peered":"2024-08-17T02:25:42.417570+0000","last_unstale":"2024-08-17T02:25:42.424725+0000","last_undegraded":"2024-08-17T02:25:42.424725+0000","last_fullsized":"2024-08-17T02:25:42.424725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:44.235619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425072+0000","last_change":"2024-08-17T02:25:42.417567+0000","last_active":"2024-08-17T02:25:42.425072+0000","last_peered":"2024-08-17T02:25:42.425072+0000","last_clean":"2024-08-17T02:25:42.425072+0000","last_became_active":"2024-08-17T02:25:42.417216+0000","last_became_peered":"2024-08-17T02:25:42.417216+0000","last_unstale":"2024-08-17T02:25:42.425072+0000","last_undegraded":"2024-08-17T02:25:42.425072+0000","last_fullsized":"2024-08-17T02:25:42.425072+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:41.195953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429129+0000","last_change":"2024-08-17T02:25:42.422296+0000","last_active":"2024-08-17T02:25:42.429129+0000","last_peered":"2024-08-17T02:25:42.429129+0000","last_clean":"2024-08-17T02:25:42.429129+0000","last_became_active":"2024-08-17T02:25:42.407208+0000","last_became_peered":"2024-08-17T02:25:42.407208+0000","last_unstale":"2024-08-17T02:25:42.429129+0000","last_undegraded":"2024-08-17T02:25:42.429129+0000","last_fullsized":"2024-08-17T02:25:42.429129+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425576+0000","last_change":"2024-08-17T02:25:42.420013+0000","last_active":"2024-08-17T02:25:42.425576+0000","last_peered":"2024-08-17T02:25:42.425576+0000","last_clean":"2024-08-17T02:25:42.425576+0000","last_became_active":"2024-08-17T02:25:42.419638+0000","last_became_peered":"2024-08-17T02:25:42.419638+0000","last_unstale":"2024-08-17T02:25:42.425576+0000","last_undegraded":"2024-08-17T02:25:42.425576+0000","last_fullsized":"2024-08-17T02:25:42.425576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:10.073499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425529+0000","last_change":"2024-08-17T02:25:42.420835+0000","last_active":"2024-08-17T02:25:42.425529+0000","last_peered":"2024-08-17T02:25:42.425529+0000","last_clean":"2024-08-17T02:25:42.425529+0000","last_became_active":"2024-08-17T02:25:42.420623+0000","last_became_peered":"2024-08-17T02:25:42.420623+0000","last_unstale":"2024-08-17T02:25:42.425529+0000","last_undegraded":"2024-08-17T02:25:42.425529+0000","last_fullsized":"2024-08-17T02:25:42.425529+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:08.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.412458+0000","last_change":"2024-08-17T02:25:42.410144+0000","last_active":"2024-08-17T02:25:42.412458+0000","last_peered":"2024-08-17T02:25:42.412458+0000","last_clean":"2024-08-17T02:25:42.412458+0000","last_became_active":"2024-08-17T02:25:42.408813+0000","last_became_peered":"2024-08-17T02:25:42.408813+0000","last_unstale":"2024-08-17T02:25:42.412458+0000","last_undegraded":"2024-08-17T02:25:42.412458+0000","last_fullsized":"2024-08-17T02:25:42.412458+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:55.310087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.436719+0000","last_change":"2024-08-17T02:25:41.414400+0000","last_active":"2024-08-17T02:25:42.436719+0000","last_peered":"2024-08-17T02:25:42.436719+0000","last_clean":"2024-08-17T02:25:42.436719+0000","last_became_active":"2024-08-17T02:25:41.413990+0000","last_became_peered":"2024-08-17T02:25:41.413990+0000","last_unstale":"2024-08-17T02:25:42.436719+0000","last_undegraded":"2024-08-17T02:25:42.436719+0000","last_fullsized":"2024-08-17T02:25:42.436719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:41:09.064759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.424736+0000","last_change":"2024-08-17T02:25:42.417423+0000","last_active":"2024-08-17T02:25:42.424736+0000","last_peered":"2024-08-17T02:25:42.424736+0000","last_clean":"2024-08-17T02:25:42.424736+0000","last_became_active":"2024-08-17T02:25:42.417172+0000","last_became_peered":"2024-08-17T02:25:42.417172+0000","last_unstale":"2024-08-17T02:25:42.424736+0000","last_undegraded":"2024-08-17T02:25:42.424736+0000","last_fullsized":"2024-08-17T02:25:42.424736+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:47.035562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.431507+0000","last_change":"2024-08-17T02:25:41.412731+0000","last_active":"2024-08-17T02:25:42.431507+0000","last_peered":"2024-08-17T02:25:42.431507+0000","last_clean":"2024-08-17T02:25:42.431507+0000","last_became_active":"2024-08-17T02:25:41.412451+0000","last_became_peered":"2024-08-17T02:25:41.412451+0000","last_unstale":"2024-08-17T02:25:42.431507+0000","last_undegraded":"2024-08-17T02:25:42.431507+0000","last_fullsized":"2024-08-17T02:25:42.431507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:54.301346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.430499+0000","last_change":"2024-08-17T02:25:42.423308+0000","last_active":"2024-08-17T02:25:42.430499+0000","last_peered":"2024-08-17T02:25:42.430499+0000","last_clean":"2024-08-17T02:25:42.430499+0000","last_became_active":"2024-08-17T02:25:42.422988+0000","last_became_peered":"2024-08-17T02:25:42.422988+0000","last_unstale":"2024-08-17T02:25:42.430499+0000","last_undegraded":"2024-08-17T02:25:42.430499+0000","last_fullsized":"2024-08-17T02:25:42.430499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:00:06.810017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434545+0000","last_change":"2024-08-17T02:25:41.414749+0000","last_active":"2024-08-17T02:25:42.434545+0000","last_peered":"2024-08-17T02:25:42.434545+0000","last_clean":"2024-08-17T02:25:42.434545+0000","last_became_active":"2024-08-17T02:25:41.414484+0000","last_became_peered":"2024-08-17T02:25:41.414484+0000","last_unstale":"2024-08-17T02:25:42.434545+0000","last_undegraded":"2024-08-17T02:25:42.434545+0000","last_fullsized":"2024-08-17T02:25:42.434545+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:48:43.410239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422456+0000","last_change":"2024-08-17T02:25:42.416685+0000","last_active":"2024-08-17T02:25:42.422456+0000","last_peered":"2024-08-17T02:25:42.422456+0000","last_clean":"2024-08-17T02:25:42.422456+0000","last_became_active":"2024-08-17T02:25:42.416113+0000","last_became_peered":"2024-08-17T02:25:42.416113+0000","last_unstale":"2024-08-17T02:25:42.422456+0000","last_undegraded":"2024-08-17T02:25:42.422456+0000","last_fullsized":"2024-08-17T02:25:42.422456+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:41.832444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.435002+0000","last_change":"2024-08-17T02:25:41.419882+0000","last_active":"2024-08-17T02:25:42.435002+0000","last_peered":"2024-08-17T02:25:42.435002+0000","last_clean":"2024-08-17T02:25:42.435002+0000","last_became_active":"2024-08-17T02:25:41.419595+0000","last_became_peered":"2024-08-17T02:25:41.419595+0000","last_unstale":"2024-08-17T02:25:42.435002+0000","last_undegraded":"2024-08-17T02:25:42.435002+0000","last_fullsized":"2024-08-17T02:25:42.435002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:28.023006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425928+0000","last_change":"2024-08-17T02:25:42.418376+0000","last_active":"2024-08-17T02:25:42.425928+0000","last_peered":"2024-08-17T02:25:42.425928+0000","last_clean":"2024-08-17T02:25:42.425928+0000","last_became_active":"2024-08-17T02:25:42.417769+0000","last_became_peered":"2024-08-17T02:25:42.417769+0000","last_unstale":"2024-08-17T02:25:42.425928+0000","last_undegraded":"2024-08-17T02:25:42.425928+0000","last_fullsized":"2024-08-17T02:25:42.425928+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:57.975103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433814+0000","last_change":"2024-08-17T02:25:41.413895+0000","last_active":"2024-08-17T02:25:42.433814+0000","last_peered":"2024-08-17T02:25:42.433814+0000","last_clean":"2024-08-17T02:25:42.433814+0000","last_became_active":"2024-08-17T02:25:41.413485+0000","last_became_peered":"2024-08-17T02:25:41.413485+0000","last_unstale":"2024-08-17T02:25:42.433814+0000","last_undegraded":"2024-08-17T02:25:42.433814+0000","last_fullsized":"2024-08-17T02:25:42.433814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:56.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425586+0000","last_change":"2024-08-17T02:25:42.419203+0000","last_active":"2024-08-17T02:25:42.425586+0000","last_peered":"2024-08-17T02:25:42.425586+0000","last_clean":"2024-08-17T02:25:42.425586+0000","last_became_active":"2024-08-17T02:25:42.418852+0000","last_became_peered":"2024-08-17T02:25:42.418852+0000","last_unstale":"2024-08-17T02:25:42.425586+0000","last_undegraded":"2024-08-17T02:25:42.425586+0000","last_fullsized":"2024-08-17T02:25:42.425586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:01.372278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434249+0000","last_change":"2024-08-17T02:25:41.416539+0000","last_active":"2024-08-17T02:25:42.434249+0000","last_peered":"2024-08-17T02:25:42.434249+0000","last_clean":"2024-08-17T02:25:42.434249+0000","last_became_active":"2024-08-17T02:25:41.416179+0000","last_became_peered":"2024-08-17T02:25:41.416179+0000","last_unstale":"2024-08-17T02:25:42.434249+0000","last_undegraded":"2024-08-17T02:25:42.434249+0000","last_fullsized":"2024-08-17T02:25:42.434249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:17:34.320598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.431728+0000","last_change":"2024-08-17T02:25:42.429847+0000","last_active":"2024-08-17T02:25:42.431728+0000","last_peered":"2024-08-17T02:25:42.431728+0000","last_clean":"2024-08-17T02:25:42.431728+0000","last_became_active":"2024-08-17T02:25:42.429552+0000","last_became_peered":"2024-08-17T02:25:42.429552+0000","last_unstale":"2024-08-17T02:25:42.431728+0000","last_undegraded":"2024-08-17T02:25:42.431728+0000","last_fullsized":"2024-08-17T02:25:42.431728+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:49:27.411778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.401285+0000","last_change":"2024-08-17T02:25:41.413648+0000","last_active":"2024-08-17T02:25:42.401285+0000","last_peered":"2024-08-17T02:25:42.401285+0000","last_clean":"2024-08-17T02:25:42.401285+0000","last_became_active":"2024-08-17T02:25:41.413311+0000","last_became_peered":"2024-08-17T02:25:41.413311+0000","last_unstale":"2024-08-17T02:25:42.401285+0000","last_undegraded":"2024-08-17T02:25:42.401285+0000","last_fullsized":"2024-08-17T02:25:42.401285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:12.438714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423254+0000","last_change":"2024-08-17T02:25:42.420210+0000","last_active":"2024-08-17T02:25:42.423254+0000","last_peered":"2024-08-17T02:25:42.423254+0000","last_clean":"2024-08-17T02:25:42.423254+0000","last_became_active":"2024-08-17T02:25:42.419925+0000","last_became_peered":"2024-08-17T02:25:42.419925+0000","last_unstale":"2024-08-17T02:25:42.423254+0000","last_undegraded":"2024-08-17T02:25:42.423254+0000","last_fullsized":"2024-08-17T02:25:42.423254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:18.458775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.415503+0000","last_change":"2024-08-17T02:25:41.419672+0000","last_active":"2024-08-17T02:25:42.415503+0000","last_peered":"2024-08-17T02:25:42.415503+0000","last_clean":"2024-08-17T02:25:42.415503+0000","last_became_active":"2024-08-17T02:25:41.419363+0000","last_became_peered":"2024-08-17T02:25:41.419363+0000","last_unstale":"2024-08-17T02:25:42.415503+0000","last_undegraded":"2024-08-17T02:25:42.415503+0000","last_fullsized":"2024-08-17T02:25:42.415503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:03.263540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418467+0000","last_change":"2024-08-17T02:25:42.414001+0000","last_active":"2024-08-17T02:25:42.418467+0000","last_peered":"2024-08-17T02:25:42.418467+0000","last_clean":"2024-08-17T02:25:42.418467+0000","last_became_active":"2024-08-17T02:25:42.413711+0000","last_became_peered":"2024-08-17T02:25:42.413711+0000","last_unstale":"2024-08-17T02:25:42.418467+0000","last_undegraded":"2024-08-17T02:25:42.418467+0000","last_fullsized":"2024-08-17T02:25:42.418467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:00.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.407148+0000","last_change":"2024-08-17T02:25:41.412465+0000","last_active":"2024-08-17T02:25:42.407148+0000","last_peered":"2024-08-17T02:25:42.407148+0000","last_clean":"2024-08-17T02:25:42.407148+0000","last_became_active":"2024-08-17T02:25:41.412180+0000","last_became_peered":"2024-08-17T02:25:41.412180+0000","last_unstale":"2024-08-17T02:25:42.407148+0000","last_undegraded":"2024-08-17T02:25:42.407148+0000","last_fullsized":"2024-08-17T02:25:42.407148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:40:41.453122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.421568+0000","last_change":"2024-08-17T02:25:42.416127+0000","last_active":"2024-08-17T02:25:42.421568+0000","last_peered":"2024-08-17T02:25:42.421568+0000","last_clean":"2024-08-17T02:25:42.421568+0000","last_became_active":"2024-08-17T02:25:42.415840+0000","last_became_peered":"2024-08-17T02:25:42.415840+0000","last_unstale":"2024-08-17T02:25:42.421568+0000","last_undegraded":"2024-08-17T02:25:42.421568+0000","last_fullsized":"2024-08-17T02:25:42.421568+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:08.682776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.406888+0000","last_change":"2024-08-17T02:25:41.416977+0000","last_active":"2024-08-17T02:25:42.406888+0000","last_peered":"2024-08-17T02:25:42.406888+0000","last_clean":"2024-08-17T02:25:42.406888+0000","last_became_active":"2024-08-17T02:25:41.416573+0000","last_became_peered":"2024-08-17T02:25:41.416573+0000","last_unstale":"2024-08-17T02:25:42.406888+0000","last_undegraded":"2024-08-17T02:25:42.406888+0000","last_fullsized":"2024-08-17T02:25:42.406888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:14.096901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.423408+0000","last_change":"2024-08-17T02:25:42.420814+0000","last_active":"2024-08-17T02:25:42.423408+0000","last_peered":"2024-08-17T02:25:42.423408+0000","last_clean":"2024-08-17T02:25:42.423408+0000","last_became_active":"2024-08-17T02:25:42.420331+0000","last_became_peered":"2024-08-17T02:25:42.420331+0000","last_unstale":"2024-08-17T02:25:42.423408+0000","last_undegraded":"2024-08-17T02:25:42.423408+0000","last_fullsized":"2024-08-17T02:25:42.423408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:22.274775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433822+0000","last_change":"2024-08-17T02:25:41.406456+0000","last_active":"2024-08-17T02:25:42.433822+0000","last_peered":"2024-08-17T02:25:42.433822+0000","last_clean":"2024-08-17T02:25:42.433822+0000","last_became_active":"2024-08-17T02:25:41.406085+0000","last_became_peered":"2024-08-17T02:25:41.406085+0000","last_unstale":"2024-08-17T02:25:42.433822+0000","last_undegraded":"2024-08-17T02:25:42.433822+0000","last_fullsized":"2024-08-17T02:25:42.433822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:16:40.187213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422731+0000","last_change":"2024-08-17T02:25:42.419317+0000","last_active":"2024-08-17T02:25:42.422731+0000","last_peered":"2024-08-17T02:25:42.422731+0000","last_clean":"2024-08-17T02:25:42.422731+0000","last_became_active":"2024-08-17T02:25:42.418969+0000","last_became_peered":"2024-08-17T02:25:42.418969+0000","last_unstale":"2024-08-17T02:25:42.422731+0000","last_undegraded":"2024-08-17T02:25:42.422731+0000","last_fullsized":"2024-08-17T02:25:42.422731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:50.507537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.437445+0000","last_change":"2024-08-17T02:25:41.419970+0000","last_active":"2024-08-17T02:25:42.437445+0000","last_peered":"2024-08-17T02:25:42.437445+0000","last_clean":"2024-08-17T02:25:42.437445+0000","last_became_active":"2024-08-17T02:25:41.419704+0000","last_became_peered":"2024-08-17T02:25:41.419704+0000","last_unstale":"2024-08-17T02:25:42.437445+0000","last_undegraded":"2024-08-17T02:25:42.437445+0000","last_fullsized":"2024-08-17T02:25:42.437445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:01.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.418874+0000","last_change":"2024-08-17T02:25:42.416809+0000","last_active":"2024-08-17T02:25:42.418874+0000","last_peered":"2024-08-17T02:25:42.418874+0000","last_clean":"2024-08-17T02:25:42.418874+0000","last_became_active":"2024-08-17T02:25:42.416549+0000","last_became_peered":"2024-08-17T02:25:42.416549+0000","last_unstale":"2024-08-17T02:25:42.418874+0000","last_undegraded":"2024-08-17T02:25:42.418874+0000","last_fullsized":"2024-08-17T02:25:42.418874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:18:18.471103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433145+0000","last_change":"2024-08-17T02:25:41.415123+0000","last_active":"2024-08-17T02:25:42.433145+0000","last_peered":"2024-08-17T02:25:42.433145+0000","last_clean":"2024-08-17T02:25:42.433145+0000","last_became_active":"2024-08-17T02:25:41.414783+0000","last_became_peered":"2024-08-17T02:25:41.414783+0000","last_unstale":"2024-08-17T02:25:42.433145+0000","last_undegraded":"2024-08-17T02:25:42.433145+0000","last_fullsized":"2024-08-17T02:25:42.433145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:06.176945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422788+0000","last_change":"2024-08-17T02:25:42.418728+0000","last_active":"2024-08-17T02:25:42.422788+0000","last_peered":"2024-08-17T02:25:42.422788+0000","last_clean":"2024-08-17T02:25:42.422788+0000","last_became_active":"2024-08-17T02:25:42.418446+0000","last_became_peered":"2024-08-17T02:25:42.418446+0000","last_unstale":"2024-08-17T02:25:42.422788+0000","last_undegraded":"2024-08-17T02:25:42.422788+0000","last_fullsized":"2024-08-17T02:25:42.422788+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:42.876425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.413093+0000","last_change":"2024-08-17T02:25:41.417738+0000","last_active":"2024-08-17T02:25:42.413093+0000","last_peered":"2024-08-17T02:25:42.413093+0000","last_clean":"2024-08-17T02:25:42.413093+0000","last_became_active":"2024-08-17T02:25:41.417458+0000","last_became_peered":"2024-08-17T02:25:41.417458+0000","last_unstale":"2024-08-17T02:25:42.413093+0000","last_undegraded":"2024-08-17T02:25:42.413093+0000","last_fullsized":"2024-08-17T02:25:42.413093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:42.545781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433104+0000","last_change":"2024-08-17T02:25:42.426300+0000","last_active":"2024-08-17T02:25:42.433104+0000","last_peered":"2024-08-17T02:25:42.433104+0000","last_clean":"2024-08-17T02:25:42.433104+0000","last_became_active":"2024-08-17T02:25:42.425814+0000","last_became_peered":"2024-08-17T02:25:42.425814+0000","last_unstale":"2024-08-17T02:25:42.433104+0000","last_undegraded":"2024-08-17T02:25:42.433104+0000","last_fullsized":"2024-08-17T02:25:42.433104+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.413772+0000","last_change":"2024-08-17T02:25:41.412269+0000","last_active":"2024-08-17T02:25:42.413772+0000","last_peered":"2024-08-17T02:25:42.413772+0000","last_clean":"2024-08-17T02:25:42.413772+0000","last_became_active":"2024-08-17T02:25:41.411996+0000","last_became_peered":"2024-08-17T02:25:41.411996+0000","last_unstale":"2024-08-17T02:25:42.413772+0000","last_undegraded":"2024-08-17T02:25:42.413772+0000","last_fullsized":"2024-08-17T02:25:42.413772+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:26.990290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425996+0000","last_change":"2024-08-17T02:25:42.421316+0000","last_active":"2024-08-17T02:25:42.425996+0000","last_peered":"2024-08-17T02:25:42.425996+0000","last_clean":"2024-08-17T02:25:42.425996+0000","last_became_active":"2024-08-17T02:25:42.421027+0000","last_became_peered":"2024-08-17T02:25:42.421027+0000","last_unstale":"2024-08-17T02:25:42.425996+0000","last_undegraded":"2024-08-17T02:25:42.425996+0000","last_fullsized":"2024-08-17T02:25:42.425996+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:22.274775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434535+0000","last_change":"2024-08-17T02:25:41.417196+0000","last_active":"2024-08-17T02:25:42.434535+0000","last_peered":"2024-08-17T02:25:42.434535+0000","last_clean":"2024-08-17T02:25:42.434535+0000","last_became_active":"2024-08-17T02:25:41.416884+0000","last_became_peered":"2024-08-17T02:25:41.416884+0000","last_unstale":"2024-08-17T02:25:42.434535+0000","last_undegraded":"2024-08-17T02:25:42.434535+0000","last_fullsized":"2024-08-17T02:25:42.434535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:00:51.323262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422708+0000","last_change":"2024-08-17T02:25:42.419706+0000","last_active":"2024-08-17T02:25:42.422708+0000","last_peered":"2024-08-17T02:25:42.422708+0000","last_clean":"2024-08-17T02:25:42.422708+0000","last_became_active":"2024-08-17T02:25:42.419419+0000","last_became_peered":"2024-08-17T02:25:42.419419+0000","last_unstale":"2024-08-17T02:25:42.422708+0000","last_undegraded":"2024-08-17T02:25:42.422708+0000","last_fullsized":"2024-08-17T02:25:42.422708+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:02:45.898859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.431762+0000","last_change":"2024-08-17T02:25:41.413608+0000","last_active":"2024-08-17T02:25:42.431762+0000","last_peered":"2024-08-17T02:25:42.431762+0000","last_clean":"2024-08-17T02:25:42.431762+0000","last_became_active":"2024-08-17T02:25:41.413299+0000","last_became_peered":"2024-08-17T02:25:41.413299+0000","last_unstale":"2024-08-17T02:25:42.431762+0000","last_undegraded":"2024-08-17T02:25:42.431762+0000","last_fullsized":"2024-08-17T02:25:42.431762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:59.656053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.431534+0000","last_change":"2024-08-17T02:25:42.429851+0000","last_active":"2024-08-17T02:25:42.431534+0000","last_peered":"2024-08-17T02:25:42.431534+0000","last_clean":"2024-08-17T02:25:42.431534+0000","last_became_active":"2024-08-17T02:25:42.429575+0000","last_became_peered":"2024-08-17T02:25:42.429575+0000","last_unstale":"2024-08-17T02:25:42.431534+0000","last_undegraded":"2024-08-17T02:25:42.431534+0000","last_fullsized":"2024-08-17T02:25:42.431534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:33.834531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.433124+0000","last_change":"2024-08-17T02:25:41.416074+0000","last_active":"2024-08-17T02:25:42.433124+0000","last_peered":"2024-08-17T02:25:42.433124+0000","last_clean":"2024-08-17T02:25:42.433124+0000","last_became_active":"2024-08-17T02:25:41.415694+0000","last_became_peered":"2024-08-17T02:25:41.415694+0000","last_unstale":"2024-08-17T02:25:42.433124+0000","last_undegraded":"2024-08-17T02:25:42.433124+0000","last_fullsized":"2024-08-17T02:25:42.433124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:14.811773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.417304+0000","last_change":"2024-08-17T02:25:42.416290+0000","last_active":"2024-08-17T02:25:42.417304+0000","last_peered":"2024-08-17T02:25:42.417304+0000","last_clean":"2024-08-17T02:25:42.417304+0000","last_became_active":"2024-08-17T02:25:42.415998+0000","last_became_peered":"2024-08-17T02:25:42.415998+0000","last_unstale":"2024-08-17T02:25:42.417304+0000","last_undegraded":"2024-08-17T02:25:42.417304+0000","last_fullsized":"2024-08-17T02:25:42.417304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:34:21.933282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.432218+0000","last_change":"2024-08-17T02:25:41.411845+0000","last_active":"2024-08-17T02:25:42.432218+0000","last_peered":"2024-08-17T02:25:42.432218+0000","last_clean":"2024-08-17T02:25:42.432218+0000","last_became_active":"2024-08-17T02:25:41.410319+0000","last_became_peered":"2024-08-17T02:25:41.410319+0000","last_unstale":"2024-08-17T02:25:42.432218+0000","last_undegraded":"2024-08-17T02:25:42.432218+0000","last_fullsized":"2024-08-17T02:25:42.432218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:26.741363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.411755+0000","last_change":"2024-08-17T02:25:42.410194+0000","last_active":"2024-08-17T02:25:42.411755+0000","last_peered":"2024-08-17T02:25:42.411755+0000","last_clean":"2024-08-17T02:25:42.411755+0000","last_became_active":"2024-08-17T02:25:42.409899+0000","last_became_peered":"2024-08-17T02:25:42.409899+0000","last_unstale":"2024-08-17T02:25:42.411755+0000","last_undegraded":"2024-08-17T02:25:42.411755+0000","last_fullsized":"2024-08-17T02:25:42.411755+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:02.087099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.404352+0000","last_change":"2024-08-17T02:25:41.408140+0000","last_active":"2024-08-17T02:25:42.404352+0000","last_peered":"2024-08-17T02:25:42.404352+0000","last_clean":"2024-08-17T02:25:42.404352+0000","last_became_active":"2024-08-17T02:25:41.407869+0000","last_became_peered":"2024-08-17T02:25:41.407869+0000","last_unstale":"2024-08-17T02:25:42.404352+0000","last_undegraded":"2024-08-17T02:25:42.404352+0000","last_fullsized":"2024-08-17T02:25:42.404352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:39:22.195354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.411676+0000","last_change":"2024-08-17T02:25:42.407511+0000","last_active":"2024-08-17T02:25:42.411676+0000","last_peered":"2024-08-17T02:25:42.411676+0000","last_clean":"2024-08-17T02:25:42.411676+0000","last_became_active":"2024-08-17T02:25:42.407273+0000","last_became_peered":"2024-08-17T02:25:42.407273+0000","last_unstale":"2024-08-17T02:25:42.411676+0000","last_undegraded":"2024-08-17T02:25:42.411676+0000","last_fullsized":"2024-08-17T02:25:42.411676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:09.127853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434036+0000","last_change":"2024-08-17T02:25:41.420302+0000","last_active":"2024-08-17T02:25:42.434036+0000","last_peered":"2024-08-17T02:25:42.434036+0000","last_clean":"2024-08-17T02:25:42.434036+0000","last_became_active":"2024-08-17T02:25:41.419958+0000","last_became_peered":"2024-08-17T02:25:41.419958+0000","last_unstale":"2024-08-17T02:25:42.434036+0000","last_undegraded":"2024-08-17T02:25:42.434036+0000","last_fullsized":"2024-08-17T02:25:42.434036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:53.300389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.414299+0000","last_change":"2024-08-17T02:25:42.412058+0000","last_active":"2024-08-17T02:25:42.414299+0000","last_peered":"2024-08-17T02:25:42.414299+0000","last_clean":"2024-08-17T02:25:42.414299+0000","last_became_active":"2024-08-17T02:25:42.411754+0000","last_became_peered":"2024-08-17T02:25:42.411754+0000","last_unstale":"2024-08-17T02:25:42.414299+0000","last_undegraded":"2024-08-17T02:25:42.414299+0000","last_fullsized":"2024-08-17T02:25:42.414299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:28.661646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.411424+0000","last_change":"2024-08-17T02:25:41.412762+0000","last_active":"2024-08-17T02:25:42.411424+0000","last_peered":"2024-08-17T02:25:42.411424+0000","last_clean":"2024-08-17T02:25:42.411424+0000","last_became_active":"2024-08-17T02:25:41.412398+0000","last_became_peered":"2024-08-17T02:25:41.412398+0000","last_unstale":"2024-08-17T02:25:42.411424+0000","last_undegraded":"2024-08-17T02:25:42.411424+0000","last_fullsized":"2024-08-17T02:25:42.411424+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:01:01.078359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425054+0000","last_change":"2024-08-17T02:25:42.422487+0000","last_active":"2024-08-17T02:25:42.425054+0000","last_peered":"2024-08-17T02:25:42.425054+0000","last_clean":"2024-08-17T02:25:42.425054+0000","last_became_active":"2024-08-17T02:25:42.422179+0000","last_became_peered":"2024-08-17T02:25:42.422179+0000","last_unstale":"2024-08-17T02:25:42.425054+0000","last_undegraded":"2024-08-17T02:25:42.425054+0000","last_fullsized":"2024-08-17T02:25:42.425054+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:59.120811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.413973+0000","last_change":"2024-08-17T02:25:41.408829+0000","last_active":"2024-08-17T02:25:42.413973+0000","last_peered":"2024-08-17T02:25:42.413973+0000","last_clean":"2024-08-17T02:25:42.413973+0000","last_became_active":"2024-08-17T02:25:41.408507+0000","last_became_peered":"2024-08-17T02:25:41.408507+0000","last_unstale":"2024-08-17T02:25:42.413973+0000","last_undegraded":"2024-08-17T02:25:42.413973+0000","last_fullsized":"2024-08-17T02:25:42.413973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:55.936904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.431503+0000","last_change":"2024-08-17T02:25:42.428934+0000","last_active":"2024-08-17T02:25:42.431503+0000","last_peered":"2024-08-17T02:25:42.431503+0000","last_clean":"2024-08-17T02:25:42.431503+0000","last_became_active":"2024-08-17T02:25:42.428579+0000","last_became_peered":"2024-08-17T02:25:42.428579+0000","last_unstale":"2024-08-17T02:25:42.431503+0000","last_undegraded":"2024-08-17T02:25:42.431503+0000","last_fullsized":"2024-08-17T02:25:42.431503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:01:35.750552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.402895+0000","last_change":"2024-08-17T02:25:41.404004+0000","last_active":"2024-08-17T02:25:42.402895+0000","last_peered":"2024-08-17T02:25:42.402895+0000","last_clean":"2024-08-17T02:25:42.402895+0000","last_became_active":"2024-08-17T02:25:41.403735+0000","last_became_peered":"2024-08-17T02:25:41.403735+0000","last_unstale":"2024-08-17T02:25:42.402895+0000","last_undegraded":"2024-08-17T02:25:42.402895+0000","last_fullsized":"2024-08-17T02:25:42.402895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:42.545781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.410319+0000","last_change":"2024-08-17T02:25:42.408344+0000","last_active":"2024-08-17T02:25:42.410319+0000","last_peered":"2024-08-17T02:25:42.410319+0000","last_clean":"2024-08-17T02:25:42.410319+0000","last_became_active":"2024-08-17T02:25:42.408053+0000","last_became_peered":"2024-08-17T02:25:42.408053+0000","last_unstale":"2024-08-17T02:25:42.410319+0000","last_undegraded":"2024-08-17T02:25:42.410319+0000","last_fullsized":"2024-08-17T02:25:42.410319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:57.975103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.434710+0000","last_change":"2024-08-17T02:25:41.411005+0000","last_active":"2024-08-17T02:25:42.434710+0000","last_peered":"2024-08-17T02:25:42.434710+0000","last_clean":"2024-08-17T02:25:42.434710+0000","last_became_active":"2024-08-17T02:25:41.410680+0000","last_became_peered":"2024-08-17T02:25:41.410680+0000","last_unstale":"2024-08-17T02:25:42.434710+0000","last_undegraded":"2024-08-17T02:25:42.434710+0000","last_fullsized":"2024-08-17T02:25:42.434710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:41.995822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.412879+0000","last_change":"2024-08-17T02:25:42.408871+0000","last_active":"2024-08-17T02:25:42.412879+0000","last_peered":"2024-08-17T02:25:42.412879+0000","last_clean":"2024-08-17T02:25:42.412879+0000","last_became_active":"2024-08-17T02:25:42.408058+0000","last_became_peered":"2024-08-17T02:25:42.408058+0000","last_unstale":"2024-08-17T02:25:42.412879+0000","last_undegraded":"2024-08-17T02:25:42.412879+0000","last_fullsized":"2024-08-17T02:25:42.412879+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:41.832444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.406994+0000","last_change":"2024-08-17T02:25:41.415141+0000","last_active":"2024-08-17T02:25:42.406994+0000","last_peered":"2024-08-17T02:25:42.406994+0000","last_clean":"2024-08-17T02:25:42.406994+0000","last_became_active":"2024-08-17T02:25:41.414871+0000","last_became_peered":"2024-08-17T02:25:41.414871+0000","last_unstale":"2024-08-17T02:25:42.406994+0000","last_undegraded":"2024-08-17T02:25:42.406994+0000","last_fullsized":"2024-08-17T02:25:42.406994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:53:15.442741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.425659+0000","last_change":"2024-08-17T02:25:42.418873+0000","last_active":"2024-08-17T02:25:42.425659+0000","last_peered":"2024-08-17T02:25:42.425659+0000","last_clean":"2024-08-17T02:25:42.425659+0000","last_became_active":"2024-08-17T02:25:42.418596+0000","last_became_peered":"2024-08-17T02:25:42.418596+0000","last_unstale":"2024-08-17T02:25:42.425659+0000","last_undegraded":"2024-08-17T02:25:42.425659+0000","last_fullsized":"2024-08-17T02:25:42.425659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:43.004563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.399850+0000","last_change":"2024-08-17T02:25:41.406162+0000","last_active":"2024-08-17T02:25:42.399850+0000","last_peered":"2024-08-17T02:25:42.399850+0000","last_clean":"2024-08-17T02:25:42.399850+0000","last_became_active":"2024-08-17T02:25:41.405855+0000","last_became_peered":"2024-08-17T02:25:41.405855+0000","last_unstale":"2024-08-17T02:25:42.399850+0000","last_undegraded":"2024-08-17T02:25:42.399850+0000","last_fullsized":"2024-08-17T02:25:42.399850+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:05.947031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429150+0000","last_change":"2024-08-17T02:25:42.423499+0000","last_active":"2024-08-17T02:25:42.429150+0000","last_peered":"2024-08-17T02:25:42.429150+0000","last_clean":"2024-08-17T02:25:42.429150+0000","last_became_active":"2024-08-17T02:25:42.423157+0000","last_became_peered":"2024-08-17T02:25:42.423157+0000","last_unstale":"2024-08-17T02:25:42.429150+0000","last_undegraded":"2024-08-17T02:25:42.429150+0000","last_fullsized":"2024-08-17T02:25:42.429150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:47.035562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.400060+0000","last_change":"2024-08-17T02:25:41.411329+0000","last_active":"2024-08-17T02:25:42.400060+0000","last_peered":"2024-08-17T02:25:42.400060+0000","last_clean":"2024-08-17T02:25:42.400060+0000","last_became_active":"2024-08-17T02:25:41.410916+0000","last_became_peered":"2024-08-17T02:25:41.410916+0000","last_unstale":"2024-08-17T02:25:42.400060+0000","last_undegraded":"2024-08-17T02:25:42.400060+0000","last_fullsized":"2024-08-17T02:25:42.400060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:56.966363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.422601+0000","last_change":"2024-08-17T02:25:42.416987+0000","last_active":"2024-08-17T02:25:42.422601+0000","last_peered":"2024-08-17T02:25:42.422601+0000","last_clean":"2024-08-17T02:25:42.422601+0000","last_became_active":"2024-08-17T02:25:42.416662+0000","last_became_peered":"2024-08-17T02:25:42.416662+0000","last_unstale":"2024-08-17T02:25:42.422601+0000","last_undegraded":"2024-08-17T02:25:42.422601+0000","last_fullsized":"2024-08-17T02:25:42.422601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:57:00.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.400410+0000","last_change":"2024-08-17T02:25:41.411479+0000","last_active":"2024-08-17T02:25:42.400410+0000","last_peered":"2024-08-17T02:25:42.400410+0000","last_clean":"2024-08-17T02:25:42.400410+0000","last_became_active":"2024-08-17T02:25:41.411185+0000","last_became_peered":"2024-08-17T02:25:41.411185+0000","last_unstale":"2024-08-17T02:25:42.400410+0000","last_undegraded":"2024-08-17T02:25:42.400410+0000","last_fullsized":"2024-08-17T02:25:42.400410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:53:14.811773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.431196+0000","last_change":"2024-08-17T02:25:42.426045+0000","last_active":"2024-08-17T02:25:42.431196+0000","last_peered":"2024-08-17T02:25:42.431196+0000","last_clean":"2024-08-17T02:25:42.431196+0000","last_became_active":"2024-08-17T02:25:42.425767+0000","last_became_peered":"2024-08-17T02:25:42.425767+0000","last_unstale":"2024-08-17T02:25:42.431196+0000","last_undegraded":"2024-08-17T02:25:42.431196+0000","last_fullsized":"2024-08-17T02:25:42.431196+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:48:54.517688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.412824+0000","last_change":"2024-08-17T02:25:41.416245+0000","last_active":"2024-08-17T02:25:42.412824+0000","last_peered":"2024-08-17T02:25:42.412824+0000","last_clean":"2024-08-17T02:25:42.412824+0000","last_became_active":"2024-08-17T02:25:41.415762+0000","last_became_peered":"2024-08-17T02:25:41.415762+0000","last_unstale":"2024-08-17T02:25:42.412824+0000","last_undegraded":"2024-08-17T02:25:42.412824+0000","last_fullsized":"2024-08-17T02:25:42.412824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:05.947031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.412907+0000","last_change":"2024-08-17T02:25:42.409630+0000","last_active":"2024-08-17T02:25:42.412907+0000","last_peered":"2024-08-17T02:25:42.412907+0000","last_clean":"2024-08-17T02:25:42.412907+0000","last_became_active":"2024-08-17T02:25:42.409370+0000","last_became_peered":"2024-08-17T02:25:42.409370+0000","last_unstale":"2024-08-17T02:25:42.412907+0000","last_undegraded":"2024-08-17T02:25:42.412907+0000","last_fullsized":"2024-08-17T02:25:42.412907+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:04:42.876425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.414582+0000","last_change":"2024-08-17T02:25:41.413754+0000","last_active":"2024-08-17T02:25:42.414582+0000","last_peered":"2024-08-17T02:25:42.414582+0000","last_clean":"2024-08-17T02:25:42.414582+0000","last_became_active":"2024-08-17T02:25:41.413461+0000","last_became_peered":"2024-08-17T02:25:41.413461+0000","last_unstale":"2024-08-17T02:25:42.414582+0000","last_undegraded":"2024-08-17T02:25:42.414582+0000","last_fullsized":"2024-08-17T02:25:42.414582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:21.125266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.429023+0000","last_change":"2024-08-17T02:25:42.422150+0000","last_active":"2024-08-17T02:25:42.429023+0000","last_peered":"2024-08-17T02:25:42.429023+0000","last_clean":"2024-08-17T02:25:42.429023+0000","last_became_active":"2024-08-17T02:25:42.409094+0000","last_became_peered":"2024-08-17T02:25:42.409094+0000","last_unstale":"2024-08-17T02:25:42.429023+0000","last_undegraded":"2024-08-17T02:25:42.429023+0000","last_fullsized":"2024-08-17T02:25:42.429023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:41.379334+0000","last_clean_scrub_stamp":"2024-08-17T02:25:41.379334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:39:44.235619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.405448+0000","last_change":"2024-08-17T02:25:41.413342+0000","last_active":"2024-08-17T02:25:42.405448+0000","last_peered":"2024-08-17T02:25:42.405448+0000","last_clean":"2024-08-17T02:25:42.405448+0000","last_became_active":"2024-08-17T02:25:41.411807+0000","last_became_peered":"2024-08-17T02:25:41.411807+0000","last_unstale":"2024-08-17T02:25:42.405448+0000","last_undegraded":"2024-08-17T02:25:42.405448+0000","last_fullsized":"2024-08-17T02:25:42.405448+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:40.370594+0000","last_clean_scrub_stamp":"2024-08-17T02:25:40.370594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:05:58.112071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":174,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-08-17T02:25:42.411159+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:25:42.411159+0000","last_peered":"2024-08-17T02:25:42.411159+0000","last_clean":"2024-08-17T02:25:42.411159+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:25:42.411159+0000","last_undegraded":"2024-08-17T02:25:42.411159+0000","last_fullsized":"2024-08-17T02:25:42.411159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":405504,"data_stored":155343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.621},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.95599999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.006},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.748}]},{"osd":3,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.075}]},{"osd":4,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.0369999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":1.135},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.88200000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.92900000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":413696,"data_stored":156873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.95899999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0760000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.623}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0580000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.82299999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.1459999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":417792,"data_stored":156895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.69899999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.173},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.77800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.89600000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.1279999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.085},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.84299999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.873},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.04}]}]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":417792,"data_stored":156085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.81499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.997}]},{"osd":5,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.1639999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.2709999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:33 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.242},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.0740000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":405504,"data_stored":155355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.67600000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.88400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.71699999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.163}]},{"osd":5,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.272},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.3009999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.046},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.1240000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:25:34 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":1.393},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.3340000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":999424,"data_stored":745759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.83599999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.73399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":1.0289999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.877},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.90300000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.502},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.0840000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.421},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.98199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:25:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.5629999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297752,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074088,"statfs":{"total":96636764160,"available":96331866112,"internally_reserved":0,"allocated":405504,"data_stored":155411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.625},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.008}]},{"osd":4,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.2290000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.111},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.264}]},{"osd":6,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.395},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.1970000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:25:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":1.306},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.3540000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":999424,"data_stored":746259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.111},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.016}]},{"osd":1,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.751},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":1.1990000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.84099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.2569999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1439999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:25:38 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.331},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.173}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:25:50.192 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:25:50.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.305+0000 7fd1dc538700 1 Processor -- start 2024-08-17T02:25:50.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.305+0000 7fd1dc538700 1 -- start start 2024-08-17T02:25:50.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1dc538700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1d40ccce0 0x7fd1d40cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1dc538700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d4153d20 con 0x7fd1d4067e10 2024-08-17T02:25:50.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1dc538700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d4068290 con 0x7fd1d4159820 2024-08-17T02:25:50.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1dc538700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4159c70 con 0x7fd1d40ccce0 2024-08-17T02:25:50.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1daad5700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd1d4067e10 0x7fd1d406f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50280/0 (socket says 172.21.15.31:50280) 2024-08-17T02:25:50.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1daad5700 1 -- 172.21.15.31:0/324185557 learned_addr learned my addr 172.21.15.31:0/324185557 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1da2d4700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1d40ccce0 0x7fd1d40cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521731513 0 0) 0x7fd1d4153d20 con 0x7fd1d4067e10 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c0003570 con 0x7fd1d4067e10 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1573100593 0 0) 0x7fd1c0003570 con 0x7fd1d4067e10 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1d40ccce0 msgr2=0x7fd1d40cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1d40ccce0 0x7fd1d40cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 >> v1:172.21.15.92:6789/0 conn(0x7fd1d4159820 legacy=0x7fd1d40cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4159e50 con 0x7fd1d4067e10 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7fd1cc0017f0 con 0x7fd1d4067e10 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 >> v1:172.21.15.31:6789/0 conn(0x7fd1d4067e10 legacy=0x7fd1d406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1c0003a90 0x7fd1c0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1d40ccce0 0x7fd1c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1c0004d50 0x7fd1c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4159c70 con 0x7fd1c0004d50 2024-08-17T02:25:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c000bb10 con 0x7fd1c0003a90 2024-08-17T02:25:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c000bc50 con 0x7fd1d40ccce0 2024-08-17T02:25:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1daad5700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1c0004d50 0x7fd1c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1da2d4700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1c0003a90 0x7fd1c0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d9ad3700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1d40ccce0 0x7fd1c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1daad5700 1 -- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1d40ccce0 msgr2=0x7fd1c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1daad5700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1d40ccce0 0x7fd1c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1daad5700 1 -- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1c0003a90 msgr2=0x7fd1c0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:50.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1daad5700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1c0003a90 0x7fd1c0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1daad5700 1 -- 172.21.15.31:0/324185557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c0003570 con 0x7fd1c0004d50 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d9ad3700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1d40ccce0 0x7fd1c0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1daad5700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1c0004d50 0x7fd1c00051c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc005c30 tx=0x7fd1cc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515daa54733dd3fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0055a0 con 0x7fd1c0004d50 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc00d960 con 0x7fd1c0004d50 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.309+0000 7fd1d92d2700 1 -- 172.21.15.31:0/324185557 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00dd00 con 0x7fd1c0004d50 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 -- 172.21.15.31:0/324185557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1c0004d50 msgr2=0x7fd1c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 --2- 172.21.15.31:0/324185557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1c0004d50 0x7fd1c00051c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc005c30 tx=0x7fd1cc005270 comp rx=0 tx=0).stop 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1daad5700 1 -- 172.21.15.31:0/324185557 reap_dead start 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 -- 172.21.15.31:0/324185557 shutdown_connections 2024-08-17T02:25:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 -- 172.21.15.31:0/324185557 >> 172.21.15.31:0/324185557 conn(0x7fd1d40cc6b0 msgr2=0x7fd1d40b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 -- 172.21.15.31:0/324185557 shutdown_connections 2024-08-17T02:25:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 -- 172.21.15.31:0/324185557 wait complete. 2024-08-17T02:25:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 Processor -- start 2024-08-17T02:25:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 -- start start 2024-08-17T02:25:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1c0004d50 0x7fd1d41440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1d41538e0 0x7fd1d4153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d40c7d30 0x7fd1d40c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d41557b0 con 0x7fd1d41538e0 2024-08-17T02:25:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4154290 con 0x7fd1d40c7d30 2024-08-17T02:25:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1dc538700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d41559e0 con 0x7fd1c0004d50 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1d9ad3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1d41538e0 0x7fd1d4153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1d9ad3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1d41538e0 0x7fd1d4153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39780/0 (socket says 172.21.15.31:39780) 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1d9ad3700 1 -- 172.21.15.31:0/1962545536 learned_addr learned my addr 172.21.15.31:0/1962545536 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1daad5700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d40c7d30 0x7fd1d40c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.313+0000 7fd1da2d4700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1c0004d50 0x7fd1d41440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1d9ad3700 1 -- 172.21.15.31:0/1962545536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1c0004d50 msgr2=0x7fd1d41440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1d9ad3700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1c0004d50 0x7fd1d41440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1d9ad3700 1 -- 172.21.15.31:0/1962545536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d40c7d30 msgr2=0x7fd1d40c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1d9ad3700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d40c7d30 0x7fd1d40c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1d9ad3700 1 -- 172.21.15.31:0/1962545536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4155cc0 con 0x7fd1d41538e0 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1daad5700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d40c7d30 0x7fd1d40c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1d9ad3700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1d41538e0 0x7fd1d4153d50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400d850 tx=0x7fd1c4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1ca7fc700 1 -- 172.21.15.31:0/1962545536 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4012600 con 0x7fd1d41538e0 2024-08-17T02:25:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1dc538700 1 -- 172.21.15.31:0/1962545536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d4155fa0 con 0x7fd1d41538e0 2024-08-17T02:25:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1ca7fc700 1 -- 172.21.15.31:0/1962545536 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4001e90 con 0x7fd1d41538e0 2024-08-17T02:25:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1dc538700 1 -- 172.21.15.31:0/1962545536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d4156560 con 0x7fd1d41538e0 2024-08-17T02:25:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1ca7fc700 1 -- 172.21.15.31:0/1962545536 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4012970 con 0x7fd1d41538e0 2024-08-17T02:25:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1dc538700 1 -- 172.21.15.31:0/1962545536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d40712b0 con 0x7fd1d41538e0 2024-08-17T02:25:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1ca7fc700 1 -- 172.21.15.31:0/1962545536 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd1c4012d20 con 0x7fd1d41538e0 2024-08-17T02:25:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1ca7fc700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd1b8060890 0x7fd1b8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1ca7fc700 1 -- 172.21.15.31:0/1962545536 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1c407ce50 con 0x7fd1d41538e0 2024-08-17T02:25:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.317+0000 7fd1da2d4700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd1b8060890 0x7fd1b8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.321+0000 7fd1da2d4700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd1b8060890 0x7fd1b8062d40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009d10 tx=0x7fd1d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.325+0000 7fd1ca7fc700 1 -- 172.21.15.31:0/1962545536 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd1c404d200 con 0x7fd1d41538e0 2024-08-17T02:25:50.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.545+0000 7fd1dc538700 1 -- 172.21.15.31:0/1962545536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd1d4063410 con 0x7fd1d41538e0 2024-08-17T02:25:50.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.553+0000 7fd1ca7fc700 1 -- 172.21.15.31:0/1962545536 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd1c4050820 con 0x7fd1d41538e0 2024-08-17T02:25:50.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 -- 172.21.15.31:0/1962545536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd1b8060890 msgr2=0x7fd1b8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd1b8060890 0x7fd1b8062d40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009d10 tx=0x7fd1d0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:50.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 -- 172.21.15.31:0/1962545536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1d41538e0 msgr2=0x7fd1d4153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1d41538e0 0x7fd1d4153d50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400d850 tx=0x7fd1c4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:50.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 -- 172.21.15.31:0/1962545536 shutdown_connections 2024-08-17T02:25:50.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd1b8060890 0x7fd1b8062d40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1d40c7d30 0x7fd1d40c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1d41538e0 0x7fd1d4153d50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 --2- 172.21.15.31:0/1962545536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1c0004d50 0x7fd1d41440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 -- 172.21.15.31:0/1962545536 >> 172.21.15.31:0/1962545536 conn(0x7fd1d40cc6b0 msgr2=0x7fd1d406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 -- 172.21.15.31:0/1962545536 shutdown_connections 2024-08-17T02:25:50.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.557+0000 7fd1dc538700 1 -- 172.21.15.31:0/1962545536 wait complete. 2024-08-17T02:25:50.560 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-08-17T02:25:50.571 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 Processor -- start 2024-08-17T02:25:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 -- start start 2024-08-17T02:25:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f90d806bd00 0x7f90d80b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d8157290 0x7f90d80b1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d80cbf40 con 0x7f90d8156ec0 2024-08-17T02:25:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d80b18a0 con 0x7f90d806bd00 2024-08-17T02:25:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80b2110 con 0x7f90d8157290 2024-08-17T02:25:50.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d77fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f90d8156ec0 0x7f90d806b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50296/0 (socket says 172.21.15.31:50296) 2024-08-17T02:25:50.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d77fe700 1 -- 172.21.15.31:0/4108508230 learned_addr learned my addr 172.21.15.31:0/4108508230 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:50.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d6ffd700 1 --2- 172.21.15.31:0/4108508230 >> v2:172.21.15.92:3300/0 conn(0x7f90d806bd00 0x7f90d80b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d7fff700 1 --2- 172.21.15.31:0/4108508230 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d8157290 0x7f90d80b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d6ffd700 1 -- 172.21.15.31:0/4108508230 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d8157290 msgr2=0x7f90d80b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:50.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d6ffd700 1 --2- 172.21.15.31:0/4108508230 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d8157290 0x7f90d80b1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d67fc700 1 -- 172.21.15.31:0/4108508230 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020549120 0 0) 0x7f90d80cbf40 con 0x7f90d8156ec0 2024-08-17T02:25:50.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d6ffd700 1 -- 172.21.15.31:0/4108508230 >> v1:172.21.15.31:6789/0 conn(0x7f90d8156ec0 legacy=0x7f90d806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d6ffd700 1 -- 172.21.15.31:0/4108508230 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80b1b50 con 0x7f90d806bd00 2024-08-17T02:25:50.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d6ffd700 1 --2- 172.21.15.31:0/4108508230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d806bd00 0x7f90d80b0e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f90c80098e0 tx=0x7f90c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdcfcc003379d52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d67fc700 1 -- 172.21.15.31:0/4108508230 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8009e80 con 0x7f90d806bd00 2024-08-17T02:25:50.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d67fc700 1 -- 172.21.15.31:0/4108508230 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c800b860 con 0x7f90d806bd00 2024-08-17T02:25:50.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90d67fc700 1 -- 172.21.15.31:0/4108508230 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c800bbe0 con 0x7f90d806bd00 2024-08-17T02:25:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 -- 172.21.15.31:0/4108508230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d806bd00 msgr2=0x7f90d80b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 --2- 172.21.15.31:0/4108508230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d806bd00 0x7f90d80b0e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f90c80098e0 tx=0x7f90c80091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 -- 172.21.15.31:0/4108508230 shutdown_connections 2024-08-17T02:25:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 --2- 172.21.15.31:0/4108508230 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d8157290 0x7f90d80b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 --2- 172.21.15.31:0/4108508230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d806bd00 0x7f90d80b0e20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 -- 172.21.15.31:0/4108508230 >> 172.21.15.31:0/4108508230 conn(0x7f90d80cdf80 msgr2=0x7f90d80ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 -- 172.21.15.31:0/4108508230 shutdown_connections 2024-08-17T02:25:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.677+0000 7f90dce1e700 1 -- 172.21.15.31:0/4108508230 wait complete. 2024-08-17T02:25:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90dce1e700 1 Processor -- start 2024-08-17T02:25:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90dce1e700 1 -- start start 2024-08-17T02:25:50.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90dce1e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d806bd00 0x7f90d80c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90dce1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90d8156ec0 0x7f90d80ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90dce1e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d8157290 0x7f90d816c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90dce1e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80ca750 con 0x7f90d8156ec0 2024-08-17T02:25:50.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90dce1e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8145a80 con 0x7f90d8157290 2024-08-17T02:25:50.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90dce1e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80c7ad0 con 0x7f90d806bd00 2024-08-17T02:25:50.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90d6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90d8156ec0 0x7f90d80ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90d6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90d8156ec0 0x7f90d80ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39790/0 (socket says 172.21.15.31:39790) 2024-08-17T02:25:50.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90d6ffd700 1 -- 172.21.15.31:0/1675918839 learned_addr learned my addr 172.21.15.31:0/1675918839 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:50.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90d7fff700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d8157290 0x7f90d816c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.681+0000 7f90d77fe700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d806bd00 0x7f90d80c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90d77fe700 1 -- 172.21.15.31:0/1675918839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d8157290 msgr2=0x7f90d816c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90d77fe700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d8157290 0x7f90d816c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90d77fe700 1 -- 172.21.15.31:0/1675918839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90d8156ec0 msgr2=0x7f90d80ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90d77fe700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90d8156ec0 0x7f90d80ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90d77fe700 1 -- 172.21.15.31:0/1675918839 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8009420 con 0x7f90d806bd00 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90d6ffd700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90d8156ec0 0x7f90d80ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90d7fff700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d8157290 0x7f90d816c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90d77fe700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d806bd00 0x7f90d80c7440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f90d000cc90 tx=0x7f90d0001a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90cf7fe700 1 -- 172.21.15.31:0/1675918839 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d000a870 con 0x7f90d806bd00 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90cf7fe700 1 -- 172.21.15.31:0/1675918839 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d000a9d0 con 0x7f90d806bd00 2024-08-17T02:25:50.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90cf7fe700 1 -- 172.21.15.31:0/1675918839 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d000ad70 con 0x7f90d806bd00 2024-08-17T02:25:50.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90dce1e700 1 -- 172.21.15.31:0/1675918839 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d80c7db0 con 0x7f90d806bd00 2024-08-17T02:25:50.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90dce1e700 1 -- 172.21.15.31:0/1675918839 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d80c8370 con 0x7f90d806bd00 2024-08-17T02:25:50.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90dce1e700 1 -- 172.21.15.31:0/1675918839 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d80712b0 con 0x7f90d806bd00 2024-08-17T02:25:50.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90cf7fe700 1 -- 172.21.15.31:0/1675918839 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f90d0007300 con 0x7f90d806bd00 2024-08-17T02:25:50.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90cf7fe700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90b80608e0 0x7f90b8062d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90d6ffd700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90b80608e0 0x7f90b8062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.685+0000 7f90cf7fe700 1 -- 172.21.15.31:0/1675918839 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90d007cf20 con 0x7f90d806bd00 2024-08-17T02:25:50.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.689+0000 7f90d6ffd700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90b80608e0 0x7f90b8062d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f90c8003080 tx=0x7f90c8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.697+0000 7f90cf7fe700 1 -- 172.21.15.31:0/1675918839 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f90d004d350 con 0x7f90d806bd00 2024-08-17T02:25:50.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.897+0000 7f90dce1e700 1 -- 172.21.15.31:0/1675918839 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90d806ab70 con 0x7f90d806bd00 2024-08-17T02:25:50.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.897+0000 7f90cf7fe700 1 -- 172.21.15.31:0/1675918839 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f90d0050970 con 0x7f90d806bd00 2024-08-17T02:25:50.901 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:25:50.901 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1920530016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1920530016},{"type":"v1","addr":"172.21.15.92:6833","nonce":1920530016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3381009547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3381009547},{"type":"v1","addr":"172.21.15.92:6835","nonce":3381009547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5040,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/548139464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":548139464},{"type":"v1","addr":"172.21.15.31:6836","nonce":548139464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:41.765672+0000","modified":"2024-08-17T02:25:44.420703+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6837/1886584780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1886584780},{"type":"v1","addr":"172.21.15.31:6837","nonce":1886584780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:25:50.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 -- 172.21.15.31:0/1675918839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90b80608e0 msgr2=0x7f90b8062d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90b80608e0 0x7f90b8062d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f90c8003080 tx=0x7f90c8017000 comp rx=0 tx=0).stop 2024-08-17T02:25:50.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 -- 172.21.15.31:0/1675918839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d806bd00 msgr2=0x7f90d80c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d806bd00 0x7f90d80c7440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f90d000cc90 tx=0x7f90d0001a20 comp rx=0 tx=0).stop 2024-08-17T02:25:50.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 -- 172.21.15.31:0/1675918839 shutdown_connections 2024-08-17T02:25:50.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90b80608e0 0x7f90b8062d90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90d8157290 0x7f90d816c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90d8156ec0 0x7f90d80ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 --2- 172.21.15.31:0/1675918839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f90d806bd00 0x7f90d80c7440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 -- 172.21.15.31:0/1675918839 >> 172.21.15.31:0/1675918839 conn(0x7f90d80cdf80 msgr2=0x7f90d80b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 -- 172.21.15.31:0/1675918839 shutdown_connections 2024-08-17T02:25:50.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:50.901+0000 7f90dce1e700 1 -- 172.21.15.31:0/1675918839 wait complete. 2024-08-17T02:25:50.905 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 14 2024-08-17T02:25:51.318 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:25:41.765672+0000', 'modified': '2024-08-17T02:25:44.420703+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5043}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5043': {'gid': 5043, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.31:6837/1886584780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6835', 'nonce': 1886584780}, {'type': 'v1', 'addr': '172.21.15.31:6837', 'nonce': 1886584780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:25:51.318 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:25:51.318 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-17T02:25:51.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.433+0000 7f9112d08700 1 Processor -- start 2024-08-17T02:25:51.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.433+0000 7f9112d08700 1 -- start start 2024-08-17T02:25:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.433+0000 7f9112d08700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f910c15d2f0 0x7f910c068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.433+0000 7f9112d08700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f910c159680 0x7f910c15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.433+0000 7f9112d08700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910c069460 con 0x7f910c15d6c0 2024-08-17T02:25:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.433+0000 7f9112d08700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910c06a2b0 con 0x7f910c15d2f0 2024-08-17T02:25:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.433+0000 7f9112d08700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910c0696a0 con 0x7f910c159680 2024-08-17T02:25:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9111d06700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f910c15d2f0 0x7f910c068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9112507700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f910c159680 0x7f910c15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9111d06700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f910c15d2f0 0x7f910c068f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60754/0 (socket says 172.21.15.31:60754) 2024-08-17T02:25:51.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9111d06700 1 -- 172.21.15.31:0/327345282 learned_addr learned my addr 172.21.15.31:0/327345282 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9111d06700 1 -- 172.21.15.31:0/327345282 >> v2:172.21.15.92:3300/0 conn(0x7f910c159680 msgr2=0x7f910c15dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9111d06700 1 --2- 172.21.15.31:0/327345282 >> v2:172.21.15.92:3300/0 conn(0x7f910c159680 0x7f910c15dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9111d06700 1 -- 172.21.15.31:0/327345282 >> v1:172.21.15.92:6789/0 conn(0x7f910c15d6c0 legacy=0x7f910c158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9111d06700 1 -- 172.21.15.31:0/327345282 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c069980 con 0x7f910c15d2f0 2024-08-17T02:25:51.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9111d06700 1 --2- 172.21.15.31:0/327345282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c15d2f0 0x7f910c068f20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f910c0cdf90 tx=0x7f9108009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6436e06b8cb5909d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9110d04700 1 -- 172.21.15.31:0/327345282 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108009e70 con 0x7f910c15d2f0 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9110d04700 1 -- 172.21.15.31:0/327345282 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910800b860 con 0x7f910c15d2f0 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9110d04700 1 -- 172.21.15.31:0/327345282 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910800bc00 con 0x7f910c15d2f0 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9112d08700 1 -- 172.21.15.31:0/327345282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c15d2f0 msgr2=0x7f910c068f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9112d08700 1 --2- 172.21.15.31:0/327345282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c15d2f0 0x7f910c068f20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f910c0cdf90 tx=0x7f9108009250 comp rx=0 tx=0).stop 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9112d08700 1 -- 172.21.15.31:0/327345282 shutdown_connections 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9112d08700 1 --2- 172.21.15.31:0/327345282 >> v2:172.21.15.92:3300/0 conn(0x7f910c159680 0x7f910c15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9112d08700 1 --2- 172.21.15.31:0/327345282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c15d2f0 0x7f910c068f20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9112d08700 1 -- 172.21.15.31:0/327345282 >> 172.21.15.31:0/327345282 conn(0x7f910c0cdfc0 msgr2=0x7f910c0ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9112d08700 1 -- 172.21.15.31:0/327345282 shutdown_connections 2024-08-17T02:25:51.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.437+0000 7f9112d08700 1 -- 172.21.15.31:0/327345282 wait complete. 2024-08-17T02:25:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112d08700 1 Processor -- start 2024-08-17T02:25:51.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112d08700 1 -- start start 2024-08-17T02:25:51.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112d08700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c159680 0x7f910c152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112d08700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f910c15d2f0 0x7f910c14ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112d08700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f910c15d6c0 0x7f910c0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112d08700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c14d6d0 con 0x7f910c159680 2024-08-17T02:25:51.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112d08700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c1513b0 con 0x7f910c15d6c0 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112d08700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c151690 con 0x7f910c15d2f0 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9111d06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c159680 0x7f910c152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9111d06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c159680 0x7f910c152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60766/0 (socket says 172.21.15.31:60766) 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9111d06700 1 -- 172.21.15.31:0/3165790577 learned_addr learned my addr 172.21.15.31:0/3165790577 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9111505700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f910c15d2f0 0x7f910c14ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112507700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f910c15d6c0 0x7f910c0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9111d06700 1 -- 172.21.15.31:0/3165790577 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f910c15d2f0 msgr2=0x7f910c14ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9111d06700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f910c15d2f0 0x7f910c14ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9111d06700 1 -- 172.21.15.31:0/3165790577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f910c15d6c0 msgr2=0x7f910c0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9111d06700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f910c15d6c0 0x7f910c0b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9111d06700 1 -- 172.21.15.31:0/3165790577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91080094f0 con 0x7f910c159680 2024-08-17T02:25:51.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9111d06700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c159680 0x7f910c152450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f910c06fb80 tx=0x7f9108017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9101ffb700 1 -- 172.21.15.31:0/3165790577 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910800bbe0 con 0x7f910c159680 2024-08-17T02:25:51.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9101ffb700 1 -- 172.21.15.31:0/3165790577 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9108011420 con 0x7f910c159680 2024-08-17T02:25:51.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112d08700 1 -- 172.21.15.31:0/3165790577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910c151970 con 0x7f910c159680 2024-08-17T02:25:51.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9101ffb700 1 -- 172.21.15.31:0/3165790577 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91080117c0 con 0x7f910c159680 2024-08-17T02:25:51.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.441+0000 7f9112d08700 1 -- 172.21.15.31:0/3165790577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910c151f30 con 0x7f910c159680 2024-08-17T02:25:51.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.445+0000 7f9101ffb700 1 -- 172.21.15.31:0/3165790577 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9108011bf0 con 0x7f910c159680 2024-08-17T02:25:51.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.445+0000 7f9101ffb700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90f0060860 0x7f90f0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.445+0000 7f9101ffb700 1 -- 172.21.15.31:0/3165790577 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f910807e410 con 0x7f910c159680 2024-08-17T02:25:51.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.445+0000 7f9111505700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90f0060860 0x7f90f0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.445+0000 7f9111505700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90f0060860 0x7f90f0062d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f910c0cdeb0 tx=0x7f90fc000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9116219740 1 Processor -- start 2024-08-17T02:25:51.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9116219740 1 -- start start 2024-08-17T02:25:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9116219740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x23d71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9116219740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21a3710 0x23d7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9116219740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21ee790 0x23dac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9116219740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x234fba0 con 0x21ee790 2024-08-17T02:25:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9116219740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x234bb40 con 0x21a3ae0 2024-08-17T02:25:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9116219740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x23110a0 con 0x21a3710 2024-08-17T02:25:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9112507700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21ee790 0x23dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9112507700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21ee790 0x23dac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60770/0 (socket says 172.21.15.31:60770) 2024-08-17T02:25:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9112507700 1 -- 172.21.15.31:0/1485112531 learned_addr learned my addr 172.21.15.31:0/1485112531 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9111d06700 1 --2- 172.21.15.31:0/1485112531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x23d71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9111505700 1 --2- 172.21.15.31:0/1485112531 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21a3710 0x23d7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9112507700 1 -- 172.21.15.31:0/1485112531 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21a3710 msgr2=0x23d7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9112507700 1 --2- 172.21.15.31:0/1485112531 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21a3710 0x23d7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9112507700 1 -- 172.21.15.31:0/1485112531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 msgr2=0x23d71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9112507700 1 --2- 172.21.15.31:0/1485112531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x23d71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9112507700 1 -- 172.21.15.31:0/1485112531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21ef9e0 con 0x21ee790 2024-08-17T02:25:51.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f9112507700 1 --2- 172.21.15.31:0/1485112531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21ee790 0x23dac60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9104007610 tx=0x7f910400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd32a5089b1a1edd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f90f6ffd700 1 -- 172.21.15.31:0/1485112531 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910400e030 con 0x21ee790 2024-08-17T02:25:51.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f90f6ffd700 1 -- 172.21.15.31:0/1485112531 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91040153f0 con 0x21ee790 2024-08-17T02:25:51.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.449+0000 7f90f6ffd700 1 -- 172.21.15.31:0/1485112531 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9104015770 con 0x21ee790 2024-08-17T02:25:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 -- 172.21.15.31:0/1485112531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21ee790 msgr2=0x23dac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 --2- 172.21.15.31:0/1485112531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21ee790 0x23dac60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9104007610 tx=0x7f910400b040 comp rx=0 tx=0).stop 2024-08-17T02:25:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 -- 172.21.15.31:0/1485112531 shutdown_connections 2024-08-17T02:25:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 --2- 172.21.15.31:0/1485112531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21ee790 0x23dac60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 --2- 172.21.15.31:0/1485112531 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21a3710 0x23d7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 --2- 172.21.15.31:0/1485112531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x23d71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 -- 172.21.15.31:0/1485112531 >> 172.21.15.31:0/1485112531 conn(0x21a3eb0 msgr2=0x23dd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 -- 172.21.15.31:0/1485112531 shutdown_connections 2024-08-17T02:25:51.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 -- 172.21.15.31:0/1485112531 wait complete. 2024-08-17T02:25:51.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 -- start start 2024-08-17T02:25:51.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 Processor -- start 2024-08-17T02:25:51.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x2424aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x2424fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x23defd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x2310d40 con 0x21a3710 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x22e9970 con 0x21a3ae0 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x231c690 con 0x21ee790 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9116219740 10 client.0 _ll_register_callbacks cb 0x22edf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9111d06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x2424aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9111d06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x2424aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60786/0 (socket says 172.21.15.31:60786) 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9111d06700 1 -- 172.21.15.31:0/2465432431 learned_addr learned my addr 172.21.15.31:0/2465432431 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9111505700 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x2424fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.453+0000 7f9112507700 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x23defd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9111d06700 1 -- 172.21.15.31:0/2465432431 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 msgr2=0x23defd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9111d06700 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x23defd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9111d06700 1 -- 172.21.15.31:0/2465432431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 msgr2=0x2424fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9111d06700 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x2424fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9111d06700 1 -- 172.21.15.31:0/2465432431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9104007340 con 0x21a3710 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9112507700 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x23defd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9111505700 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x2424fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9111d06700 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x2424aa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f910800b3c0 tx=0x7f910807e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6827dca1816e1e44 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f90ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f90ebfff700 1 -- 172.21.15.31:0/2465432431 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108011ea0 con 0x21a3710 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f90ebfff700 1 -- 172.21.15.31:0/2465432431 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9108059500 con 0x21a3710 2024-08-17T02:25:51.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9116219740 1 -- 172.21.15.31:0/2465432431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21b1260 con 0x21a3710 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f90ebfff700 1 -- 172.21.15.31:0/2465432431 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91080527c0 con 0x21a3710 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9116219740 10 client.5253 fetch_fsmap learned FSMap version 14 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9116219740 1 -- 172.21.15.31:0/2465432431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x2319370 con 0x21a3710 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f90ebfff700 1 -- 172.21.15.31:0/2465432431 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21b1260 con 0x21a3710 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f90ebfff700 1 -- 172.21.15.31:0/2465432431 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9108051a10 con 0x21a3710 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9116219740 10 client.5253 fetch_fsmap finished waiting for FSMap version 14 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9116219740 10 client.5253 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9116219740 20 client.5253 populate_metadata read hostname 'smithi031' 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9116219740 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.31:6835/1886584780,v1:172.21.15.31:6837/1886584780] conn(0x242dc30 0x2430010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9116219740 4 client.5253 mds_command: new command op to 5043 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:25:51.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9116219740 1 -- 172.21.15.31:0/2465432431 --> [v2:172.21.15.31:6835/1886584780,v1:172.21.15.31:6837/1886584780] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x21fb4e0 con 0x242dc30 2024-08-17T02:25:51.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9111505700 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.31:6835/1886584780,v1:172.21.15.31:6837/1886584780] conn(0x242dc30 0x2430010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f90ebfff700 10 client.5253 ms_handle_connect on v2:172.21.15.31:6835/1886584780 2024-08-17T02:25:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9111505700 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.31:6835/1886584780,v1:172.21.15.31:6837/1886584780] conn(0x242dc30 0x2430010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d645bd43a0056ab server_cookie=d2b2bb0d5d656304 in_seq=0 out_seq=0 2024-08-17T02:25:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f90ebfff700 1 -- 172.21.15.31:0/2465432431 <== mds.0 v2:172.21.15.31:6835/1886584780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x21fb4e0 con 0x242dc30 2024-08-17T02:25:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f90ebfff700 10 client.5253 handle_command_reply: tid=0 2024-08-17T02:25:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.457+0000 7f9116219740 1 client.5253 shutdown 2024-08-17T02:25:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 1 -- 172.21.15.31:0/2465432431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 msgr2=0x2424aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x2424aa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f910800b3c0 tx=0x7f910807e040 comp rx=0 tx=0).stop 2024-08-17T02:25:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 1 -- 172.21.15.31:0/2465432431 shutdown_connections 2024-08-17T02:25:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x23defd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x2424fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.31:6835/1886584780,v1:172.21.15.31:6837/1886584780] conn(0x242dc30 0x2430010 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 1 --2- 172.21.15.31:0/2465432431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x2424aa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f90ebfff700 0 client.5253 ms_handle_reset on v2:172.21.15.31:6835/1886584780 2024-08-17T02:25:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 1 -- 172.21.15.31:0/2465432431 >> 172.21.15.31:0/2465432431 conn(0x21a3eb0 msgr2=0x23dcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 1 -- 172.21.15.31:0/2465432431 shutdown_connections 2024-08-17T02:25:51.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 1 -- 172.21.15.31:0/2465432431 wait complete. 2024-08-17T02:25:51.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.461+0000 7f9116219740 20 client.5253 trim_cache size 0 max 16384 2024-08-17T02:25:51.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9116219740 1 Processor -- start 2024-08-17T02:25:51.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9116219740 1 -- start start 2024-08-17T02:25:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9116219740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23d70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9116219740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x23d7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9116219740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x23dac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9116219740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x2220650 con 0x21a3710 2024-08-17T02:25:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9116219740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x221c7c0 con 0x21a3ae0 2024-08-17T02:25:51.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9116219740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x2349500 con 0x21ee790 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9111d06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23d70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9111d06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23d70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60802/0 (socket says 172.21.15.31:60802) 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9111d06700 1 -- 172.21.15.31:0/234125238 learned_addr learned my addr 172.21.15.31:0/234125238 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9111505700 1 --2- 172.21.15.31:0/234125238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x23d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9112507700 1 --2- 172.21.15.31:0/234125238 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x23dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9111d06700 1 -- 172.21.15.31:0/234125238 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 msgr2=0x23dac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9111d06700 1 --2- 172.21.15.31:0/234125238 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x23dac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9111d06700 1 -- 172.21.15.31:0/234125238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 msgr2=0x23d7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9111d06700 1 --2- 172.21.15.31:0/234125238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x23d7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9111d06700 1 -- 172.21.15.31:0/234125238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x22ffd80 con 0x21a3710 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9112507700 1 --2- 172.21.15.31:0/234125238 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x23dac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.477+0000 7f9111d06700 1 --2- 172.21.15.31:0/234125238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23d70d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9108006fd0 tx=0x7f9108027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ae5444c585bbea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f90f77fe700 1 -- 172.21.15.31:0/234125238 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910807b070 con 0x21a3710 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f90f77fe700 1 -- 172.21.15.31:0/234125238 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9108059500 con 0x21a3710 2024-08-17T02:25:51.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f90f77fe700 1 -- 172.21.15.31:0/234125238 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108011ea0 con 0x21a3710 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 -- 172.21.15.31:0/234125238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 msgr2=0x23d70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 --2- 172.21.15.31:0/234125238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23d70d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9108006fd0 tx=0x7f9108027000 comp rx=0 tx=0).stop 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 -- 172.21.15.31:0/234125238 shutdown_connections 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 --2- 172.21.15.31:0/234125238 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x23dac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 --2- 172.21.15.31:0/234125238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x23d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 --2- 172.21.15.31:0/234125238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23d70d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 -- 172.21.15.31:0/234125238 >> 172.21.15.31:0/234125238 conn(0x21a3eb0 msgr2=0x2423e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 -- 172.21.15.31:0/234125238 shutdown_connections 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 -- 172.21.15.31:0/234125238 wait complete. 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 -- start start 2024-08-17T02:25:51.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 Processor -- start 2024-08-17T02:25:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23dbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x247c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x247c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x2381bb0 con 0x21a3710 2024-08-17T02:25:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x2323570 con 0x21a3ae0 2024-08-17T02:25:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x231b820 con 0x21ee790 2024-08-17T02:25:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9116219740 10 client.0 _ll_register_callbacks cb 0x216f9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:25:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9111d06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23dbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9111d06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23dbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60816/0 (socket says 172.21.15.31:60816) 2024-08-17T02:25:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9111d06700 1 -- 172.21.15.31:0/2967324600 learned_addr learned my addr 172.21.15.31:0/2967324600 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9112507700 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x247c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9111505700 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x247c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9111d06700 1 -- 172.21.15.31:0/2967324600 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 msgr2=0x247c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9111d06700 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x247c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9111d06700 1 -- 172.21.15.31:0/2967324600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 msgr2=0x247c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9111d06700 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x247c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9111d06700 1 -- 172.21.15.31:0/2967324600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9108067030 con 0x21a3710 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f9111d06700 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23dbf70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9108009290 tx=0x7f9108057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bae833acdd893a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.481+0000 7f90ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f90ebfff700 1 -- 172.21.15.31:0/2967324600 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108070070 con 0x21a3710 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 -- 172.21.15.31:0/2967324600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91040153f0 con 0x21a3710 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f90ebfff700 1 -- 172.21.15.31:0/2967324600 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91080557b0 con 0x21a3710 2024-08-17T02:25:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f90ebfff700 1 -- 172.21.15.31:0/2967324600 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f910807b050 con 0x21a3710 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 10 client.5259 fetch_fsmap learned FSMap version 14 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 -- 172.21.15.31:0/2967324600 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x22f4130 con 0x21a3710 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f90ebfff700 1 -- 172.21.15.31:0/2967324600 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910805d080 con 0x21a3710 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f90ebfff700 1 -- 172.21.15.31:0/2967324600 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9108073020 con 0x21a3710 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 10 client.5259 fetch_fsmap finished waiting for FSMap version 14 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 10 client.5259 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 20 client.5259 populate_metadata read hostname 'smithi031' 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.31:6835/1886584780,v1:172.21.15.31:6837/1886584780] conn(0x247cdb0 0x2430fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 4 client.5259 mds_command: new command op to 5043 tid=0[{"prefix": "status"}] 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 -- 172.21.15.31:0/2967324600 --> [v2:172.21.15.31:6835/1886584780,v1:172.21.15.31:6837/1886584780] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2220260 con 0x247cdb0 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9111505700 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.31:6835/1886584780,v1:172.21.15.31:6837/1886584780] conn(0x247cdb0 0x2430fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f90ebfff700 10 client.5259 ms_handle_connect on v2:172.21.15.31:6835/1886584780 2024-08-17T02:25:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9111505700 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.31:6835/1886584780,v1:172.21.15.31:6837/1886584780] conn(0x247cdb0 0x2430fe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84ee6b43edd1218e server_cookie=2b4882c39de086b5 in_seq=0 out_seq=0 2024-08-17T02:25:51.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f90ebfff700 1 -- 172.21.15.31:0/2967324600 <== mds.0 v2:172.21.15.31:6835/1886584780 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x2220260 con 0x247cdb0 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f90ebfff700 10 client.5259 handle_command_reply: tid=0 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 client.5259 shutdown 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 -- 172.21.15.31:0/2967324600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 msgr2=0x23dbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23dbf70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9108009290 tx=0x7f9108057000 comp rx=0 tx=0).stop 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 -- 172.21.15.31:0/2967324600 shutdown_connections 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x21ee790 0x247c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x21a3ae0 0x247c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.31:6835/1886584780,v1:172.21.15.31:6837/1886584780] conn(0x247cdb0 0x2430fe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f90ebfff700 0 client.5259 ms_handle_reset on v2:172.21.15.31:6835/1886584780 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 --2- 172.21.15.31:0/2967324600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x21a3710 0x23dbf70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 -- 172.21.15.31:0/2967324600 >> 172.21.15.31:0/2967324600 conn(0x21a3eb0 msgr2=0x23d5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 -- 172.21.15.31:0/2967324600 shutdown_connections 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 1 -- 172.21.15.31:0/2967324600 wait complete. 2024-08-17T02:25:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.485+0000 7f9116219740 20 client.5259 trim_cache size 0 max 16384 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "bf850b64-aabe-4059-850b-2b80766a6162", 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5043, 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 9.0766252850000004, 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 14, 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 36, 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 36, 2024-08-17T02:25:51.493 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 23.142526632999999 2024-08-17T02:25:51.494 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:25:51.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 -- 172.21.15.31:0/3165790577 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90f0060860 msgr2=0x7f90f0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90f0060860 0x7f90f0062d10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f910c0cdeb0 tx=0x7f90fc000bc0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 -- 172.21.15.31:0/3165790577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c159680 msgr2=0x7f910c152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c159680 0x7f910c152450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f910c06fb80 tx=0x7f9108017000 comp rx=0 tx=0).stop 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 -- 172.21.15.31:0/3165790577 shutdown_connections 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f90f0060860 0x7f90f0062d10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f910c15d6c0 0x7f910c0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f910c15d2f0 0x7f910c14ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 --2- 172.21.15.31:0/3165790577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f910c159680 0x7f910c152450 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 -- 172.21.15.31:0/3165790577 >> 172.21.15.31:0/3165790577 conn(0x7f910c0cdfc0 msgr2=0x7f910c06b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 -- 172.21.15.31:0/3165790577 shutdown_connections 2024-08-17T02:25:51.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.489+0000 7f9112d08700 1 -- 172.21.15.31:0/3165790577 wait complete. 2024-08-17T02:25:51.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:51.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.613+0000 7fa791419700 1 Processor -- start 2024-08-17T02:25:51.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.613+0000 7fa791419700 1 -- start start 2024-08-17T02:25:51.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c155d60 0x7fa78c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa78c0cc150 0x7fa78c068510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c0adf70 con 0x7fa78c156130 2024-08-17T02:25:51.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c0ad360 con 0x7fa78c0cc150 2024-08-17T02:25:51.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c0ad640 con 0x7fa78c155d60 2024-08-17T02:25:51.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78a7fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa78c0cc150 0x7fa78c068510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78affd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c155d60 0x7fa78c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78a7fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa78c0cc150 0x7fa78c068510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:59270/0 (socket says 172.21.15.31:59270) 2024-08-17T02:25:51.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa78c156130 0x7fa78c06e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:43788/0 (socket says 172.21.15.31:43788) 2024-08-17T02:25:51.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78a7fc700 1 -- 172.21.15.31:0/976083048 learned_addr learned my addr 172.21.15.31:0/976083048 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:51.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa789ffb700 1 -- 172.21.15.31:0/976083048 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266061253 0 0) 0x7fa78c0adf70 con 0x7fa78c156130 2024-08-17T02:25:51.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa789ffb700 1 -- 172.21.15.31:0/976083048 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa774003570 con 0x7fa78c156130 2024-08-17T02:25:51.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78affd700 1 -- 172.21.15.31:0/976083048 >> v2:172.21.15.92:3300/0 conn(0x7fa78c0cc150 msgr2=0x7fa78c068510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78affd700 1 --2- 172.21.15.31:0/976083048 >> v2:172.21.15.92:3300/0 conn(0x7fa78c0cc150 0x7fa78c068510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78affd700 1 -- 172.21.15.31:0/976083048 >> v1:172.21.15.92:6789/0 conn(0x7fa78c156130 legacy=0x7fa78c06e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78affd700 1 -- 172.21.15.31:0/976083048 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c0ad920 con 0x7fa78c155d60 2024-08-17T02:25:51.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78a7fc700 1 --2- 172.21.15.31:0/976083048 >> v2:172.21.15.92:3300/0 conn(0x7fa78c0cc150 0x7fa78c068510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:51.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa78affd700 1 --2- 172.21.15.31:0/976083048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c155d60 0x7fa78c0cbc10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0098e0 tx=0x7fa77c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98569eebdc5f1c06 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa789ffb700 1 -- 172.21.15.31:0/976083048 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c011630 con 0x7fa78c155d60 2024-08-17T02:25:51.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa789ffb700 1 -- 172.21.15.31:0/976083048 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c011790 con 0x7fa78c155d60 2024-08-17T02:25:51.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa789ffb700 1 -- 172.21.15.31:0/976083048 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c011b30 con 0x7fa78c155d60 2024-08-17T02:25:51.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 -- 172.21.15.31:0/976083048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c155d60 msgr2=0x7fa78c0cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 --2- 172.21.15.31:0/976083048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c155d60 0x7fa78c0cbc10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0098e0 tx=0x7fa77c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 -- 172.21.15.31:0/976083048 shutdown_connections 2024-08-17T02:25:51.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 --2- 172.21.15.31:0/976083048 >> v2:172.21.15.92:3300/0 conn(0x7fa78c0cc150 0x7fa78c068510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 --2- 172.21.15.31:0/976083048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c155d60 0x7fa78c0cbc10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.617+0000 7fa791419700 1 -- 172.21.15.31:0/976083048 >> 172.21.15.31:0/976083048 conn(0x7fa78c06a280 msgr2=0x7fa78c06a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa791419700 1 -- 172.21.15.31:0/976083048 shutdown_connections 2024-08-17T02:25:51.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa791419700 1 -- 172.21.15.31:0/976083048 wait complete. 2024-08-17T02:25:51.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa791419700 1 Processor -- start 2024-08-17T02:25:51.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa791419700 1 -- start start 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa791419700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa78c0cc150 0x7fa78c0c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa791419700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa78c155d60 0x7fa78c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa791419700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c156130 0x7fa78c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa791419700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c0a9ca0 con 0x7fa78c0cc150 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa791419700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c159530 con 0x7fa78c155d60 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa791419700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c16a750 con 0x7fa78c156130 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.621+0000 7fa78affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa78c0cc150 0x7fa78c0c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa78c0cc150 0x7fa78c0c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60830/0 (socket says 172.21.15.31:60830) 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78affd700 1 -- 172.21.15.31:0/943858054 learned_addr learned my addr 172.21.15.31:0/943858054 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78a7fc700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa78c155d60 0x7fa78c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78b7fe700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c156130 0x7fa78c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78affd700 1 -- 172.21.15.31:0/943858054 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c156130 msgr2=0x7fa78c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78affd700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c156130 0x7fa78c153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78affd700 1 -- 172.21.15.31:0/943858054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa78c155d60 msgr2=0x7fa78c150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78affd700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa78c155d60 0x7fa78c150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78affd700 1 -- 172.21.15.31:0/943858054 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7800094f0 con 0x7fa78c0cc150 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78affd700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa78c0cc150 0x7fa78c0c96f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0ad780 tx=0x7fa77c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa772ffd700 1 -- 172.21.15.31:0/943858054 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c011b10 con 0x7fa78c0cc150 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa772ffd700 1 -- 172.21.15.31:0/943858054 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c0233f0 con 0x7fa78c0cc150 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa791419700 1 -- 172.21.15.31:0/943858054 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c009420 con 0x7fa78c0cc150 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa772ffd700 1 -- 172.21.15.31:0/943858054 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c023770 con 0x7fa78c0cc150 2024-08-17T02:25:51.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa791419700 1 -- 172.21.15.31:0/943858054 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c151580 con 0x7fa78c0cc150 2024-08-17T02:25:51.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa791419700 1 -- 172.21.15.31:0/943858054 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c0712b0 con 0x7fa78c0cc150 2024-08-17T02:25:51.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa772ffd700 1 -- 172.21.15.31:0/943858054 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa77c02c3b0 con 0x7fa78c0cc150 2024-08-17T02:25:51.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa772ffd700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa778060860 0x7fa778062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa78a7fc700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa778060860 0x7fa778062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.625+0000 7fa772ffd700 1 -- 172.21.15.31:0/943858054 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa77c07e080 con 0x7fa78c0cc150 2024-08-17T02:25:51.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.629+0000 7fa78a7fc700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa778060860 0x7fa778062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa78c158100 tx=0x7fa780008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.633+0000 7fa772ffd700 1 -- 172.21.15.31:0/943858054 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa77c04e550 con 0x7fa78c0cc150 2024-08-17T02:25:51.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.841+0000 7fa791419700 1 -- 172.21.15.31:0/943858054 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa78c1540b0 con 0x7fa78c0cc150 2024-08-17T02:25:51.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.841+0000 7fa772ffd700 1 -- 172.21.15.31:0/943858054 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa77c051b70 con 0x7fa78c0cc150 2024-08-17T02:25:51.845 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:51.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 -- 172.21.15.31:0/943858054 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa778060860 msgr2=0x7fa778062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa778060860 0x7fa778062d10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa78c158100 tx=0x7fa780008040 comp rx=0 tx=0).stop 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 -- 172.21.15.31:0/943858054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa78c0cc150 msgr2=0x7fa78c0c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa78c0cc150 0x7fa78c0c96f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0ad780 tx=0x7fa77c017000 comp rx=0 tx=0).stop 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 -- 172.21.15.31:0/943858054 shutdown_connections 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa778060860 0x7fa778062d10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa78c156130 0x7fa78c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa78c155d60 0x7fa78c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 --2- 172.21.15.31:0/943858054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa78c0cc150 0x7fa78c0c96f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 -- 172.21.15.31:0/943858054 >> 172.21.15.31:0/943858054 conn(0x7fa78c06a280 msgr2=0x7fa78c0ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 -- 172.21.15.31:0/943858054 shutdown_connections 2024-08-17T02:25:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:51.845+0000 7fa791419700 1 -- 172.21.15.31:0/943858054 wait complete. 2024-08-17T02:25:51.859 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:25:51.859 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:51.859 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-08-17T02:25:51.859 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:25:51.859 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:51.859 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:25:51.859 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:25:51.859 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:51.859 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:25:51.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:51.860 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-08-17T02:25:51.867 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-08-17T02:25:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42532sec preferred_lft 42532sec 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:67:ac:62:cf brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:82:9c:7d:d0:39 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::20c5:b8ff:fe41:bbbe/64 scope link 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:51.869 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether de:09:5f:e3:10:8f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:25:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::dc09:5fff:fee3:108f/64 scope link 2024-08-17T02:25:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:51.870 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:82:9c:7d:d0:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:25:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c82:9cff:fe7d:d039/64 scope link 2024-08-17T02:25:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:51.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:51.870 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:51.884 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-08-17T02:25:51.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:51.885 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-08-17T02:25:51.938 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-08-17T02:25:51.938 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:51.938 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-08-17T02:25:51.938 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:25:51.938 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-08-17T02:25:51.938 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:51.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:51.939 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec bash -c ' 2024-08-17T02:25:51.939 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-08-17T02:25:51.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:25:51.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:25:51.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:25:51.939 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-08-17T02:25:51.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:51.976 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-08-17T02:25:51.983 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:25:51.983 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:25:51.983 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:25:51.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:51.983 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-08-17T02:25:52.042 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-17T02:25:52.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:52.042 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:52.047 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:25:52.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:52.047 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:52.052 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-08-17T02:25:52.114 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:52.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:52.125 INFO:teuthology.orchestra.run.smithi031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:52.126 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:52.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:52.127 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-08-17T02:25:52.132 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:25:52.132 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-17T02:25:52.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-08-17T02:25:52.192 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:52.192 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:52.204 INFO:teuthology.orchestra.run.smithi031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:52.206 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:52.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:52.206 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-08-17T02:25:52.260 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:2024-08-17T02:25:52.257+0000 7f140913e380 -1 init, newargv = 0x557dee45e900 newargc=15 2024-08-17T02:25:52.260 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[34056]: starting ceph client 2024-08-17T02:25:52.270 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[34056]: starting fuse 2024-08-17T02:25:53.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-08-17T02:25:53.332 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:53.333 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:53.387 INFO:teuthology.orchestra.run.smithi031.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:53.388 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:53.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:53.388 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-08-17T02:25:53.393 INFO:teuthology.orchestra.run.smithi031.stdout:52 2024-08-17T02:25:53.393 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:25:53.393 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:25:53.393 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> import re 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2024-08-17T02:25:53.394 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> return f 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.0")) 2024-08-17T02:25:53.395 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-08-17T02:25:53.478 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.0.34056.asok 2024-08-17T02:25:53.661 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34056.asok 2024-08-17T02:25:53.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:53.662 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34056.asok status 2024-08-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2024-08-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "0", 2024-08-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2024-08-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-17T02:25:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "34056", 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5268, 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 5268 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-08-17T02:25:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1804711717 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1804711717 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.5268 192.168.0.1:0/1804711717", 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/1804711717", 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 14, 2024-08-17T02:25:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 36, 2024-08-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2024-08-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2024-08-17T02:25:53.764 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:25:53.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:53.771 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2024-08-17T02:25:53.771 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:53.776 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2024-08-17T02:25:53.777 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:53.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:53.777 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:53.793 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.897+0000 7f4b0edfe700 1 Processor -- start 2024-08-17T02:25:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.897+0000 7f4b0edfe700 1 -- start start 2024-08-17T02:25:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.897+0000 7f4b0edfe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b080b22e0 0x7f4b080b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.897+0000 7f4b0edfe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4b08068e60 0x7f4b0815c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.897+0000 7f4b0edfe700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0809dbe0 con 0x7f4b08068a10 2024-08-17T02:25:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.897+0000 7f4b0edfe700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b080b0010 con 0x7f4b08068e60 2024-08-17T02:25:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.897+0000 7f4b0edfe700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080b01f0 con 0x7f4b080b22e0 2024-08-17T02:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0ddfc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b080b22e0 0x7f4b080b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0e5fd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4b08068e60 0x7f4b0815c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0d5fb700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4b08068a10 0x7f4b0809d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:43800/0 (socket says 172.21.15.31:43800) 2024-08-17T02:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0d5fb700 1 -- 172.21.15.31:0/3515648964 learned_addr learned my addr 172.21.15.31:0/3515648964 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0cdfa700 1 -- 172.21.15.31:0/3515648964 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907658107 0 0) 0x7f4b0809dbe0 con 0x7f4b08068a10 2024-08-17T02:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0cdfa700 1 -- 172.21.15.31:0/3515648964 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4af4003570 con 0x7f4b08068a10 2024-08-17T02:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0e5fd700 1 -- 172.21.15.31:0/3515648964 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b080b22e0 msgr2=0x7f4b080b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0e5fd700 1 --2- 172.21.15.31:0/3515648964 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b080b22e0 0x7f4b080b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0e5fd700 1 -- 172.21.15.31:0/3515648964 >> v1:172.21.15.92:6789/0 conn(0x7f4b08068a10 legacy=0x7f4b0809d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0e5fd700 1 -- 172.21.15.31:0/3515648964 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b080b04d0 con 0x7f4b08068e60 2024-08-17T02:25:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0ddfc700 1 --2- 172.21.15.31:0/3515648964 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b080b22e0 0x7f4b080b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0e5fd700 1 --2- 172.21.15.31:0/3515648964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b08068e60 0x7f4b0815c380 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009e60 tx=0x7f4b00009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4379cca054ec520f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0cdfa700 1 -- 172.21.15.31:0/3515648964 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000e070 con 0x7f4b08068e60 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0cdfa700 1 -- 172.21.15.31:0/3515648964 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0000bab0 con 0x7f4b08068e60 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0cdfa700 1 -- 172.21.15.31:0/3515648964 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000be70 con 0x7f4b08068e60 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0edfe700 1 -- 172.21.15.31:0/3515648964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b08068e60 msgr2=0x7f4b0815c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0edfe700 1 --2- 172.21.15.31:0/3515648964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b08068e60 0x7f4b0815c380 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009e60 tx=0x7f4b00009780 comp rx=0 tx=0).stop 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0edfe700 1 -- 172.21.15.31:0/3515648964 shutdown_connections 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0edfe700 1 --2- 172.21.15.31:0/3515648964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b08068e60 0x7f4b0815c380 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0edfe700 1 --2- 172.21.15.31:0/3515648964 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b080b22e0 0x7f4b080b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0edfe700 1 -- 172.21.15.31:0/3515648964 >> 172.21.15.31:0/3515648964 conn(0x7f4b08067400 msgr2=0x7f4b08067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0edfe700 1 -- 172.21.15.31:0/3515648964 shutdown_connections 2024-08-17T02:25:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.901+0000 7f4b0edfe700 1 -- 172.21.15.31:0/3515648964 wait complete. 2024-08-17T02:25:53.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0edfe700 1 Processor -- start 2024-08-17T02:25:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0edfe700 1 -- start start 2024-08-17T02:25:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0edfe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b08068a10 0x7f4b080abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0edfe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b08068e60 0x7f4b081558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0edfe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b080b22e0 0x7f4b08169230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0edfe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080ac880 con 0x7f4b08068a10 2024-08-17T02:25:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0edfe700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080ad6e0 con 0x7f4b080b22e0 2024-08-17T02:25:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0edfe700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080acad0 con 0x7f4b08068e60 2024-08-17T02:25:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0ddfc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b08068a10 0x7f4b080abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0ddfc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b08068a10 0x7f4b080abbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60838/0 (socket says 172.21.15.31:60838) 2024-08-17T02:25:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0ddfc700 1 -- 172.21.15.31:0/4034300401 learned_addr learned my addr 172.21.15.31:0/4034300401 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0d5fb700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b08068e60 0x7f4b081558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0e5fd700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b080b22e0 0x7f4b08169230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0ddfc700 1 -- 172.21.15.31:0/4034300401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b08068e60 msgr2=0x7f4b081558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0ddfc700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b08068e60 0x7f4b081558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0ddfc700 1 -- 172.21.15.31:0/4034300401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b080b22e0 msgr2=0x7f4b08169230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0ddfc700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b080b22e0 0x7f4b08169230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0ddfc700 1 -- 172.21.15.31:0/4034300401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af8009420 con 0x7f4b08068a10 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4b0ddfc700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b08068a10 0x7f4b080abbf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4af800ecb0 tx=0x7f4af80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4afdffb700 1 -- 172.21.15.31:0/4034300401 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af800c850 con 0x7f4b08068a10 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4afdffb700 1 -- 172.21.15.31:0/4034300401 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af800c9b0 con 0x7f4b08068a10 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.905+0000 7f4afdffb700 1 -- 172.21.15.31:0/4034300401 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af800cd30 con 0x7f4b08068a10 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.909+0000 7f4b0edfe700 1 -- 172.21.15.31:0/4034300401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b00009a20 con 0x7f4b08068a10 2024-08-17T02:25:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.909+0000 7f4b0edfe700 1 -- 172.21.15.31:0/4034300401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b080ad090 con 0x7f4b08068a10 2024-08-17T02:25:53.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.909+0000 7f4b0edfe700 1 -- 172.21.15.31:0/4034300401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b080712b0 con 0x7f4b08068a10 2024-08-17T02:25:53.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.909+0000 7f4afdffb700 1 -- 172.21.15.31:0/4034300401 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4af8013680 con 0x7f4b08068a10 2024-08-17T02:25:53.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.909+0000 7f4afdffb700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4aec060890 0x7f4aec062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.909+0000 7f4afdffb700 1 -- 172.21.15.31:0/4034300401 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4af807ce00 con 0x7f4b08068a10 2024-08-17T02:25:53.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.909+0000 7f4b0d5fb700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4aec060890 0x7f4aec062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.913+0000 7f4b0d5fb700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4aec060890 0x7f4aec062d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4b080cc9d0 tx=0x7f4b04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:53.917+0000 7f4afdffb700 1 -- 172.21.15.31:0/4034300401 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4af8050ce0 con 0x7f4b08068a10 2024-08-17T02:25:54.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.121+0000 7f4b0edfe700 1 -- 172.21.15.31:0/4034300401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4b080b2750 con 0x7f4b08068a10 2024-08-17T02:25:54.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.121+0000 7f4afdffb700 1 -- 172.21.15.31:0/4034300401 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4af8050870 con 0x7f4b08068a10 2024-08-17T02:25:54.124 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 -- 172.21.15.31:0/4034300401 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4aec060890 msgr2=0x7f4aec062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4aec060890 0x7f4aec062d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4b080cc9d0 tx=0x7f4b04009040 comp rx=0 tx=0).stop 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 -- 172.21.15.31:0/4034300401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b08068a10 msgr2=0x7f4b080abbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b08068a10 0x7f4b080abbf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4af800ecb0 tx=0x7f4af80091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 -- 172.21.15.31:0/4034300401 shutdown_connections 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4aec060890 0x7f4aec062d40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b080b22e0 0x7f4b08169230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b08068e60 0x7f4b081558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 --2- 172.21.15.31:0/4034300401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b08068a10 0x7f4b080abbf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 -- 172.21.15.31:0/4034300401 >> 172.21.15.31:0/4034300401 conn(0x7f4b08067400 msgr2=0x7f4b080b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:54.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 -- 172.21.15.31:0/4034300401 shutdown_connections 2024-08-17T02:25:54.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:54.125+0000 7f4b0edfe700 1 -- 172.21.15.31:0/4034300401 wait complete. 2024-08-17T02:25:54.139 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:25:54.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:54.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-08-17T02:25:54.139 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:25:54.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:54.139 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:25:54.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:25:54.140 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:54.140 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:25:54.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:54.140 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:54.149 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42539sec preferred_lft 42539sec 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 02:42:e1:2f:ab:e8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi092.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:54.151 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 7e:8b:da:9f:00:08 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:54.151 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:25:54.151 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:54.151 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::b4c3:daff:fecb:893f/64 scope link 2024-08-17T02:25:54.151 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:54.151 INFO:teuthology.orchestra.run.smithi092.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:54.151 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 9e:59:18:0c:b6:de brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:25:54.151 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::9c59:18ff:fe0c:b6de/64 scope link 2024-08-17T02:25:54.152 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:54.152 INFO:teuthology.orchestra.run.smithi092.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:54.152 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 7e:8b:da:9f:00:08 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:25:54.152 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::7c8b:daff:fe9f:8/64 scope link 2024-08-17T02:25:54.152 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:54.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:54.152 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:54.167 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-08-17T02:25:54.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:54.168 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-08-17T02:25:54.174 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-08-17T02:25:54.174 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:54.174 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-08-17T02:25:54.175 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:25:54.175 INFO:teuthology.orchestra.run.smithi092.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-08-17T02:25:54.175 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-08-17T02:25:54.175 INFO:teuthology.orchestra.run.smithi092.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-08-17T02:25:54.175 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:54.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:54.175 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2024-08-17T02:25:54.175 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-08-17T02:25:54.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:25:54.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:25:54.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:25:54.175 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-08-17T02:25:54.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:54.215 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-08-17T02:25:54.222 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:25:54.222 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:25:54.222 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:25:54.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:54.223 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-08-17T02:25:54.236 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-17T02:25:54.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:54.236 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:54.286 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:25:54.287 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:54.287 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:54.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-08-17T02:25:54.309 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:54.309 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:54.367 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:54.367 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:54.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:54.368 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-08-17T02:25:54.376 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-17T02:25:54.376 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-17T02:25:54.378 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-08-17T02:25:54.390 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:54.390 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:54.447 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:54.448 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:54.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:54.449 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-08-17T02:25:54.459 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi092.stderr:2024-08-17T02:25:54.457+0000 7f60782c7380 -1 init, newargv = 0x559a78b66780 newargc=15 2024-08-17T02:25:54.459 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi092.stderr:ceph-fuse[30344]: starting ceph client 2024-08-17T02:25:54.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi092.stderr:ceph-fuse[30344]: starting fuse 2024-08-17T02:25:55.555 DEBUG:teuthology.orchestra.run.smithi092:> sudo modprobe fuse 2024-08-17T02:25:55.572 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-08-17T02:25:55.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-08-17T02:25:55.628 INFO:teuthology.orchestra.run.smithi092.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-08-17T02:25:55.629 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-08-17T02:25:55.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:55.630 DEBUG:teuthology.orchestra.run.smithi092:> ls /sys/fs/fuse/connections 2024-08-17T02:25:55.635 INFO:teuthology.orchestra.run.smithi092.stdout:52 2024-08-17T02:25:55.635 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-08-17T02:25:55.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-08-17T02:25:55.635 DEBUG:teuthology.orchestra.run.smithi092:> import glob 2024-08-17T02:25:55.635 DEBUG:teuthology.orchestra.run.smithi092:> import re 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> import os 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> import subprocess 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> def _find_admin_socket(client_name): 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> files = glob.glob(asok_path) 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> # Given a non-glob path, it better be there 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> if "*" not in asok_path: 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> assert(len(files) == 1) 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> return files[0] 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> for f in files: 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-17T02:25:55.636 DEBUG:teuthology.orchestra.run.smithi092:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-17T02:25:55.637 DEBUG:teuthology.orchestra.run.smithi092:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-17T02:25:55.637 DEBUG:teuthology.orchestra.run.smithi092:> contents = proc_f.read() 2024-08-17T02:25:55.637 DEBUG:teuthology.orchestra.run.smithi092:> if mountpoint in contents: 2024-08-17T02:25:55.637 DEBUG:teuthology.orchestra.run.smithi092:> return f 2024-08-17T02:25:55.637 DEBUG:teuthology.orchestra.run.smithi092:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-17T02:25:55.637 DEBUG:teuthology.orchestra.run.smithi092:> 2024-08-17T02:25:55.637 DEBUG:teuthology.orchestra.run.smithi092:> print(_find_admin_socket("client.1")) 2024-08-17T02:25:55.637 DEBUG:teuthology.orchestra.run.smithi092:> ' 2024-08-17T02:25:55.716 INFO:teuthology.orchestra.run.smithi092.stdout:/var/run/ceph/ceph-client.1.30344.asok 2024-08-17T02:25:55.903 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.30344.asok 2024-08-17T02:25:55.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:55.904 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.30344.asok status 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: "metadata": { 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_sha1": "2577e8139c6b8786f9d6d6ea21b8da9244b9260e", 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 17.2.7-1375-g2577e813 (2577e8139c6b8786f9d6d6ea21b8da9244b9260e) quincy (stable)", 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: "entity_id": "1", 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": "smithi092", 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: "pid": "30344", 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: "root": "/" 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_count": 0, 2024-08-17T02:25:56.000 INFO:teuthology.orchestra.run.smithi092.stdout: "dentry_pinned_count": 0, 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 4904, 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "inst": { 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "name": { 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "client", 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "num": 4904 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2090562864 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": { 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-08-17T02:25:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "192.168.0.1:0", 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2090562864 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "inst_str": "client.4904 192.168.0.1:0/2090562864", 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "addr_str": "192.168.0.1:0/2090562864", 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "inode_count": 1, 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_epoch": 14, 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch": 36, 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_epoch_barrier": 0, 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "blocklisted": false, 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs" 2024-08-17T02:25:56.002 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-08-17T02:25:56.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:56.009 DEBUG:teuthology.orchestra.run.smithi092:> stat --file-system '--printf=%T 2024-08-17T02:25:56.009 DEBUG:teuthology.orchestra.run.smithi092:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:56.016 INFO:teuthology.orchestra.run.smithi092.stdout:fuseblk 2024-08-17T02:25:56.016 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:56.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:56.017 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:56.027 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:25:56.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.149+0000 7f4ee135c700 1 Processor -- start 2024-08-17T02:25:56.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.149+0000 7f4ee135c700 1 -- start start 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc068e70 0x7f4edc0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4edc159fd0 0x7f4edc0af290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4edc15cc00 con 0x7f4edc068aa0 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc150510 con 0x7f4edc159fd0 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc069260 con 0x7f4edc068e70 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edb7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc068e70 0x7f4edc0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edb7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc068e70 0x7f4edc0cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:47120/0 (socket says 172.21.15.31:47120) 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee0b5b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4edc159fd0 0x7f4edc0af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edb7fe700 1 -- 172.21.15.31:0/464627268 learned_addr learned my addr 172.21.15.31:0/464627268 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:56.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edb7fe700 1 -- 172.21.15.31:0/464627268 >> v2:172.21.15.92:3300/0 conn(0x7f4edc159fd0 msgr2=0x7f4edc0af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:56.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edb7fe700 1 --2- 172.21.15.31:0/464627268 >> v2:172.21.15.92:3300/0 conn(0x7f4edc159fd0 0x7f4edc0af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edb7fe700 1 -- 172.21.15.31:0/464627268 >> v1:172.21.15.92:6789/0 conn(0x7f4edc068aa0 legacy=0x7f4edc0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edb7fe700 1 -- 172.21.15.31:0/464627268 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc15ce50 con 0x7f4edc068e70 2024-08-17T02:25:56.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edb7fe700 1 --2- 172.21.15.31:0/464627268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc068e70 0x7f4edc0cb010 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0099b0 tx=0x7f4ecc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3563c7857e29e03 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edaffd700 1 -- 172.21.15.31:0/464627268 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc009ea0 con 0x7f4edc068e70 2024-08-17T02:25:56.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edaffd700 1 -- 172.21.15.31:0/464627268 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc00b860 con 0x7f4edc068e70 2024-08-17T02:25:56.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4edaffd700 1 -- 172.21.15.31:0/464627268 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc00bc00 con 0x7f4edc068e70 2024-08-17T02:25:56.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 -- 172.21.15.31:0/464627268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc068e70 msgr2=0x7f4edc0cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 --2- 172.21.15.31:0/464627268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc068e70 0x7f4edc0cb010 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0099b0 tx=0x7f4ecc009250 comp rx=0 tx=0).stop 2024-08-17T02:25:56.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 -- 172.21.15.31:0/464627268 shutdown_connections 2024-08-17T02:25:56.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 --2- 172.21.15.31:0/464627268 >> v2:172.21.15.92:3300/0 conn(0x7f4edc159fd0 0x7f4edc0af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 --2- 172.21.15.31:0/464627268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc068e70 0x7f4edc0cb010 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 -- 172.21.15.31:0/464627268 >> 172.21.15.31:0/464627268 conn(0x7f4edc0d0090 msgr2=0x7f4edc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 -- 172.21.15.31:0/464627268 shutdown_connections 2024-08-17T02:25:56.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.153+0000 7f4ee135c700 1 -- 172.21.15.31:0/464627268 wait complete. 2024-08-17T02:25:56.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4ee135c700 1 Processor -- start 2024-08-17T02:25:56.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4ee135c700 1 -- start start 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4ee135c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4edc068aa0 0x7f4edc150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4ee135c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc068e70 0x7f4edc14ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4ee135c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc159fd0 0x7f4edc0c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4ee135c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc1582f0 con 0x7f4edc068e70 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4ee135c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0c80c0 con 0x7f4edc068aa0 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4ee135c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0c74b0 con 0x7f4edc159fd0 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4edb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc068e70 0x7f4edc14ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4edb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc068e70 0x7f4edc14ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60842/0 (socket says 172.21.15.31:60842) 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4edb7fe700 1 -- 172.21.15.31:0/1583318555 learned_addr learned my addr 172.21.15.31:0/1583318555 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4ee0b5b700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc159fd0 0x7f4edc0c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.157+0000 7f4edbfff700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4edc068aa0 0x7f4edc150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4edb7fe700 1 -- 172.21.15.31:0/1583318555 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc159fd0 msgr2=0x7f4edc0c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4edb7fe700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc159fd0 0x7f4edc0c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4edb7fe700 1 -- 172.21.15.31:0/1583318555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4edc068aa0 msgr2=0x7f4edc150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4edb7fe700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4edc068aa0 0x7f4edc150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4edb7fe700 1 -- 172.21.15.31:0/1583318555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0094f0 con 0x7f4edc068e70 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4edb7fe700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc068e70 0x7f4edc14ed90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00b3c0 tx=0x7f4ecc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4ed3fff700 1 -- 172.21.15.31:0/1583318555 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc01f070 con 0x7f4edc068e70 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4ed3fff700 1 -- 172.21.15.31:0/1583318555 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc000bc0 con 0x7f4edc068e70 2024-08-17T02:25:56.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4ee135c700 1 -- 172.21.15.31:0/1583318555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc0c7790 con 0x7f4edc068e70 2024-08-17T02:25:56.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4ed3fff700 1 -- 172.21.15.31:0/1583318555 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc025420 con 0x7f4edc068e70 2024-08-17T02:25:56.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4ee135c700 1 -- 172.21.15.31:0/1583318555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc0c7d50 con 0x7f4edc068e70 2024-08-17T02:25:56.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4ee135c700 1 -- 172.21.15.31:0/1583318555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc0712b0 con 0x7f4edc068e70 2024-08-17T02:25:56.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.161+0000 7f4ed3fff700 1 -- 172.21.15.31:0/1583318555 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4ecc023070 con 0x7f4edc068e70 2024-08-17T02:25:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.165+0000 7f4ed3fff700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ebc060860 0x7f4ebc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.165+0000 7f4ed3fff700 1 -- 172.21.15.31:0/1583318555 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ecc07dea0 con 0x7f4edc068e70 2024-08-17T02:25:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.165+0000 7f4edbfff700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ebc060860 0x7f4ebc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.165+0000 7f4edbfff700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ebc060860 0x7f4ebc062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4003a10 tx=0x7f4ec4000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.173+0000 7f4ed3fff700 1 -- 172.21.15.31:0/1583318555 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4ecc04e3b0 con 0x7f4edc068e70 2024-08-17T02:25:56.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.381+0000 7f4ee135c700 1 -- 172.21.15.31:0/1583318555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4edc0cdc60 con 0x7f4edc068e70 2024-08-17T02:25:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.685+0000 7f4ed3fff700 1 -- 172.21.15.31:0/1583318555 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 136+0+0 (secure 0 0 0) 0x7f4ecc051910 con 0x7f4edc068e70 2024-08-17T02:25:56.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 -- 172.21.15.31:0/1583318555 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ebc060860 msgr2=0x7f4ebc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ebc060860 0x7f4ebc062d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4003a10 tx=0x7f4ec4000bc0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 -- 172.21.15.31:0/1583318555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc068e70 msgr2=0x7f4edc14ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc068e70 0x7f4edc14ed90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00b3c0 tx=0x7f4ecc017000 comp rx=0 tx=0).stop 2024-08-17T02:25:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 -- 172.21.15.31:0/1583318555 shutdown_connections 2024-08-17T02:25:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4ebc060860 0x7f4ebc062d10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4edc159fd0 0x7f4edc0c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4edc068e70 0x7f4edc14ed90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 --2- 172.21.15.31:0/1583318555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4edc068aa0 0x7f4edc150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 -- 172.21.15.31:0/1583318555 >> 172.21.15.31:0/1583318555 conn(0x7f4edc0d0090 msgr2=0x7f4edc15b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 -- 172.21.15.31:0/1583318555 shutdown_connections 2024-08-17T02:25:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.689+0000 7f4ee135c700 1 -- 172.21.15.31:0/1583318555 wait complete. 2024-08-17T02:25:56.710 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:25:56.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d126b9700 1 Processor -- start 2024-08-17T02:25:56.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d126b9700 1 -- start start 2024-08-17T02:25:56.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d126b9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1d0c0b0480 0x7f1d0c069580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d126b9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0c15ab70 con 0x7f1d0c0ad930 2024-08-17T02:25:56.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d126b9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0c0acb70 con 0x7f1d0c0691b0 2024-08-17T02:25:56.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d126b9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0c0b0910 con 0x7f1d0c0b0480 2024-08-17T02:25:56.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d11eb8700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1d0c0ad930 0x7f1d0c13f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55898/0 (socket says 172.21.15.31:55898) 2024-08-17T02:25:56.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d11eb8700 1 -- 172.21.15.31:0/1521476996 learned_addr learned my addr 172.21.15.31:0/1521476996 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:25:56.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d10eb6700 1 --2- 172.21.15.31:0/1521476996 >> v2:172.21.15.92:3300/0 conn(0x7f1d0c0b0480 0x7f1d0c069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1cfffff700 1 -- 172.21.15.31:0/1521476996 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400603495 0 0) 0x7f1d0c15ab70 con 0x7f1d0c0ad930 2024-08-17T02:25:56.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1cfffff700 1 -- 172.21.15.31:0/1521476996 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cf8003570 con 0x7f1d0c0ad930 2024-08-17T02:25:56.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d10eb6700 1 -- 172.21.15.31:0/1521476996 >> v1:172.21.15.92:6789/0 conn(0x7f1d0c0691b0 legacy=0x7f1d0c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d10eb6700 1 -- 172.21.15.31:0/1521476996 >> v1:172.21.15.31:6789/0 conn(0x7f1d0c0ad930 legacy=0x7f1d0c13f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.825+0000 7f1d10eb6700 1 -- 172.21.15.31:0/1521476996 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c0ace50 con 0x7f1d0c0b0480 2024-08-17T02:25:56.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1d10eb6700 1 --2- 172.21.15.31:0/1521476996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d0c0b0480 0x7f1d0c069580 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d000098e0 tx=0x7f1d000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d89890242ddfc6b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1cfffff700 1 -- 172.21.15.31:0/1521476996 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000b640 con 0x7f1d0c0b0480 2024-08-17T02:25:56.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1cfffff700 1 -- 172.21.15.31:0/1521476996 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0000b7a0 con 0x7f1d0c0b0480 2024-08-17T02:25:56.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1cfffff700 1 -- 172.21.15.31:0/1521476996 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000bb40 con 0x7f1d0c0b0480 2024-08-17T02:25:56.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1d126b9700 1 -- 172.21.15.31:0/1521476996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d0c0b0480 msgr2=0x7f1d0c069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1d126b9700 1 --2- 172.21.15.31:0/1521476996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d0c0b0480 0x7f1d0c069580 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d000098e0 tx=0x7f1d000091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1d126b9700 1 -- 172.21.15.31:0/1521476996 shutdown_connections 2024-08-17T02:25:56.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1d126b9700 1 --2- 172.21.15.31:0/1521476996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d0c0b0480 0x7f1d0c069580 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1d126b9700 1 -- 172.21.15.31:0/1521476996 >> 172.21.15.31:0/1521476996 conn(0x7f1d0c067400 msgr2=0x7f1d0c0677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1d126b9700 1 -- 172.21.15.31:0/1521476996 shutdown_connections 2024-08-17T02:25:56.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1d126b9700 1 -- 172.21.15.31:0/1521476996 wait complete. 2024-08-17T02:25:56.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1d126b9700 1 Processor -- start 2024-08-17T02:25:56.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.829+0000 7f1d126b9700 1 -- start start 2024-08-17T02:25:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d126b9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0c0691b0 0x7f1d0c135830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d126b9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d0c0ad930 0x7f1d0c138400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d126b9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d0c0b0480 0x7f1d0c1367f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d126b9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c137f70 con 0x7f1d0c0691b0 2024-08-17T02:25:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d126b9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c13b550 con 0x7f1d0c0b0480 2024-08-17T02:25:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d126b9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c137360 con 0x7f1d0c0ad930 2024-08-17T02:25:56.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d116b7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0c0691b0 0x7f1d0c135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d116b7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0c0691b0 0x7f1d0c135830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60850/0 (socket says 172.21.15.31:60850) 2024-08-17T02:25:56.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d116b7700 1 -- 172.21.15.31:0/518143466 learned_addr learned my addr 172.21.15.31:0/518143466 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:56.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d11eb8700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d0c0b0480 0x7f1d0c1367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d10eb6700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d0c0ad930 0x7f1d0c138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d116b7700 1 -- 172.21.15.31:0/518143466 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d0c0ad930 msgr2=0x7f1d0c138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d116b7700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d0c0ad930 0x7f1d0c138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d116b7700 1 -- 172.21.15.31:0/518143466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d0c0b0480 msgr2=0x7f1d0c1367f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d116b7700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d0c0b0480 0x7f1d0c1367f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d116b7700 1 -- 172.21.15.31:0/518143466 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d00009420 con 0x7f1d0c0691b0 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d10eb6700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d0c0ad930 0x7f1d0c138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d11eb8700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d0c0b0480 0x7f1d0c1367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d116b7700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0c0691b0 0x7f1d0c135830 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800c590 tx=0x7f1d0800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1cfd7fa700 1 -- 172.21.15.31:0/518143466 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08011590 con 0x7f1d0c0691b0 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d126b9700 1 -- 172.21.15.31:0/518143466 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c137640 con 0x7f1d0c0691b0 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1cfd7fa700 1 -- 172.21.15.31:0/518143466 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d080116f0 con 0x7f1d0c0691b0 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1cfd7fa700 1 -- 172.21.15.31:0/518143466 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08011ab0 con 0x7f1d0c0691b0 2024-08-17T02:25:56.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d126b9700 1 -- 172.21.15.31:0/518143466 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c137c00 con 0x7f1d0c0691b0 2024-08-17T02:25:56.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.833+0000 7f1d126b9700 1 -- 172.21.15.31:0/518143466 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c15ab60 con 0x7f1d0c0691b0 2024-08-17T02:25:56.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.837+0000 7f1cfd7fa700 1 -- 172.21.15.31:0/518143466 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1d0801b3b0 con 0x7f1d0c0691b0 2024-08-17T02:25:56.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.837+0000 7f1cfd7fa700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1cf0060890 0x7f1cf0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.837+0000 7f1d10eb6700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1cf0060890 0x7f1cf0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.837+0000 7f1cfd7fa700 1 -- 172.21.15.31:0/518143466 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d0807c1d0 con 0x7f1d0c0691b0 2024-08-17T02:25:56.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.837+0000 7f1d10eb6700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1cf0060890 0x7f1cf0062d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1d000093f0 tx=0x7f1d00017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:56.845+0000 7f1cfd7fa700 1 -- 172.21.15.31:0/518143466 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1d0c15ab60 con 0x7f1d0c0691b0 2024-08-17T02:25:57.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.033+0000 7f1d126b9700 1 -- 172.21.15.31:0/518143466 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d0c1380b0 con 0x7f1cf0060890 2024-08-17T02:25:57.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1cfd7fa700 1 -- 172.21.15.31:0/518143466 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1d0000b910 con 0x7f1cf0060890 2024-08-17T02:25:57.039 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-08-17T02:25:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:25:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-08-17T02:25:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:25:57.039 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-08-17T02:25:57.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 -- 172.21.15.31:0/518143466 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1cf0060890 msgr2=0x7f1cf0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1cf0060890 0x7f1cf0062d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1d000093f0 tx=0x7f1d00017000 comp rx=0 tx=0).stop 2024-08-17T02:25:57.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 -- 172.21.15.31:0/518143466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0c0691b0 msgr2=0x7f1d0c135830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0c0691b0 0x7f1d0c135830 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800c590 tx=0x7f1d0800c950 comp rx=0 tx=0).stop 2024-08-17T02:25:57.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 -- 172.21.15.31:0/518143466 shutdown_connections 2024-08-17T02:25:57.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1cf0060890 0x7f1cf0062d40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d0c0b0480 0x7f1d0c1367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d0c0ad930 0x7f1d0c138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 --2- 172.21.15.31:0/518143466 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0c0691b0 0x7f1d0c135830 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 -- 172.21.15.31:0/518143466 >> 172.21.15.31:0/518143466 conn(0x7f1d0c067400 msgr2=0x7f1d0c06d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.037+0000 7f1d126b9700 1 -- 172.21.15.31:0/518143466 shutdown_connections 2024-08-17T02:25:57.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.041+0000 7f1d126b9700 1 -- 172.21.15.31:0/518143466 wait complete. 2024-08-17T02:25:57.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:25:57.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f927b59e700 1 Processor -- start 2024-08-17T02:25:57.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f927b59e700 1 -- start start 2024-08-17T02:25:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f927b59e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f927c068aa0 0x7f927c068e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f927b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f927c0cb010 0x7f927c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f927b59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f927c0aeb80 0x7f927c0af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f927b59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c150510 con 0x7f927c0cb010 2024-08-17T02:25:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f927b59e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c15a510 con 0x7f927c068aa0 2024-08-17T02:25:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f927b59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c15cc00 con 0x7f927c0aeb80 2024-08-17T02:25:57.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9271d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f927c0cb010 0x7f927c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9271d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f927c0cb010 0x7f927c159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60864/0 (socket says 172.21.15.31:60864) 2024-08-17T02:25:57.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9271d9b700 1 -- 172.21.15.31:0/406531831 learned_addr learned my addr 172.21.15.31:0/406531831 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:57.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f927ad9d700 1 --2- 172.21.15.31:0/406531831 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f927c0aeb80 0x7f927c0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f927a59c700 1 --2- 172.21.15.31:0/406531831 >> v2:172.21.15.92:3300/0 conn(0x7f927c068aa0 0x7f927c068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9271d9b700 1 -- 172.21.15.31:0/406531831 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f927c0aeb80 msgr2=0x7f927c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9271d9b700 1 --2- 172.21.15.31:0/406531831 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f927c0aeb80 0x7f927c0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9271d9b700 1 -- 172.21.15.31:0/406531831 >> v2:172.21.15.92:3300/0 conn(0x7f927c068aa0 msgr2=0x7f927c068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9271d9b700 1 --2- 172.21.15.31:0/406531831 >> v2:172.21.15.92:3300/0 conn(0x7f927c068aa0 0x7f927c068e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9271d9b700 1 -- 172.21.15.31:0/406531831 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c0cb430 con 0x7f927c0cb010 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9271d9b700 1 --2- 172.21.15.31:0/406531831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 0x7f927c159fd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f927c06ae60 tx=0x7f9264009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d58dc9b7495c464 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9279d9b700 1 -- 172.21.15.31:0/406531831 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400b640 con 0x7f927c0cb010 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9279d9b700 1 -- 172.21.15.31:0/406531831 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926400b7a0 con 0x7f927c0cb010 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.161+0000 7f9279d9b700 1 -- 172.21.15.31:0/406531831 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926400bb60 con 0x7f927c0cb010 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 -- 172.21.15.31:0/406531831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 msgr2=0x7f927c159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 --2- 172.21.15.31:0/406531831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 0x7f927c159fd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f927c06ae60 tx=0x7f9264009250 comp rx=0 tx=0).stop 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 -- 172.21.15.31:0/406531831 shutdown_connections 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 --2- 172.21.15.31:0/406531831 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f927c0aeb80 0x7f927c0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 --2- 172.21.15.31:0/406531831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 0x7f927c159fd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 --2- 172.21.15.31:0/406531831 >> v2:172.21.15.92:3300/0 conn(0x7f927c068aa0 0x7f927c068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 -- 172.21.15.31:0/406531831 >> 172.21.15.31:0/406531831 conn(0x7f927c0d0090 msgr2=0x7f927c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 -- 172.21.15.31:0/406531831 shutdown_connections 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 -- 172.21.15.31:0/406531831 wait complete. 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 Processor -- start 2024-08-17T02:25:57.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 -- start start 2024-08-17T02:25:57.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f927c068aa0 0x7f927c0c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c0aeb80 0x7f927c0c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 0x7f927c0b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c169560 con 0x7f927c0cb010 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c0c8090 con 0x7f927c0aeb80 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.165+0000 7f927b59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c0c82c0 con 0x7f927c068aa0 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 0x7f927c0b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 0x7f927c0b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60876/0 (socket says 172.21.15.31:60876) 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927ad9d700 1 -- 172.21.15.31:0/836845335 learned_addr learned my addr 172.21.15.31:0/836845335 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f9271d9b700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c0aeb80 0x7f927c0c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927a59c700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f927c068aa0 0x7f927c0c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927ad9d700 1 -- 172.21.15.31:0/836845335 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f927c068aa0 msgr2=0x7f927c0c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927ad9d700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f927c068aa0 0x7f927c0c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927ad9d700 1 -- 172.21.15.31:0/836845335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c0aeb80 msgr2=0x7f927c0c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927ad9d700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c0aeb80 0x7f927c0c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927ad9d700 1 -- 172.21.15.31:0/836845335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92640094f0 con 0x7f927c0cb010 2024-08-17T02:25:57.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927ad9d700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 0x7f927c0b07b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9274009df0 tx=0x7f927400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f9272ffd700 1 -- 172.21.15.31:0/836845335 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400caa0 con 0x7f927c0cb010 2024-08-17T02:25:57.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f9272ffd700 1 -- 172.21.15.31:0/836845335 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927400f040 con 0x7f927c0cb010 2024-08-17T02:25:57.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927b59e700 1 -- 172.21.15.31:0/836845335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c0c85a0 con 0x7f927c0cb010 2024-08-17T02:25:57.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f9272ffd700 1 -- 172.21.15.31:0/836845335 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400ce70 con 0x7f927c0cb010 2024-08-17T02:25:57.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927b59e700 1 -- 172.21.15.31:0/836845335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c0c8b60 con 0x7f927c0cb010 2024-08-17T02:25:57.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.169+0000 7f927b59e700 1 -- 172.21.15.31:0/836845335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c1696d0 con 0x7f927c0cb010 2024-08-17T02:25:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.173+0000 7f9272ffd700 1 -- 172.21.15.31:0/836845335 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9274014690 con 0x7f927c0cb010 2024-08-17T02:25:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.173+0000 7f9272ffd700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f925c060860 0x7f925c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.173+0000 7f927a59c700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f925c060860 0x7f925c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.173+0000 7f9272ffd700 1 -- 172.21.15.31:0/836845335 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f927407d3d0 con 0x7f927c0cb010 2024-08-17T02:25:57.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.173+0000 7f927a59c700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f925c060860 0x7f925c062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f926c009c80 tx=0x7f926c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.181+0000 7f9272ffd700 1 -- 172.21.15.31:0/836845335 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f927c1696d0 con 0x7f927c0cb010 2024-08-17T02:25:57.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.349+0000 7f927b59e700 1 -- 172.21.15.31:0/836845335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f927c1696a0 con 0x7f927c0cb010 2024-08-17T02:25:57.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.349+0000 7f9272ffd700 1 -- 172.21.15.31:0/836845335 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f92740512b0 con 0x7f927c0cb010 2024-08-17T02:25:57.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 -- 172.21.15.31:0/836845335 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f925c060860 msgr2=0x7f925c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f925c060860 0x7f925c062d10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f926c009c80 tx=0x7f926c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 -- 172.21.15.31:0/836845335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 msgr2=0x7f927c0b07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 0x7f927c0b07b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9274009df0 tx=0x7f927400b040 comp rx=0 tx=0).stop 2024-08-17T02:25:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 -- 172.21.15.31:0/836845335 shutdown_connections 2024-08-17T02:25:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f925c060860 0x7f925c062d10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f927c0cb010 0x7f927c0b07b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f927c0aeb80 0x7f927c0c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 --2- 172.21.15.31:0/836845335 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f927c068aa0 0x7f927c0c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 -- 172.21.15.31:0/836845335 >> 172.21.15.31:0/836845335 conn(0x7f927c0d0090 msgr2=0x7f927c14fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 -- 172.21.15.31:0/836845335 shutdown_connections 2024-08-17T02:25:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.353+0000 7f927b59e700 1 -- 172.21.15.31:0/836845335 wait complete. 2024-08-17T02:25:57.367 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000037340 2024-08-17T02:25:57.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.481+0000 7fc373fff700 1 Processor -- start 2024-08-17T02:25:57.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.481+0000 7fc373fff700 1 -- start start 2024-08-17T02:25:57.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc373fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc3741591e0 0x7fc374156440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc373fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc374068c20 0x7fc3740cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc373fff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3740cadf0 con 0x7fc37406ed10 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc373fff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3740cb0d0 con 0x7fc3741591e0 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc373fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740cb3b0 con 0x7fc374068c20 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc372ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc3741591e0 0x7fc374156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc3737fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc374068c20 0x7fc3740cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc372ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc3741591e0 0x7fc374156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:59348/0 (socket says 172.21.15.31:59348) 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc372ffd700 1 -- 172.21.15.31:0/3114703446 learned_addr learned my addr 172.21.15.31:0/3114703446 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc3737fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc374068c20 0x7fc3740cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:47158/0 (socket says 172.21.15.31:47158) 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc36a7fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc37406ed10 0x7fc374068510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:43822/0 (socket says 172.21.15.31:43822) 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc372ffd700 1 -- 172.21.15.31:0/3114703446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc374068c20 msgr2=0x7fc3740cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc372ffd700 1 --2- 172.21.15.31:0/3114703446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc374068c20 0x7fc3740cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc372ffd700 1 -- 172.21.15.31:0/3114703446 >> v1:172.21.15.92:6789/0 conn(0x7fc37406ed10 legacy=0x7fc374068510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc372ffd700 1 -- 172.21.15.31:0/3114703446 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3740cb690 con 0x7fc3741591e0 2024-08-17T02:25:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc3737fe700 1 --2- 172.21.15.31:0/3114703446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc374068c20 0x7fc3740cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc372ffd700 1 --2- 172.21.15.31:0/3114703446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741591e0 0x7fc374156440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc36400bc50 tx=0x7fc36400b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9821ffe4dfc88eca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc3727fc700 1 -- 172.21.15.31:0/3114703446 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400daf0 con 0x7fc3741591e0 2024-08-17T02:25:57.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc3727fc700 1 -- 172.21.15.31:0/3114703446 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36400dc50 con 0x7fc3741591e0 2024-08-17T02:25:57.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.485+0000 7fc3727fc700 1 -- 172.21.15.31:0/3114703446 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364010470 con 0x7fc3741591e0 2024-08-17T02:25:57.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.489+0000 7fc373fff700 1 -- 172.21.15.31:0/3114703446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741591e0 msgr2=0x7fc374156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.489+0000 7fc373fff700 1 --2- 172.21.15.31:0/3114703446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741591e0 0x7fc374156440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc36400bc50 tx=0x7fc36400b4f0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.489+0000 7fc373fff700 1 -- 172.21.15.31:0/3114703446 shutdown_connections 2024-08-17T02:25:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.489+0000 7fc373fff700 1 --2- 172.21.15.31:0/3114703446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc374068c20 0x7fc3740cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.489+0000 7fc373fff700 1 --2- 172.21.15.31:0/3114703446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741591e0 0x7fc374156440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.489+0000 7fc373fff700 1 -- 172.21.15.31:0/3114703446 >> 172.21.15.31:0/3114703446 conn(0x7fc37406a0c0 msgr2=0x7fc37406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.489+0000 7fc373fff700 1 -- 172.21.15.31:0/3114703446 shutdown_connections 2024-08-17T02:25:57.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.489+0000 7fc373fff700 1 -- 172.21.15.31:0/3114703446 wait complete. 2024-08-17T02:25:57.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.489+0000 7fc373fff700 1 Processor -- start 2024-08-17T02:25:57.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc373fff700 1 -- start start 2024-08-17T02:25:57.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc373fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc374068c20 0x7fc3740c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc373fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc37406ed10 0x7fc37415e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc373fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741591e0 0x7fc374143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc373fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740c8a40 con 0x7fc374068c20 2024-08-17T02:25:57.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc373fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37415b450 con 0x7fc3741591e0 2024-08-17T02:25:57.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc373fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc374143d40 con 0x7fc37406ed10 2024-08-17T02:25:57.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc372ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc374068c20 0x7fc3740c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc372ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc374068c20 0x7fc3740c8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60884/0 (socket says 172.21.15.31:60884) 2024-08-17T02:25:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc372ffd700 1 -- 172.21.15.31:0/1122555094 learned_addr learned my addr 172.21.15.31:0/1122555094 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:25:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc36a7fc700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc37406ed10 0x7fc37415e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc3737fe700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741591e0 0x7fc374143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc372ffd700 1 -- 172.21.15.31:0/1122555094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc37406ed10 msgr2=0x7fc37415e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc372ffd700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc37406ed10 0x7fc37415e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc372ffd700 1 -- 172.21.15.31:0/1122555094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741591e0 msgr2=0x7fc374143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc372ffd700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741591e0 0x7fc374143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc372ffd700 1 -- 172.21.15.31:0/1122555094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c009a20 con 0x7fc374068c20 2024-08-17T02:25:57.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc372ffd700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc374068c20 0x7fc3740c8ce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc36400b530 tx=0x7fc36401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc36b7fe700 1 -- 172.21.15.31:0/1122555094 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364006bc0 con 0x7fc374068c20 2024-08-17T02:25:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc36b7fe700 1 -- 172.21.15.31:0/1122555094 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc364018630 con 0x7fc374068c20 2024-08-17T02:25:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc373fff700 1 -- 172.21.15.31:0/1122555094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36400b790 con 0x7fc374068c20 2024-08-17T02:25:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc36b7fe700 1 -- 172.21.15.31:0/1122555094 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364018a10 con 0x7fc374068c20 2024-08-17T02:25:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.493+0000 7fc373fff700 1 -- 172.21.15.31:0/1122555094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3740c8760 con 0x7fc374068c20 2024-08-17T02:25:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.497+0000 7fc373fff700 1 -- 172.21.15.31:0/1122555094 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3740712b0 con 0x7fc374068c20 2024-08-17T02:25:57.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.497+0000 7fc36b7fe700 1 -- 172.21.15.31:0/1122555094 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fc364022400 con 0x7fc374068c20 2024-08-17T02:25:57.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.497+0000 7fc36b7fe700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc354060860 0x7fc354062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.497+0000 7fc36a7fc700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc354060860 0x7fc354062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.497+0000 7fc36b7fe700 1 -- 172.21.15.31:0/1122555094 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc364014070 con 0x7fc374068c20 2024-08-17T02:25:57.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.497+0000 7fc36a7fc700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc354060860 0x7fc354062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc37415a7c0 tx=0x7fc35c007e70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.505+0000 7fc36b7fe700 1 -- 172.21.15.31:0/1122555094 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fc36404eb10 con 0x7fc374068c20 2024-08-17T02:25:57.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:25:57.697+0000 7fc373fff700 1 -- 172.21.15.31:0/1122555094 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000037340", "target": ["mon-mgr", ""]}) v1 -- 0x7fc374070be0 con 0x7fc354060860 2024-08-17T02:26:00.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.753+0000 7fc36b7fe700 1 -- 172.21.15.31:0/1122555094 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fc374070be0 con 0x7fc354060860 2024-08-17T02:26:00.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 -- 172.21.15.31:0/1122555094 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc354060860 msgr2=0x7fc354062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc354060860 0x7fc354062d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc37415a7c0 tx=0x7fc35c007e70 comp rx=0 tx=0).stop 2024-08-17T02:26:00.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 -- 172.21.15.31:0/1122555094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc374068c20 msgr2=0x7fc3740c8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc374068c20 0x7fc3740c8ce0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc36400b530 tx=0x7fc36401a000 comp rx=0 tx=0).stop 2024-08-17T02:26:00.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 -- 172.21.15.31:0/1122555094 shutdown_connections 2024-08-17T02:26:00.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fc354060860 0x7fc354062d10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3741591e0 0x7fc374143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc37406ed10 0x7fc37415e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 --2- 172.21.15.31:0/1122555094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc374068c20 0x7fc3740c8ce0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 -- 172.21.15.31:0/1122555094 >> 172.21.15.31:0/1122555094 conn(0x7fc37406a0c0 msgr2=0x7fc3741569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 -- 172.21.15.31:0/1122555094 shutdown_connections 2024-08-17T02:26:00.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.757+0000 7fc373fff700 1 -- 172.21.15.31:0/1122555094 wait complete. 2024-08-17T02:26:00.762 INFO:teuthology.orchestra.run.smithi031.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:26:00.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:26:00.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.877+0000 7f5ca18f4700 1 Processor -- start 2024-08-17T02:26:00.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.877+0000 7f5ca18f4700 1 -- start start 2024-08-17T02:26:00.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5ca18f4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5c9c0b1b60 0x7f5c9c0af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5ca18f4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 0x7f5c9c0afd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5ca18f4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c157c90 con 0x7f5c9c1554a0 2024-08-17T02:26:00.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5ca18f4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c156dd0 con 0x7f5c9c0b1b60 2024-08-17T02:26:00.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5ca18f4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c157080 con 0x7f5c9c155870 2024-08-17T02:26:00.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9b7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 0x7f5c9c0afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9b7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 0x7f5c9c0afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:58206/0 (socket says 172.21.15.31:58206) 2024-08-17T02:26:00.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9b7fe700 1 -- 172.21.15.31:0/1360870897 learned_addr learned my addr 172.21.15.31:0/1360870897 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:26:00.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c93fff700 1 --2- 172.21.15.31:0/1360870897 >> v2:172.21.15.92:3300/0 conn(0x7f5c9c0b1b60 0x7f5c9c0af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9b7fe700 1 -- 172.21.15.31:0/1360870897 >> v2:172.21.15.92:3300/0 conn(0x7f5c9c0b1b60 msgr2=0x7f5c9c0af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9b7fe700 1 --2- 172.21.15.31:0/1360870897 >> v2:172.21.15.92:3300/0 conn(0x7f5c9c0b1b60 0x7f5c9c0af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9b7fe700 1 -- 172.21.15.31:0/1360870897 >> v1:172.21.15.92:6789/0 conn(0x7f5c9c1554a0 legacy=0x7f5c9c1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9b7fe700 1 -- 172.21.15.31:0/1360870897 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c157360 con 0x7f5c9c155870 2024-08-17T02:26:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9b7fe700 1 --2- 172.21.15.31:0/1360870897 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 0x7f5c9c0afd20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009f20 tx=0x7f5c94009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6edebf78885fbc4d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9a7fc700 1 -- 172.21.15.31:0/1360870897 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400e070 con 0x7f5c9c155870 2024-08-17T02:26:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9a7fc700 1 -- 172.21.15.31:0/1360870897 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9400b9d0 con 0x7f5c9c155870 2024-08-17T02:26:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.881+0000 7f5c9a7fc700 1 -- 172.21.15.31:0/1360870897 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c940092e0 con 0x7f5c9c155870 2024-08-17T02:26:00.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.885+0000 7f5ca18f4700 1 -- 172.21.15.31:0/1360870897 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 msgr2=0x7f5c9c0afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.885+0000 7f5ca18f4700 1 --2- 172.21.15.31:0/1360870897 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 0x7f5c9c0afd20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009f20 tx=0x7f5c94009840 comp rx=0 tx=0).stop 2024-08-17T02:26:00.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.885+0000 7f5ca18f4700 1 -- 172.21.15.31:0/1360870897 shutdown_connections 2024-08-17T02:26:00.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.885+0000 7f5ca18f4700 1 --2- 172.21.15.31:0/1360870897 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 0x7f5c9c0afd20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.885+0000 7f5ca18f4700 1 --2- 172.21.15.31:0/1360870897 >> v2:172.21.15.92:3300/0 conn(0x7f5c9c0b1b60 0x7f5c9c0af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.885+0000 7f5ca18f4700 1 -- 172.21.15.31:0/1360870897 >> 172.21.15.31:0/1360870897 conn(0x7f5c9c0cbe50 msgr2=0x7f5c9c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.885+0000 7f5ca18f4700 1 -- 172.21.15.31:0/1360870897 shutdown_connections 2024-08-17T02:26:00.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.885+0000 7f5ca18f4700 1 -- 172.21.15.31:0/1360870897 wait complete. 2024-08-17T02:26:00.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.885+0000 7f5ca18f4700 1 Processor -- start 2024-08-17T02:26:00.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.885+0000 7f5ca18f4700 1 -- start start 2024-08-17T02:26:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5ca18f4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c0b1b60 0x7f5c9c134b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5ca18f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c9c1554a0 0x7f5c9c14e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5ca18f4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 0x7f5c9c14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5ca18f4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c148c70 con 0x7f5c9c0b1b60 2024-08-17T02:26:00.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5ca18f4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c148f50 con 0x7f5c9c1554a0 2024-08-17T02:26:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5ca18f4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c149230 con 0x7f5c9c155870 2024-08-17T02:26:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c9affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c0b1b60 0x7f5c9c134b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c93fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c9c1554a0 0x7f5c9c14e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c93fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c9c1554a0 0x7f5c9c14e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:36602/0 (socket says 172.21.15.31:36602) 2024-08-17T02:26:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c9affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c0b1b60 0x7f5c9c134b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37774/0 (socket says 172.21.15.31:37774) 2024-08-17T02:26:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c93fff700 1 -- 172.21.15.31:0/2227962013 learned_addr learned my addr 172.21.15.31:0/2227962013 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:26:00.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c9b7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 0x7f5c9c14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c93fff700 1 -- 172.21.15.31:0/2227962013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 msgr2=0x7f5c9c14e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c93fff700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 0x7f5c9c14e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c93fff700 1 -- 172.21.15.31:0/2227962013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c0b1b60 msgr2=0x7f5c9c134b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c93fff700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c0b1b60 0x7f5c9c134b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c93fff700 1 -- 172.21.15.31:0/2227962013 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94009ae0 con 0x7f5c9c1554a0 2024-08-17T02:26:00.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c9affd700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c0b1b60 0x7f5c9c134b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:00.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c93fff700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c9c1554a0 0x7f5c9c14e400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400ec80 tx=0x7f5c840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c92ffd700 1 -- 172.21.15.31:0/2227962013 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8400c850 con 0x7f5c9c1554a0 2024-08-17T02:26:00.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c92ffd700 1 -- 172.21.15.31:0/2227962013 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8400c9d0 con 0x7f5c9c1554a0 2024-08-17T02:26:00.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5ca18f4700 1 -- 172.21.15.31:0/2227962013 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9c149510 con 0x7f5c9c1554a0 2024-08-17T02:26:00.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5c92ffd700 1 -- 172.21.15.31:0/2227962013 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8400cd90 con 0x7f5c9c1554a0 2024-08-17T02:26:00.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.889+0000 7f5ca18f4700 1 -- 172.21.15.31:0/2227962013 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9c1350d0 con 0x7f5c9c1554a0 2024-08-17T02:26:00.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.893+0000 7f5ca18f4700 1 -- 172.21.15.31:0/2227962013 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9c144dd0 con 0x7f5c9c1554a0 2024-08-17T02:26:00.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.893+0000 7f5c92ffd700 1 -- 172.21.15.31:0/2227962013 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f5c84013680 con 0x7f5c9c1554a0 2024-08-17T02:26:00.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.893+0000 7f5c92ffd700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5c80060860 0x7f5c80062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.893+0000 7f5c92ffd700 1 -- 172.21.15.31:0/2227962013 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f5c8407d1e0 con 0x7f5c9c1554a0 2024-08-17T02:26:00.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.893+0000 7f5c9affd700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5c80060860 0x7f5c80062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.893+0000 7f5c9affd700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5c80060860 0x7f5c80062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c001dc0 tx=0x7f5c8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:00.905+0000 7f5c92ffd700 1 -- 172.21.15.31:0/2227962013 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f5c9c144dd0 con 0x7f5c9c1554a0 2024-08-17T02:26:01.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.093+0000 7f5ca18f4700 1 -- 172.21.15.31:0/2227962013 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c9c144dd0 con 0x7f5c80060860 2024-08-17T02:26:01.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5c92ffd700 1 -- 172.21.15.31:0/2227962013 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f5c9c144dd0 con 0x7f5c80060860 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volume_0000000000037340" 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-08-17T02:26:01.099 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-08-17T02:26:01.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 -- 172.21.15.31:0/2227962013 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5c80060860 msgr2=0x7f5c80062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5c80060860 0x7f5c80062d10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c001dc0 tx=0x7f5c8c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:01.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 -- 172.21.15.31:0/2227962013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c9c1554a0 msgr2=0x7f5c9c14e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c9c1554a0 0x7f5c9c14e400 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400ec80 tx=0x7f5c840091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 -- 172.21.15.31:0/2227962013 shutdown_connections 2024-08-17T02:26:01.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f5c80060860 0x7f5c80062d10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5c9c155870 0x7f5c9c14e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c9c1554a0 0x7f5c9c14e400 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 --2- 172.21.15.31:0/2227962013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c9c0b1b60 0x7f5c9c134b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 -- 172.21.15.31:0/2227962013 >> 172.21.15.31:0/2227962013 conn(0x7f5c9c0cbe50 msgr2=0x7f5c9c155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 -- 172.21.15.31:0/2227962013 shutdown_connections 2024-08-17T02:26:01.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.097+0000 7f5ca18f4700 1 -- 172.21.15.31:0/2227962013 wait complete. 2024-08-17T02:26:01.113 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:26:01.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.221+0000 7f3296655700 1 Processor -- start 2024-08-17T02:26:01.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.221+0000 7f3296655700 1 -- start start 2024-08-17T02:26:01.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f32900b0780 0x7f32900af570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3290069ec0 0x7f329006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329006a860 con 0x7f3290157080 2024-08-17T02:26:01.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900af0e0 con 0x7f3290069ec0 2024-08-17T02:26:01.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900b0bb0 con 0x7f32900b0780 2024-08-17T02:26:01.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3295e54700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3290069ec0 0x7f329006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3295653700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3290157080 0x7f32900cc670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44744/0 (socket says 172.21.15.31:44744) 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3295653700 1 -- 172.21.15.31:0/1596317994 learned_addr learned my addr 172.21.15.31:0/1596317994 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3294e52700 1 --2- 172.21.15.31:0/1596317994 >> v2:172.21.15.92:3300/0 conn(0x7f32900b0780 0x7f32900af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3295e54700 1 -- 172.21.15.31:0/1596317994 >> v2:172.21.15.92:3300/0 conn(0x7f32900b0780 msgr2=0x7f32900af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3295e54700 1 --2- 172.21.15.31:0/1596317994 >> v2:172.21.15.92:3300/0 conn(0x7f32900b0780 0x7f32900af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3295e54700 1 -- 172.21.15.31:0/1596317994 >> v1:172.21.15.31:6789/0 conn(0x7f3290157080 legacy=0x7f32900cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3283fff700 1 -- 172.21.15.31:0/1596317994 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458631261 0 0) 0x7f328c001490 con 0x7f3290157080 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3295e54700 1 -- 172.21.15.31:0/1596317994 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290157450 con 0x7f3290069ec0 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3294e52700 1 --2- 172.21.15.31:0/1596317994 >> v2:172.21.15.92:3300/0 conn(0x7f32900b0780 0x7f32900af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3295e54700 1 --2- 172.21.15.31:0/1596317994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290069ec0 0x7f329006a320 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f32900ab890 tx=0x7f32880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685b452e5eca7e3b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3283fff700 1 -- 172.21.15.31:0/1596317994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800b6b0 con 0x7f3290069ec0 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3283fff700 1 -- 172.21.15.31:0/1596317994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328800b810 con 0x7f3290069ec0 2024-08-17T02:26:01.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3283fff700 1 -- 172.21.15.31:0/1596317994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800bbb0 con 0x7f3290069ec0 2024-08-17T02:26:01.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 -- 172.21.15.31:0/1596317994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290069ec0 msgr2=0x7f329006a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 --2- 172.21.15.31:0/1596317994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290069ec0 0x7f329006a320 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f32900ab890 tx=0x7f32880091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 -- 172.21.15.31:0/1596317994 shutdown_connections 2024-08-17T02:26:01.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 --2- 172.21.15.31:0/1596317994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290069ec0 0x7f329006a320 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 --2- 172.21.15.31:0/1596317994 >> v2:172.21.15.92:3300/0 conn(0x7f32900b0780 0x7f32900af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 -- 172.21.15.31:0/1596317994 >> 172.21.15.31:0/1596317994 conn(0x7f3290067e90 msgr2=0x7f32900cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 -- 172.21.15.31:0/1596317994 shutdown_connections 2024-08-17T02:26:01.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 -- 172.21.15.31:0/1596317994 wait complete. 2024-08-17T02:26:01.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 Processor -- start 2024-08-17T02:26:01.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.225+0000 7f3296655700 1 -- start start 2024-08-17T02:26:01.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3296655700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3290069ec0 0x7f32900ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3296655700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32900b0780 0x7f32900ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3296655700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290157080 0x7f329014c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3296655700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329014dc90 con 0x7f3290157080 2024-08-17T02:26:01.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3296655700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900ace40 con 0x7f32900b0780 2024-08-17T02:26:01.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3296655700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32900ad120 con 0x7f3290069ec0 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295e54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290157080 0x7f329014c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295e54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290157080 0x7f329014c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37788/0 (socket says 172.21.15.31:37788) 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295e54700 1 -- 172.21.15.31:0/3588205685 learned_addr learned my addr 172.21.15.31:0/3588205685 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3294e52700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32900b0780 0x7f32900ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295653700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3290069ec0 0x7f32900ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295e54700 1 -- 172.21.15.31:0/3588205685 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3290069ec0 msgr2=0x7f32900ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295e54700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3290069ec0 0x7f32900ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295e54700 1 -- 172.21.15.31:0/3588205685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32900b0780 msgr2=0x7f32900ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295e54700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32900b0780 0x7f32900ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295e54700 1 -- 172.21.15.31:0/3588205685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288009420 con 0x7f3290157080 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3294e52700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32900b0780 0x7f32900ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295653700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3290069ec0 0x7f32900ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3295e54700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290157080 0x7f329014c8e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f32900b1eb0 tx=0x7f3288017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f32817fa700 1 -- 172.21.15.31:0/3588205685 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800bb50 con 0x7f3290157080 2024-08-17T02:26:01.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f32817fa700 1 -- 172.21.15.31:0/3588205685 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288011630 con 0x7f3290157080 2024-08-17T02:26:01.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3296655700 1 -- 172.21.15.31:0/3588205685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3290148300 con 0x7f3290157080 2024-08-17T02:26:01.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f32817fa700 1 -- 172.21.15.31:0/3588205685 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32880119d0 con 0x7f3290157080 2024-08-17T02:26:01.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3296655700 1 -- 172.21.15.31:0/3588205685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32901488c0 con 0x7f3290157080 2024-08-17T02:26:01.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f3296655700 1 -- 172.21.15.31:0/3588205685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3290148ae0 con 0x7f3290157080 2024-08-17T02:26:01.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.229+0000 7f32817fa700 1 -- 172.21.15.31:0/3588205685 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3288011d40 con 0x7f3290157080 2024-08-17T02:26:01.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.233+0000 7f32817fa700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3274060860 0x7f3274062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.233+0000 7f3295653700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3274060860 0x7f3274062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.233+0000 7f32817fa700 1 -- 172.21.15.31:0/3588205685 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f328807ea60 con 0x7f3290157080 2024-08-17T02:26:01.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.233+0000 7f3295653700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3274060860 0x7f3274062d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f329006b5b0 tx=0x7f328c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.241+0000 7f32817fa700 1 -- 172.21.15.31:0/3588205685 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f328804eb90 con 0x7f3290157080 2024-08-17T02:26:01.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.405+0000 7f3296655700 1 -- 172.21.15.31:0/3588205685 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f32900712b0 con 0x7f3290157080 2024-08-17T02:26:01.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.405+0000 7f32817fa700 1 -- 172.21.15.31:0/3588205685 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v39) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f32880521b0 con 0x7f3290157080 2024-08-17T02:26:01.409 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:26:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 -- 172.21.15.31:0/3588205685 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3274060860 msgr2=0x7f3274062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3274060860 0x7f3274062d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f329006b5b0 tx=0x7f328c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 -- 172.21.15.31:0/3588205685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290157080 msgr2=0x7f329014c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290157080 0x7f329014c8e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f32900b1eb0 tx=0x7f3288017000 comp rx=0 tx=0).stop 2024-08-17T02:26:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 -- 172.21.15.31:0/3588205685 shutdown_connections 2024-08-17T02:26:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3274060860 0x7f3274062d10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3290157080 0x7f329014c8e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32900b0780 0x7f32900ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 --2- 172.21.15.31:0/3588205685 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3290069ec0 0x7f32900ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 -- 172.21.15.31:0/3588205685 >> 172.21.15.31:0/3588205685 conn(0x7f3290067e90 msgr2=0x7f32900ca040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 -- 172.21.15.31:0/3588205685 shutdown_connections 2024-08-17T02:26:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.409+0000 7f3296655700 1 -- 172.21.15.31:0/3588205685 wait complete. 2024-08-17T02:26:01.423 INFO:teuthology.orchestra.run.smithi031.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:40.183864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:40.754356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000037340.meta","create_time":"2024-08-17T02:25:57.739259+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000037340"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000037340.data","create_time":"2024-08-17T02:25:58.749832+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000037340"}}}] 2024-08-17T02:26:01.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000037340 --format=json 2024-08-17T02:26:01.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.529+0000 7f77293ec700 1 Processor -- start 2024-08-17T02:26:01.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.529+0000 7f77293ec700 1 -- start start 2024-08-17T02:26:01.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 0x7f77240c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f77240ca070 0x7f772406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240cb1b0 con 0x7f7724156fd0 2024-08-17T02:26:01.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77240ca5a0 con 0x7f77240ca070 2024-08-17T02:26:01.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77240ca880 con 0x7f77240b12b0 2024-08-17T02:26:01.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f7722ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7724156fd0 0x7f77240cb640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44760/0 (socket says 172.21.15.31:44760) 2024-08-17T02:26:01.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f7722ffd700 1 -- 172.21.15.31:0/269157650 learned_addr learned my addr 172.21.15.31:0/269157650 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:26:01.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77237fe700 1 --2- 172.21.15.31:0/269157650 >> v2:172.21.15.92:3300/0 conn(0x7f77240ca070 0x7f772406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f771bfff700 1 --2- 172.21.15.31:0/269157650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 0x7f77240c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77227fc700 1 -- 172.21.15.31:0/269157650 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678836753 0 0) 0x7f77240cb1b0 con 0x7f7724156fd0 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77227fc700 1 -- 172.21.15.31:0/269157650 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7710003570 con 0x7f7724156fd0 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f771bfff700 1 -- 172.21.15.31:0/269157650 >> v2:172.21.15.92:3300/0 conn(0x7f77240ca070 msgr2=0x7f772406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f771bfff700 1 --2- 172.21.15.31:0/269157650 >> v2:172.21.15.92:3300/0 conn(0x7f77240ca070 0x7f772406a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f771bfff700 1 -- 172.21.15.31:0/269157650 >> v1:172.21.15.31:6789/0 conn(0x7f7724156fd0 legacy=0x7f77240cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f771bfff700 1 -- 172.21.15.31:0/269157650 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240cab60 con 0x7f77240b12b0 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f771bfff700 1 --2- 172.21.15.31:0/269157650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 0x7f77240c9b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f770c0098e0 tx=0x7f770c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8ea230c23a10684 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77227fc700 1 -- 172.21.15.31:0/269157650 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c011630 con 0x7f77240b12b0 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77227fc700 1 -- 172.21.15.31:0/269157650 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c011790 con 0x7f77240b12b0 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77227fc700 1 -- 172.21.15.31:0/269157650 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c011b30 con 0x7f77240b12b0 2024-08-17T02:26:01.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 -- 172.21.15.31:0/269157650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 msgr2=0x7f77240c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 --2- 172.21.15.31:0/269157650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 0x7f77240c9b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f770c0098e0 tx=0x7f770c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 -- 172.21.15.31:0/269157650 shutdown_connections 2024-08-17T02:26:01.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 --2- 172.21.15.31:0/269157650 >> v2:172.21.15.92:3300/0 conn(0x7f77240ca070 0x7f772406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 --2- 172.21.15.31:0/269157650 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 0x7f77240c9b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 -- 172.21.15.31:0/269157650 >> 172.21.15.31:0/269157650 conn(0x7f77240cbe50 msgr2=0x7f77240cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 -- 172.21.15.31:0/269157650 shutdown_connections 2024-08-17T02:26:01.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.533+0000 7f77293ec700 1 -- 172.21.15.31:0/269157650 wait complete. 2024-08-17T02:26:01.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77293ec700 1 Processor -- start 2024-08-17T02:26:01.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77293ec700 1 -- start start 2024-08-17T02:26:01.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77293ec700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 0x7f7724144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77293ec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77240ca070 0x7f77241511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77293ec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7724156fd0 0x7f7724151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77293ec700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240b0940 con 0x7f77240ca070 2024-08-17T02:26:01.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77293ec700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240afd30 con 0x7f7724156fd0 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77293ec700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77240b0010 con 0x7f77240b12b0 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77240ca070 0x7f77241511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77240ca070 0x7f77241511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37796/0 (socket says 172.21.15.31:37796) 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771bfff700 1 -- 172.21.15.31:0/201654434 learned_addr learned my addr 172.21.15.31:0/201654434 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f7722ffd700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 0x7f7724144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77237fe700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7724156fd0 0x7f7724151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771bfff700 1 -- 172.21.15.31:0/201654434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 msgr2=0x7f7724144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771bfff700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 0x7f7724144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771bfff700 1 -- 172.21.15.31:0/201654434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7724156fd0 msgr2=0x7f7724151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771bfff700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7724156fd0 0x7f7724151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771bfff700 1 -- 172.21.15.31:0/201654434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009420 con 0x7f77240ca070 2024-08-17T02:26:01.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77237fe700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7724156fd0 0x7f7724151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:01.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771bfff700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77240ca070 0x7f77241511c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f770c013000 tx=0x7f770c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771affd700 1 -- 172.21.15.31:0/201654434 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c011b10 con 0x7f77240ca070 2024-08-17T02:26:01.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771affd700 1 -- 172.21.15.31:0/201654434 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c000cc0 con 0x7f77240ca070 2024-08-17T02:26:01.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77293ec700 1 -- 172.21.15.31:0/201654434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77240b02f0 con 0x7f77240ca070 2024-08-17T02:26:01.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f771affd700 1 -- 172.21.15.31:0/201654434 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c023600 con 0x7f77240ca070 2024-08-17T02:26:01.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.537+0000 7f77293ec700 1 -- 172.21.15.31:0/201654434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7724144d90 con 0x7f77240ca070 2024-08-17T02:26:01.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.541+0000 7f77293ec700 1 -- 172.21.15.31:0/201654434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7724144fb0 con 0x7f77240ca070 2024-08-17T02:26:01.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.541+0000 7f771affd700 1 -- 172.21.15.31:0/201654434 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f770c02c3b0 con 0x7f77240ca070 2024-08-17T02:26:01.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.541+0000 7f771affd700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7704060860 0x7f7704062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.541+0000 7f771affd700 1 -- 172.21.15.31:0/201654434 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f770c07e360 con 0x7f77240ca070 2024-08-17T02:26:01.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.541+0000 7f7722ffd700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7704060860 0x7f7704062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.541+0000 7f7722ffd700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7704060860 0x7f7704062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7714007fd0 tx=0x7f7714009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.553+0000 7f771affd700 1 -- 172.21.15.31:0/201654434 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f7724144fb0 con 0x7f77240ca070 2024-08-17T02:26:01.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.757+0000 7f77293ec700 1 -- 172.21.15.31:0/201654434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000037340", "format": "json"} v 0) v1 -- 0x7f772416a770 con 0x7f77240ca070 2024-08-17T02:26:01.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.757+0000 7f771affd700 1 -- 172.21.15.31:0/201654434 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000037340", "format": "json"}]=0 v17) v1 ==== 110+0+1842 (secure 0 0 0) 0x7f770c015750 con 0x7f77240ca070 2024-08-17T02:26:01.761 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:26:01.761 INFO:teuthology.orchestra.run.smithi031.stdout:{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:59.737073+0000","modified":"2024-08-17T02:26:01.269310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.31:6836/548139464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":548139464},{"type":"v1","addr":"172.21.15.31:6836","nonce":548139464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000037340","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 -- 172.21.15.31:0/201654434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7704060860 msgr2=0x7f7704062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7704060860 0x7f7704062d10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7714007fd0 tx=0x7f7714009040 comp rx=0 tx=0).stop 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 -- 172.21.15.31:0/201654434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77240ca070 msgr2=0x7f77241511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77240ca070 0x7f77241511c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f770c013000 tx=0x7f770c017000 comp rx=0 tx=0).stop 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 -- 172.21.15.31:0/201654434 shutdown_connections 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f7704060860 0x7f7704062d10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7724156fd0 0x7f7724151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77240ca070 0x7f77241511c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 --2- 172.21.15.31:0/201654434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f77240b12b0 0x7f7724144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 -- 172.21.15.31:0/201654434 >> 172.21.15.31:0/201654434 conn(0x7f77240cbe50 msgr2=0x7f77241528a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 -- 172.21.15.31:0/201654434 shutdown_connections 2024-08-17T02:26:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.761+0000 7f77293ec700 1 -- 172.21.15.31:0/201654434 wait complete. 2024-08-17T02:26:01.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000037340 --yes-i-really-mean-it 2024-08-17T02:26:01.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0838106700 1 Processor -- start 2024-08-17T02:26:01.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0838106700 1 -- start start 2024-08-17T02:26:01.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0838106700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f083015d3f0 0x7f08300b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0838106700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0830161260 0x7f083015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0838106700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0830067d00 con 0x7f08300aff40 2024-08-17T02:26:01.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0838106700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08300b30a0 con 0x7f083015d3f0 2024-08-17T02:26:01.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0838106700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083006e430 con 0x7f0830161260 2024-08-17T02:26:01.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0835ea2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f083015d3f0 0x7f08300b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0835ea2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f083015d3f0 0x7f08300b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37804/0 (socket says 172.21.15.31:37804) 2024-08-17T02:26:01.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0835ea2700 1 -- 172.21.15.31:0/317853667 learned_addr learned my addr 172.21.15.31:0/317853667 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:26:01.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f08356a1700 1 --2- 172.21.15.31:0/317853667 >> v2:172.21.15.92:3300/0 conn(0x7f0830161260 0x7f083015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0835ea2700 1 -- 172.21.15.31:0/317853667 >> v2:172.21.15.92:3300/0 conn(0x7f0830161260 msgr2=0x7f083015d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:01.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0835ea2700 1 --2- 172.21.15.31:0/317853667 >> v2:172.21.15.92:3300/0 conn(0x7f0830161260 0x7f083015d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0835ea2700 1 -- 172.21.15.31:0/317853667 >> v1:172.21.15.92:6789/0 conn(0x7f08300aff40 legacy=0x7f08300aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0835ea2700 1 -- 172.21.15.31:0/317853667 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083006f8d0 con 0x7f083015d3f0 2024-08-17T02:26:01.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0835ea2700 1 --2- 172.21.15.31:0/317853667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f083015d3f0 0x7f08300b2b60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f08300b1e50 tx=0x7f082c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b085415d3705036 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0834ea0700 1 -- 172.21.15.31:0/317853667 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c009e70 con 0x7f083015d3f0 2024-08-17T02:26:01.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0834ea0700 1 -- 172.21.15.31:0/317853667 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c00b860 con 0x7f083015d3f0 2024-08-17T02:26:01.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.881+0000 7f0834ea0700 1 -- 172.21.15.31:0/317853667 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c00bc00 con 0x7f083015d3f0 2024-08-17T02:26:01.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 -- 172.21.15.31:0/317853667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f083015d3f0 msgr2=0x7f08300b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 --2- 172.21.15.31:0/317853667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f083015d3f0 0x7f08300b2b60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f08300b1e50 tx=0x7f082c009250 comp rx=0 tx=0).stop 2024-08-17T02:26:01.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 -- 172.21.15.31:0/317853667 shutdown_connections 2024-08-17T02:26:01.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 --2- 172.21.15.31:0/317853667 >> v2:172.21.15.92:3300/0 conn(0x7f0830161260 0x7f083015d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 --2- 172.21.15.31:0/317853667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f083015d3f0 0x7f08300b2b60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 -- 172.21.15.31:0/317853667 >> 172.21.15.31:0/317853667 conn(0x7f083006b120 msgr2=0x7f083006b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 -- 172.21.15.31:0/317853667 shutdown_connections 2024-08-17T02:26:01.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 -- 172.21.15.31:0/317853667 wait complete. 2024-08-17T02:26:01.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 Processor -- start 2024-08-17T02:26:01.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 -- start start 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08300aff40 0x7f08300a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083015d3f0 0x7f083015fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0830161260 0x7f0830156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08300a7da0 con 0x7f08300aff40 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083015e220 con 0x7f083015d3f0 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0838106700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0830160710 con 0x7f0830161260 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0835ea2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08300aff40 0x7f08300a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0835ea2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08300aff40 0x7f08300a7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37806/0 (socket says 172.21.15.31:37806) 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.885+0000 7f0835ea2700 1 -- 172.21.15.31:0/1591811955 learned_addr learned my addr 172.21.15.31:0/1591811955 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f08356a1700 1 --2- 172.21.15.31:0/1591811955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083015d3f0 0x7f083015fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f08366a3700 1 --2- 172.21.15.31:0/1591811955 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0830161260 0x7f0830156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0835ea2700 1 -- 172.21.15.31:0/1591811955 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0830161260 msgr2=0x7f0830156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0835ea2700 1 --2- 172.21.15.31:0/1591811955 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0830161260 0x7f0830156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0835ea2700 1 -- 172.21.15.31:0/1591811955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083015d3f0 msgr2=0x7f083015fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0835ea2700 1 --2- 172.21.15.31:0/1591811955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083015d3f0 0x7f083015fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0835ea2700 1 -- 172.21.15.31:0/1591811955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c0094f0 con 0x7f08300aff40 2024-08-17T02:26:01.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0835ea2700 1 --2- 172.21.15.31:0/1591811955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08300aff40 0x7f08300a7790 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f082c006fd0 tx=0x7f082c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0825ffb700 1 -- 172.21.15.31:0/1591811955 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c00bbe0 con 0x7f08300aff40 2024-08-17T02:26:01.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0825ffb700 1 -- 172.21.15.31:0/1591811955 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c011420 con 0x7f08300aff40 2024-08-17T02:26:01.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0838106700 1 -- 172.21.15.31:0/1591811955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083015d8f0 con 0x7f08300aff40 2024-08-17T02:26:01.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0825ffb700 1 -- 172.21.15.31:0/1591811955 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c0117c0 con 0x7f08300aff40 2024-08-17T02:26:01.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0838106700 1 -- 172.21.15.31:0/1591811955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083015deb0 con 0x7f08300aff40 2024-08-17T02:26:01.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.889+0000 7f0838106700 1 -- 172.21.15.31:0/1591811955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08300712b0 con 0x7f08300aff40 2024-08-17T02:26:01.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.893+0000 7f0825ffb700 1 -- 172.21.15.31:0/1591811955 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f082c011bf0 con 0x7f08300aff40 2024-08-17T02:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.893+0000 7f0825ffb700 1 --2- 172.21.15.31:0/1591811955 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0814060860 0x7f0814062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.893+0000 7f0825ffb700 1 -- 172.21.15.31:0/1591811955 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f082c07ec90 con 0x7f08300aff40 2024-08-17T02:26:01.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.893+0000 7f08356a1700 1 --2- 172.21.15.31:0/1591811955 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0814060860 0x7f0814062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.893+0000 7f08356a1700 1 --2- 172.21.15.31:0/1591811955 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0814060860 0x7f0814062d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f08300afb00 tx=0x7f08200091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:01.901+0000 7f0825ffb700 1 -- 172.21.15.31:0/1591811955 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f082c04eda0 con 0x7f08300aff40 2024-08-17T02:26:02.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:26:02.085+0000 7f0838106700 1 -- 172.21.15.31:0/1591811955 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000037340", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f083015e360 con 0x7f0814060860 2024-08-17T02:26:05.203 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-08-17T02:26:05.201+0000 7fd780d3c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:13.521 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:13.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:43.575 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:43.579 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:13.628 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:13.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:43.682 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:43.685 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:01.793 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:28:01.795 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:28:01.795 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:01.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:01.835 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:28:01.835 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2024-08-17T02:28:01.835 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:01.835 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:01.849 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi031.stderr:ceph-fuse[34056]: fuse finished with error 0 and tester_r 0 2024-08-17T02:28:01.852 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:28:01.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:01.852 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:28:02.019 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi092.front.sepia.ceph.com... 2024-08-17T02:28:02.019 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:02.019 DEBUG:teuthology.orchestra.run.smithi092:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:02.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi092.stderr:ceph-fuse[30344]: fuse finished with error 0 and tester_r 0 2024-08-17T02:28:02.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:28:02.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:02.036 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:28:02.159 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:28:02.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:02.159 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:28:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-08-17T02:28:02.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:02.167 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:28:02.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:02.167 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:28:02.174 INFO:teuthology.orchestra.run.smithi092.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-08-17T02:28:02.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:02.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:02.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa37073700 1 Processor -- start 2024-08-17T02:28:02.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa37073700 1 -- start start 2024-08-17T02:28:02.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa37073700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffa3015da80 0x7ffa30168860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa37073700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa30141e40 con 0x7ffa30069580 2024-08-17T02:28:02.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa37073700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa30141230 con 0x7ffa300691b0 2024-08-17T02:28:02.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa37073700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa30141510 con 0x7ffa3015da80 2024-08-17T02:28:02.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa36872700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffa3015da80 0x7ffa30168860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa36872700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffa3015da80 0x7ffa30168860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55232/0 (socket says 172.21.15.31:55232) 2024-08-17T02:28:02.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa36872700 1 -- 172.21.15.31:0/334148441 learned_addr learned my addr 172.21.15.31:0/334148441 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:02.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa35870700 1 --1- 172.21.15.31:0/334148441 >> v1:172.21.15.31:6789/0 conn(0x7ffa30069580 0x7ffa3015d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49814/0 (socket says 172.21.15.31:49814) 2024-08-17T02:28:02.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.319+0000 7ffa36872700 1 -- 172.21.15.31:0/334148441 >> v1:172.21.15.92:6789/0 conn(0x7ffa300691b0 legacy=0x7ffa30161e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa3506f700 1 -- 172.21.15.31:0/334148441 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34391687 0 0) 0x7ffa30141230 con 0x7ffa300691b0 2024-08-17T02:28:02.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa36872700 1 -- 172.21.15.31:0/334148441 >> v1:172.21.15.31:6789/0 conn(0x7ffa30069580 legacy=0x7ffa3015d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa36872700 1 -- 172.21.15.31:0/334148441 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa301417f0 con 0x7ffa3015da80 2024-08-17T02:28:02.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa36872700 1 --2- 172.21.15.31:0/334148441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa3015da80 0x7ffa30168860 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009f20 tx=0x7ffa28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2128d4637bf10d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa3506f700 1 -- 172.21.15.31:0/334148441 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800e070 con 0x7ffa3015da80 2024-08-17T02:28:02.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa3506f700 1 -- 172.21.15.31:0/334148441 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2800b980 con 0x7ffa3015da80 2024-08-17T02:28:02.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa3506f700 1 -- 172.21.15.31:0/334148441 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280092e0 con 0x7ffa3015da80 2024-08-17T02:28:02.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa37073700 1 -- 172.21.15.31:0/334148441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa3015da80 msgr2=0x7ffa30168860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa37073700 1 --2- 172.21.15.31:0/334148441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa3015da80 0x7ffa30168860 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009f20 tx=0x7ffa28009840 comp rx=0 tx=0).stop 2024-08-17T02:28:02.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa37073700 1 -- 172.21.15.31:0/334148441 shutdown_connections 2024-08-17T02:28:02.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa37073700 1 --2- 172.21.15.31:0/334148441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa3015da80 0x7ffa30168860 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa37073700 1 -- 172.21.15.31:0/334148441 >> 172.21.15.31:0/334148441 conn(0x7ffa30067400 msgr2=0x7ffa30067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa37073700 1 -- 172.21.15.31:0/334148441 shutdown_connections 2024-08-17T02:28:02.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa37073700 1 -- 172.21.15.31:0/334148441 wait complete. 2024-08-17T02:28:02.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa37073700 1 Processor -- start 2024-08-17T02:28:02.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.323+0000 7ffa37073700 1 -- start start 2024-08-17T02:28:02.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa37073700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa300691b0 0x7ffa3015def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa37073700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa30069580 0x7ffa300adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa37073700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa3015da80 0x7ffa30135b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa37073700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30145480 con 0x7ffa30069580 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa37073700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3015e5f0 con 0x7ffa3015da80 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa37073700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3015e8d0 con 0x7ffa300691b0 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa35870700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa30069580 0x7ffa300adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa35870700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa30069580 0x7ffa300adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55248/0 (socket says 172.21.15.31:55248) 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa35870700 1 -- 172.21.15.31:0/567764582 learned_addr learned my addr 172.21.15.31:0/567764582 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa36071700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa300691b0 0x7ffa3015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa36872700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa3015da80 0x7ffa30135b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa35870700 1 -- 172.21.15.31:0/567764582 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa300691b0 msgr2=0x7ffa3015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa35870700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa300691b0 0x7ffa3015def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa35870700 1 -- 172.21.15.31:0/567764582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa3015da80 msgr2=0x7ffa30135b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa35870700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa3015da80 0x7ffa30135b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa35870700 1 -- 172.21.15.31:0/567764582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28009ae0 con 0x7ffa30069580 2024-08-17T02:28:02.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa35870700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa30069580 0x7ffa300adb90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000c760 tx=0x7ffa20007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa267fc700 1 -- 172.21.15.31:0/567764582 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20005a70 con 0x7ffa30069580 2024-08-17T02:28:02.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa267fc700 1 -- 172.21.15.31:0/567764582 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa20005bf0 con 0x7ffa30069580 2024-08-17T02:28:02.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa37073700 1 -- 172.21.15.31:0/567764582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa30145110 con 0x7ffa30069580 2024-08-17T02:28:02.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa267fc700 1 -- 172.21.15.31:0/567764582 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa200070d0 con 0x7ffa30069580 2024-08-17T02:28:02.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa37073700 1 -- 172.21.15.31:0/567764582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa30136050 con 0x7ffa30069580 2024-08-17T02:28:02.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.327+0000 7ffa37073700 1 -- 172.21.15.31:0/567764582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa30145630 con 0x7ffa30069580 2024-08-17T02:28:02.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.331+0000 7ffa267fc700 1 -- 172.21.15.31:0/567764582 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ffa20007500 con 0x7ffa30069580 2024-08-17T02:28:02.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.331+0000 7ffa267fc700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ffa14060860 0x7ffa14062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.331+0000 7ffa267fc700 1 -- 172.21.15.31:0/567764582 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7ffa2007c450 con 0x7ffa30069580 2024-08-17T02:28:02.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.331+0000 7ffa36071700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ffa14060860 0x7ffa14062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.331+0000 7ffa36071700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ffa14060860 0x7ffa14062d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0011e0 tx=0x7ffa2c007ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.339+0000 7ffa267fc700 1 -- 172.21.15.31:0/567764582 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ffa30145630 con 0x7ffa30069580 2024-08-17T02:28:02.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 -- 172.21.15.31:0/567764582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa301452a0 con 0x7ffa30069580 2024-08-17T02:28:02.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa267fc700 1 -- 172.21.15.31:0/567764582 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5681 (secure 0 0 0) 0x7ffa2004c4b0 con 0x7ffa30069580 2024-08-17T02:28:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:02.548 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1920530016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1920530016},{"type":"v1","addr":"172.21.15.92:6833","nonce":1920530016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3381009547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3381009547},{"type":"v1","addr":"172.21.15.92:6835","nonce":3381009547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:41.765672+0000","modified":"2024-08-17T02:25:44.420703+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6837/1886584780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1886584780},{"type":"v1","addr":"172.21.15.31:6837","nonce":1886584780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:59.737073+0000","modified":"2024-08-17T02:26:01.269310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.31:6836/548139464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":548139464},{"type":"v1","addr":"172.21.15.31:6836","nonce":548139464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000037340","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:02.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 -- 172.21.15.31:0/567764582 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ffa14060860 msgr2=0x7ffa14062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ffa14060860 0x7ffa14062d10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0011e0 tx=0x7ffa2c007ce0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 -- 172.21.15.31:0/567764582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa30069580 msgr2=0x7ffa300adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa30069580 0x7ffa300adb90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000c760 tx=0x7ffa20007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 -- 172.21.15.31:0/567764582 shutdown_connections 2024-08-17T02:28:02.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ffa14060860 0x7ffa14062d10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa3015da80 0x7ffa30135b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa30069580 0x7ffa300adb90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 --2- 172.21.15.31:0/567764582 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa300691b0 0x7ffa3015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 -- 172.21.15.31:0/567764582 >> 172.21.15.31:0/567764582 conn(0x7ffa30067400 msgr2=0x7ffa3006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.543+0000 7ffa37073700 1 -- 172.21.15.31:0/567764582 shutdown_connections 2024-08-17T02:28:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.547+0000 7ffa37073700 1 -- 172.21.15.31:0/567764582 wait complete. 2024-08-17T02:28:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-08-17T02:28:02.563 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:02.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.667+0000 7f31d2ad3700 1 Processor -- start 2024-08-17T02:28:02.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.667+0000 7f31d2ad3700 1 -- start start 2024-08-17T02:28:02.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.667+0000 7f31d2ad3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f31cc154b90 0x7f31cc06ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.667+0000 7f31d2ad3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc157640 0x7f31cc157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.667+0000 7f31d2ad3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc157ff0 con 0x7f31cc0aeeb0 2024-08-17T02:28:02.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.667+0000 7f31d2ad3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc06f450 con 0x7f31cc154b90 2024-08-17T02:28:02.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.667+0000 7f31d2ad3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc06ea80 con 0x7f31cc157640 2024-08-17T02:28:02.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.667+0000 7f31d1070700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f31cc0aeeb0 0x7f31cc0cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49816/0 (socket says 172.21.15.31:49816) 2024-08-17T02:28:02.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.667+0000 7f31d1070700 1 -- 172.21.15.31:0/2329396626 learned_addr learned my addr 172.21.15.31:0/2329396626 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:02.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cbfff700 1 --2- 172.21.15.31:0/2329396626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc157640 0x7f31cc157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31d086f700 1 --2- 172.21.15.31:0/2329396626 >> v2:172.21.15.92:3300/0 conn(0x7f31cc154b90 0x7f31cc06ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cb7fe700 1 -- 172.21.15.31:0/2329396626 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490908236 0 0) 0x7f31cc157ff0 con 0x7f31cc0aeeb0 2024-08-17T02:28:02.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cb7fe700 1 -- 172.21.15.31:0/2329396626 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31bc003570 con 0x7f31cc0aeeb0 2024-08-17T02:28:02.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cbfff700 1 -- 172.21.15.31:0/2329396626 >> v2:172.21.15.92:3300/0 conn(0x7f31cc154b90 msgr2=0x7f31cc06ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cbfff700 1 --2- 172.21.15.31:0/2329396626 >> v2:172.21.15.92:3300/0 conn(0x7f31cc154b90 0x7f31cc06ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cbfff700 1 -- 172.21.15.31:0/2329396626 >> v1:172.21.15.31:6789/0 conn(0x7f31cc0aeeb0 legacy=0x7f31cc0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cbfff700 1 -- 172.21.15.31:0/2329396626 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0b2410 con 0x7f31cc157640 2024-08-17T02:28:02.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cbfff700 1 --2- 172.21.15.31:0/2329396626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc157640 0x7f31cc157ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f31b80098e0 tx=0x7f31b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb57a3a000140033 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cb7fe700 1 -- 172.21.15.31:0/2329396626 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8011630 con 0x7f31cc157640 2024-08-17T02:28:02.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cb7fe700 1 -- 172.21.15.31:0/2329396626 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b8011790 con 0x7f31cc157640 2024-08-17T02:28:02.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31cb7fe700 1 -- 172.21.15.31:0/2329396626 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8011b30 con 0x7f31cc157640 2024-08-17T02:28:02.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31d2ad3700 1 -- 172.21.15.31:0/2329396626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc157640 msgr2=0x7f31cc157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31d2ad3700 1 --2- 172.21.15.31:0/2329396626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc157640 0x7f31cc157ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f31b80098e0 tx=0x7f31b80091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31d2ad3700 1 -- 172.21.15.31:0/2329396626 shutdown_connections 2024-08-17T02:28:02.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31d2ad3700 1 --2- 172.21.15.31:0/2329396626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc157640 0x7f31cc157ab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31d2ad3700 1 --2- 172.21.15.31:0/2329396626 >> v2:172.21.15.92:3300/0 conn(0x7f31cc154b90 0x7f31cc06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31d2ad3700 1 -- 172.21.15.31:0/2329396626 >> 172.21.15.31:0/2329396626 conn(0x7f31cc06a280 msgr2=0x7f31cc06a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31d2ad3700 1 -- 172.21.15.31:0/2329396626 shutdown_connections 2024-08-17T02:28:02.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.671+0000 7f31d2ad3700 1 -- 172.21.15.31:0/2329396626 wait complete. 2024-08-17T02:28:02.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d2ad3700 1 Processor -- start 2024-08-17T02:28:02.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d2ad3700 1 -- start start 2024-08-17T02:28:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d2ad3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31cc0aeeb0 0x7f31cc0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d2ad3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc154b90 0x7f31cc15da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d2ad3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc157640 0x7f31cc1519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d2ad3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1674d0 con 0x7f31cc157640 2024-08-17T02:28:02.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d2ad3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc0b0740 con 0x7f31cc0aeeb0 2024-08-17T02:28:02.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d2ad3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc0b0a20 con 0x7f31cc154b90 2024-08-17T02:28:02.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d1070700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc157640 0x7f31cc1519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31cbfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc154b90 0x7f31cc15da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31cbfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc154b90 0x7f31cc15da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:43276/0 (socket says 172.21.15.31:43276) 2024-08-17T02:28:02.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d086f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31cc0aeeb0 0x7f31cc0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31cbfff700 1 -- 172.21.15.31:0/3286248706 learned_addr learned my addr 172.21.15.31:0/3286248706 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:02.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d1070700 1 -- 172.21.15.31:0/3286248706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc154b90 msgr2=0x7f31cc15da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d1070700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc154b90 0x7f31cc15da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d1070700 1 -- 172.21.15.31:0/3286248706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31cc0aeeb0 msgr2=0x7f31cc0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d1070700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31cc0aeeb0 0x7f31cc0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d1070700 1 -- 172.21.15.31:0/3286248706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8009420 con 0x7f31cc157640 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d086f700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31cc0aeeb0 0x7f31cc0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31cbfff700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc154b90 0x7f31cc15da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d1070700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc157640 0x7f31cc1519f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f31c400cbc0 tx=0x7f31c4001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31c8ff9700 1 -- 172.21.15.31:0/3286248706 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400a7e0 con 0x7f31cc157640 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31c8ff9700 1 -- 172.21.15.31:0/3286248706 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c400a940 con 0x7f31cc157640 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d2ad3700 1 -- 172.21.15.31:0/3286248706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31cc0b0d00 con 0x7f31cc157640 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31c8ff9700 1 -- 172.21.15.31:0/3286248706 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400acc0 con 0x7f31cc157640 2024-08-17T02:28:02.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.675+0000 7f31d2ad3700 1 -- 172.21.15.31:0/3286248706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc151f30 con 0x7f31cc157640 2024-08-17T02:28:02.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.679+0000 7f31d2ad3700 1 -- 172.21.15.31:0/3286248706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc152120 con 0x7f31cc157640 2024-08-17T02:28:02.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.679+0000 7f31c8ff9700 1 -- 172.21.15.31:0/3286248706 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f31c4007300 con 0x7f31cc157640 2024-08-17T02:28:02.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.679+0000 7f31c8ff9700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f31b0060860 0x7f31b0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.679+0000 7f31c8ff9700 1 -- 172.21.15.31:0/3286248706 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f31c407d2d0 con 0x7f31cc157640 2024-08-17T02:28:02.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.679+0000 7f31d086f700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f31b0060860 0x7f31b0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.683+0000 7f31d086f700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f31b0060860 0x7f31b0062d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31c0011480 tx=0x7f31c00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.687+0000 7f31c8ff9700 1 -- 172.21.15.31:0/3286248706 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f31cc152120 con 0x7f31cc157640 2024-08-17T02:28:02.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.851+0000 7f31d2ad3700 1 -- 172.21.15.31:0/3286248706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31cc152120 con 0x7f31cc157640 2024-08-17T02:28:02.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31c8ff9700 1 -- 172.21.15.31:0/3286248706 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18740 (secure 0 0 0) 0x7f31cc152120 con 0x7f31cc157640 2024-08-17T02:28:02.860 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:02.860 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":43,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:26:27.834101+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:40.183864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:40.754356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000037340.meta","create_time":"2024-08-17T02:25:57.739259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000037340"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000037340.data","create_time":"2024-08-17T02:25:58.749832+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000037340"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.3e","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31d2ad3700 1 -- 172.21.15.31:0/3286248706 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f31b0060860 msgr2=0x7f31b0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31d2ad3700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f31b0060860 0x7f31b0062d10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f31c0011480 tx=0x7f31c00091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31d2ad3700 1 -- 172.21.15.31:0/3286248706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc157640 msgr2=0x7f31cc1519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31d2ad3700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc157640 0x7f31cc1519f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f31c400cbc0 tx=0x7f31c4001a20 comp rx=0 tx=0).stop 2024-08-17T02:28:02.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31d2ad3700 1 -- 172.21.15.31:0/3286248706 shutdown_connections 2024-08-17T02:28:02.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31d2ad3700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f31b0060860 0x7f31b0062d10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31d2ad3700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31cc157640 0x7f31cc1519f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31d2ad3700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31cc154b90 0x7f31cc15da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31d2ad3700 1 --2- 172.21.15.31:0/3286248706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31cc0aeeb0 0x7f31cc0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.855+0000 7f31d2ad3700 1 -- 172.21.15.31:0/3286248706 >> 172.21.15.31:0/3286248706 conn(0x7f31cc06a280 msgr2=0x7f31cc15b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.859+0000 7f31d2ad3700 1 -- 172.21.15.31:0/3286248706 shutdown_connections 2024-08-17T02:28:02.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.859+0000 7f31d2ad3700 1 -- 172.21.15.31:0/3286248706 wait complete. 2024-08-17T02:28:02.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:40.183864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:40.754356+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000037340.meta', 'create_time': '2024-08-17T02:25:57.739259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000037340'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000037340.data', 'create_time': '2024-08-17T02:25:58.749832+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000037340'}}}] 2024-08-17T02:28:02.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:02.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.987+0000 7f4e7ab61700 1 Processor -- start 2024-08-17T02:28:02.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.987+0000 7f4e7ab61700 1 -- start start 2024-08-17T02:28:02.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e7ab61700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e741591e0 0x7f4e74156440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e7ab61700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4e74068c20 0x7f4e740cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e7ab61700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e740cadf0 con 0x7f4e7406ed10 2024-08-17T02:28:02.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e7ab61700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e740cb0d0 con 0x7f4e74068c20 2024-08-17T02:28:02.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e7ab61700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740cb3b0 con 0x7f4e741591e0 2024-08-17T02:28:02.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e7935e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4e7406ed10 0x7f4e74068510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49818/0 (socket says 172.21.15.31:49818) 2024-08-17T02:28:02.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e7935e700 1 -- 172.21.15.31:0/455595284 learned_addr learned my addr 172.21.15.31:0/455595284 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:02.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e79b5f700 1 --2- 172.21.15.31:0/455595284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e741591e0 0x7f4e74156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e7a360700 1 --2- 172.21.15.31:0/455595284 >> v2:172.21.15.92:3300/0 conn(0x7f4e74068c20 0x7f4e740cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e78b5d700 1 -- 172.21.15.31:0/455595284 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357586522 0 0) 0x7f4e740cadf0 con 0x7f4e7406ed10 2024-08-17T02:28:02.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e78b5d700 1 -- 172.21.15.31:0/455595284 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e60003570 con 0x7f4e7406ed10 2024-08-17T02:28:02.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e79b5f700 1 -- 172.21.15.31:0/455595284 >> v2:172.21.15.92:3300/0 conn(0x7f4e74068c20 msgr2=0x7f4e740cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e79b5f700 1 --2- 172.21.15.31:0/455595284 >> v2:172.21.15.92:3300/0 conn(0x7f4e74068c20 0x7f4e740cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e79b5f700 1 -- 172.21.15.31:0/455595284 >> v1:172.21.15.31:6789/0 conn(0x7f4e7406ed10 legacy=0x7f4e74068510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e79b5f700 1 -- 172.21.15.31:0/455595284 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e740cb690 con 0x7f4e741591e0 2024-08-17T02:28:02.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e79b5f700 1 --2- 172.21.15.31:0/455595284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e741591e0 0x7f4e74156440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e700098e0 tx=0x7f4e700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e54d3644cb1a7aa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e78b5d700 1 -- 172.21.15.31:0/455595284 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70011630 con 0x7f4e741591e0 2024-08-17T02:28:02.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e78b5d700 1 -- 172.21.15.31:0/455595284 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e70011790 con 0x7f4e741591e0 2024-08-17T02:28:02.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.991+0000 7f4e78b5d700 1 -- 172.21.15.31:0/455595284 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70011b30 con 0x7f4e741591e0 2024-08-17T02:28:02.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.995+0000 7f4e7ab61700 1 -- 172.21.15.31:0/455595284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e741591e0 msgr2=0x7f4e74156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.995+0000 7f4e7ab61700 1 --2- 172.21.15.31:0/455595284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e741591e0 0x7f4e74156440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4e700098e0 tx=0x7f4e700091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.995+0000 7f4e7ab61700 1 -- 172.21.15.31:0/455595284 shutdown_connections 2024-08-17T02:28:02.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.995+0000 7f4e7ab61700 1 --2- 172.21.15.31:0/455595284 >> v2:172.21.15.92:3300/0 conn(0x7f4e74068c20 0x7f4e740cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.995+0000 7f4e7ab61700 1 --2- 172.21.15.31:0/455595284 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e741591e0 0x7f4e74156440 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.995+0000 7f4e7ab61700 1 -- 172.21.15.31:0/455595284 >> 172.21.15.31:0/455595284 conn(0x7f4e7406a0c0 msgr2=0x7f4e7406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.995+0000 7f4e7ab61700 1 -- 172.21.15.31:0/455595284 shutdown_connections 2024-08-17T02:28:03.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.995+0000 7f4e7ab61700 1 -- 172.21.15.31:0/455595284 wait complete. 2024-08-17T02:28:03.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.995+0000 7f4e7ab61700 1 Processor -- start 2024-08-17T02:28:03.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.995+0000 7f4e7ab61700 1 -- start start 2024-08-17T02:28:03.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7ab61700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e74068c20 0x7f4e741548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7ab61700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e7406ed10 0x7f4e740c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7ab61700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e741591e0 0x7f4e740c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7ab61700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74154de0 con 0x7f4e741591e0 2024-08-17T02:28:03.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7ab61700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740c2560 con 0x7f4e74068c20 2024-08-17T02:28:03.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7ab61700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740c2820 con 0x7f4e7406ed10 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7a360700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e741591e0 0x7f4e740c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7a360700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e741591e0 0x7f4e740c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55272/0 (socket says 172.21.15.31:55272) 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7a360700 1 -- 172.21.15.31:0/1195954623 learned_addr learned my addr 172.21.15.31:0/1195954623 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e79b5f700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e74068c20 0x7f4e741548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7935e700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e7406ed10 0x7f4e740c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7a360700 1 -- 172.21.15.31:0/1195954623 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e7406ed10 msgr2=0x7f4e740c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7a360700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e7406ed10 0x7f4e740c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7a360700 1 -- 172.21.15.31:0/1195954623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e74068c20 msgr2=0x7f4e741548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7a360700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e74068c20 0x7f4e741548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7a360700 1 -- 172.21.15.31:0/1195954623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e70009420 con 0x7f4e741591e0 2024-08-17T02:28:03.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7a360700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e741591e0 0x7f4e740c35e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009ec0 tx=0x7f4e6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e65ffb700 1 -- 172.21.15.31:0/1195954623 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c00cc20 con 0x7f4e741591e0 2024-08-17T02:28:03.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7ab61700 1 -- 172.21.15.31:0/1195954623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e740c2b00 con 0x7f4e741591e0 2024-08-17T02:28:03.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e65ffb700 1 -- 172.21.15.31:0/1195954623 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c00f040 con 0x7f4e741591e0 2024-08-17T02:28:03.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7ab61700 1 -- 172.21.15.31:0/1195954623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e740c30c0 con 0x7f4e741591e0 2024-08-17T02:28:03.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e65ffb700 1 -- 172.21.15.31:0/1195954623 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c014480 con 0x7f4e741591e0 2024-08-17T02:28:03.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e7ab61700 1 -- 172.21.15.31:0/1195954623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e740c32e0 con 0x7f4e741591e0 2024-08-17T02:28:03.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:02.999+0000 7f4e65ffb700 1 -- 172.21.15.31:0/1195954623 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4e6c014830 con 0x7f4e741591e0 2024-08-17T02:28:03.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.003+0000 7f4e65ffb700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e58060890 0x7f4e58062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.003+0000 7f4e65ffb700 1 -- 172.21.15.31:0/1195954623 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4e6c07dcc0 con 0x7f4e741591e0 2024-08-17T02:28:03.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.003+0000 7f4e79b5f700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e58060890 0x7f4e58062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.003+0000 7f4e79b5f700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e58060890 0x7f4e58062d40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4e700091e0 tx=0x7f4e70017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.011+0000 7f4e65ffb700 1 -- 172.21.15.31:0/1195954623 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4e6c084080 con 0x7f4e741591e0 2024-08-17T02:28:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 -- 172.21.15.31:0/1195954623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e740712b0 con 0x7f4e741591e0 2024-08-17T02:28:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e65ffb700 1 -- 172.21.15.31:0/1195954623 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e6c018020 con 0x7f4e741591e0 2024-08-17T02:28:03.175 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:28:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 -- 172.21.15.31:0/1195954623 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e58060890 msgr2=0x7f4e58062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e58060890 0x7f4e58062d40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4e700091e0 tx=0x7f4e70017000 comp rx=0 tx=0).stop 2024-08-17T02:28:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 -- 172.21.15.31:0/1195954623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e741591e0 msgr2=0x7f4e740c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e741591e0 0x7f4e740c35e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009ec0 tx=0x7f4e6c00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 -- 172.21.15.31:0/1195954623 shutdown_connections 2024-08-17T02:28:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e58060890 0x7f4e58062d40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e741591e0 0x7f4e740c35e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e7406ed10 0x7f4e740c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 --2- 172.21.15.31:0/1195954623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e74068c20 0x7f4e741548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 -- 172.21.15.31:0/1195954623 >> 172.21.15.31:0/1195954623 conn(0x7f4e7406a0c0 msgr2=0x7f4e740b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 -- 172.21.15.31:0/1195954623 shutdown_connections 2024-08-17T02:28:03.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.171+0000 7f4e7ab61700 1 -- 172.21.15.31:0/1195954623 wait complete. 2024-08-17T02:28:03.190 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:03.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.299+0000 7fb8e183d700 1 Processor -- start 2024-08-17T02:28:03.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.299+0000 7fb8e183d700 1 -- start start 2024-08-17T02:28:03.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc0b4340 0x7fb8dc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc0b2a60 con 0x7fb8dc159330 2024-08-17T02:28:03.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8dc0b11b0 con 0x7fb8dc159700 2024-08-17T02:28:03.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc0b1490 con 0x7fb8dc0b4340 2024-08-17T02:28:03.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8daffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb8dc159330 0x7fb8dc0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49830/0 (socket says 172.21.15.31:49830) 2024-08-17T02:28:03.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8daffd700 1 -- 172.21.15.31:0/2257798494 learned_addr learned my addr 172.21.15.31:0/2257798494 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:03.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8da7fc700 1 --2- 172.21.15.31:0/2257798494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc0b4340 0x7fb8dc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8d9ffb700 1 -- 172.21.15.31:0/2257798494 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374151525 0 0) 0x7fb8dc0b2a60 con 0x7fb8dc159330 2024-08-17T02:28:03.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8d9ffb700 1 -- 172.21.15.31:0/2257798494 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8c4003570 con 0x7fb8dc159330 2024-08-17T02:28:03.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8d9ffb700 1 -- 172.21.15.31:0/2257798494 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023775688 0 0) 0x7fb8dc0b11b0 con 0x7fb8dc159700 2024-08-17T02:28:03.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8d9ffb700 1 -- 172.21.15.31:0/2257798494 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8dc0b2a60 con 0x7fb8dc159700 2024-08-17T02:28:03.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8da7fc700 1 -- 172.21.15.31:0/2257798494 >> v1:172.21.15.92:6789/0 conn(0x7fb8dc159700 legacy=0x7fb8dc0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8da7fc700 1 -- 172.21.15.31:0/2257798494 >> v1:172.21.15.31:6789/0 conn(0x7fb8dc159330 legacy=0x7fb8dc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8da7fc700 1 -- 172.21.15.31:0/2257798494 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc0b1770 con 0x7fb8dc0b4340 2024-08-17T02:28:03.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8da7fc700 1 --2- 172.21.15.31:0/2257798494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc0b4340 0x7fb8dc0b0530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009910 tx=0x7fb8cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f93cde243148b5d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8d9ffb700 1 -- 172.21.15.31:0/2257798494 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc011630 con 0x7fb8dc0b4340 2024-08-17T02:28:03.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8d9ffb700 1 -- 172.21.15.31:0/2257798494 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc011790 con 0x7fb8dc0b4340 2024-08-17T02:28:03.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8d9ffb700 1 -- 172.21.15.31:0/2257798494 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc011b30 con 0x7fb8dc0b4340 2024-08-17T02:28:03.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 -- 172.21.15.31:0/2257798494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc0b4340 msgr2=0x7fb8dc0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 --2- 172.21.15.31:0/2257798494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc0b4340 0x7fb8dc0b0530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009910 tx=0x7fb8cc0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 -- 172.21.15.31:0/2257798494 shutdown_connections 2024-08-17T02:28:03.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 --2- 172.21.15.31:0/2257798494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc0b4340 0x7fb8dc0b0530 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 -- 172.21.15.31:0/2257798494 >> 172.21.15.31:0/2257798494 conn(0x7fb8dc099610 msgr2=0x7fb8dc067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 -- 172.21.15.31:0/2257798494 shutdown_connections 2024-08-17T02:28:03.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.303+0000 7fb8e183d700 1 -- 172.21.15.31:0/2257798494 wait complete. 2024-08-17T02:28:03.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8e183d700 1 Processor -- start 2024-08-17T02:28:03.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8e183d700 1 -- start start 2024-08-17T02:28:03.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8e183d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8dc0b4340 0x7fb8dc14b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8e183d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc159330 0x7fb8dc14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8e183d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8dc159700 0x7fb8dc150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8e183d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc1529c0 con 0x7fb8dc0b4340 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8e183d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc153020 con 0x7fb8dc159700 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8e183d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc1535e0 con 0x7fb8dc159330 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8daffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8dc0b4340 0x7fb8dc14b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8daffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8dc0b4340 0x7fb8dc14b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55276/0 (socket says 172.21.15.31:55276) 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8daffd700 1 -- 172.21.15.31:0/474794769 learned_addr learned my addr 172.21.15.31:0/474794769 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8da7fc700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc159330 0x7fb8dc14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8db7fe700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8dc159700 0x7fb8dc150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8daffd700 1 -- 172.21.15.31:0/474794769 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc159330 msgr2=0x7fb8dc14e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8daffd700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc159330 0x7fb8dc14e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8daffd700 1 -- 172.21.15.31:0/474794769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8dc159700 msgr2=0x7fb8dc150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8daffd700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8dc159700 0x7fb8dc150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8daffd700 1 -- 172.21.15.31:0/474794769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009420 con 0x7fb8dc0b4340 2024-08-17T02:28:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8daffd700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8dc0b4340 0x7fb8dc14b970 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c7c0 tx=0x7fb8d0007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.307+0000 7fb8c2ffd700 1 -- 172.21.15.31:0/474794769 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0005b30 con 0x7fb8dc0b4340 2024-08-17T02:28:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.311+0000 7fb8c2ffd700 1 -- 172.21.15.31:0/474794769 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d0005cd0 con 0x7fb8dc0b4340 2024-08-17T02:28:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.311+0000 7fb8e183d700 1 -- 172.21.15.31:0/474794769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8dc14deb0 con 0x7fb8dc0b4340 2024-08-17T02:28:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.311+0000 7fb8c2ffd700 1 -- 172.21.15.31:0/474794769 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0007320 con 0x7fb8dc0b4340 2024-08-17T02:28:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.311+0000 7fb8e183d700 1 -- 172.21.15.31:0/474794769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8dc153270 con 0x7fb8dc0b4340 2024-08-17T02:28:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.311+0000 7fb8c2ffd700 1 -- 172.21.15.31:0/474794769 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb8d0007690 con 0x7fb8dc0b4340 2024-08-17T02:28:03.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.311+0000 7fb8e183d700 1 -- 172.21.15.31:0/474794769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8dc0712b0 con 0x7fb8dc0b4340 2024-08-17T02:28:03.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.311+0000 7fb8c2ffd700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb8c8060860 0x7fb8c8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.311+0000 7fb8da7fc700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb8c8060860 0x7fb8c8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.311+0000 7fb8c2ffd700 1 -- 172.21.15.31:0/474794769 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fb8d007c3e0 con 0x7fb8dc0b4340 2024-08-17T02:28:03.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.315+0000 7fb8da7fc700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb8c8060860 0x7fb8c8062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009860 tx=0x7fb8cc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.315+0000 7fb8c2ffd700 1 -- 172.21.15.31:0/474794769 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb8d004a480 con 0x7fb8dc0b4340 2024-08-17T02:28:03.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.483+0000 7fb8e183d700 1 -- 172.21.15.31:0/474794769 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8dc154e20 con 0x7fb8dc0b4340 2024-08-17T02:28:03.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.483+0000 7fb8c2ffd700 1 -- 172.21.15.31:0/474794769 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8d004c450 con 0x7fb8dc0b4340 2024-08-17T02:28:03.488 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:28:03.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 -- 172.21.15.31:0/474794769 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb8c8060860 msgr2=0x7fb8c8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb8c8060860 0x7fb8c8062d10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009860 tx=0x7fb8cc017000 comp rx=0 tx=0).stop 2024-08-17T02:28:03.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 -- 172.21.15.31:0/474794769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8dc0b4340 msgr2=0x7fb8dc14b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8dc0b4340 0x7fb8dc14b970 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c7c0 tx=0x7fb8d0007e80 comp rx=0 tx=0).stop 2024-08-17T02:28:03.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 -- 172.21.15.31:0/474794769 shutdown_connections 2024-08-17T02:28:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb8c8060860 0x7fb8c8062d10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8dc159700 0x7fb8dc150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb8dc159330 0x7fb8dc14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 --2- 172.21.15.31:0/474794769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8dc0b4340 0x7fb8dc14b970 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 -- 172.21.15.31:0/474794769 >> 172.21.15.31:0/474794769 conn(0x7fb8dc099610 msgr2=0x7fb8dc15c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 -- 172.21.15.31:0/474794769 shutdown_connections 2024-08-17T02:28:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.487+0000 7fb8e183d700 1 -- 172.21.15.31:0/474794769 wait complete. 2024-08-17T02:28:03.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:03.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabe4e8d700 1 Processor -- start 2024-08-17T02:28:03.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabe4e8d700 1 -- start start 2024-08-17T02:28:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabe4e8d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0158e90 0x7fabe015d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabe4e8d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fabe0067400 0x7fabe0067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabe4e8d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe00b20b0 con 0x7fabe0068c20 2024-08-17T02:28:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabe4e8d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe006e200 con 0x7fabe0067400 2024-08-17T02:28:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabe4e8d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe0067d80 con 0x7fabe0158e90 2024-08-17T02:28:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabdeffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fabe0068c20 0x7fabe0159260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49840/0 (socket says 172.21.15.31:49840) 2024-08-17T02:28:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabdeffd700 1 -- 172.21.15.31:0/3310115611 learned_addr learned my addr 172.21.15.31:0/3310115611 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabdffff700 1 --2- 172.21.15.31:0/3310115611 >> v2:172.21.15.92:3300/0 conn(0x7fabe0067400 0x7fabe0067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabdf7fe700 1 --2- 172.21.15.31:0/3310115611 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0158e90 0x7fabe015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabde7fc700 1 -- 172.21.15.31:0/3310115611 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736116436 0 0) 0x7fabe00b20b0 con 0x7fabe0068c20 2024-08-17T02:28:03.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.615+0000 7fabde7fc700 1 -- 172.21.15.31:0/3310115611 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc8003570 con 0x7fabe0068c20 2024-08-17T02:28:03.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabdf7fe700 1 -- 172.21.15.31:0/3310115611 >> v2:172.21.15.92:3300/0 conn(0x7fabe0067400 msgr2=0x7fabe0067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabdf7fe700 1 --2- 172.21.15.31:0/3310115611 >> v2:172.21.15.92:3300/0 conn(0x7fabe0067400 0x7fabe0067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabdf7fe700 1 -- 172.21.15.31:0/3310115611 >> v1:172.21.15.31:6789/0 conn(0x7fabe0068c20 legacy=0x7fabe0159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabdf7fe700 1 -- 172.21.15.31:0/3310115611 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe015dc60 con 0x7fabe0158e90 2024-08-17T02:28:03.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabdffff700 1 --2- 172.21.15.31:0/3310115611 >> v2:172.21.15.92:3300/0 conn(0x7fabe0067400 0x7fabe0067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:03.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabdf7fe700 1 --2- 172.21.15.31:0/3310115611 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0158e90 0x7fabe015d720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fabd40098e0 tx=0x7fabd40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3cb04d6bc2bdeb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabde7fc700 1 -- 172.21.15.31:0/3310115611 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4011630 con 0x7fabe0158e90 2024-08-17T02:28:03.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabde7fc700 1 -- 172.21.15.31:0/3310115611 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd4011790 con 0x7fabe0158e90 2024-08-17T02:28:03.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabde7fc700 1 -- 172.21.15.31:0/3310115611 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4011b30 con 0x7fabe0158e90 2024-08-17T02:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3310115611 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0158e90 msgr2=0x7fabe015d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabe4e8d700 1 --2- 172.21.15.31:0/3310115611 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0158e90 0x7fabe015d720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fabd40098e0 tx=0x7fabd40091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3310115611 shutdown_connections 2024-08-17T02:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabe4e8d700 1 --2- 172.21.15.31:0/3310115611 >> v2:172.21.15.92:3300/0 conn(0x7fabe0067400 0x7fabe0067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabe4e8d700 1 --2- 172.21.15.31:0/3310115611 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0158e90 0x7fabe015d720 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3310115611 >> 172.21.15.31:0/3310115611 conn(0x7fabe006bbb0 msgr2=0x7fabe0068510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3310115611 shutdown_connections 2024-08-17T02:28:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.619+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3310115611 wait complete. 2024-08-17T02:28:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabe4e8d700 1 Processor -- start 2024-08-17T02:28:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabe4e8d700 1 -- start start 2024-08-17T02:28:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabe4e8d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0067400 0x7fabe014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabe4e8d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe0068c20 0x7fabe014ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabe4e8d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe0158e90 0x7fabe00ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabe4e8d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe016d4f0 con 0x7fabe0068c20 2024-08-17T02:28:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabe4e8d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe016c920 con 0x7fabe0158e90 2024-08-17T02:28:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabe4e8d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe016cbc0 con 0x7fabe0067400 2024-08-17T02:28:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabdeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe0068c20 0x7fabe014ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabdeffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe0068c20 0x7fabe014ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55278/0 (socket says 172.21.15.31:55278) 2024-08-17T02:28:03.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabdeffd700 1 -- 172.21.15.31:0/3618940316 learned_addr learned my addr 172.21.15.31:0/3618940316 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:03.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabdffff700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe0158e90 0x7fabe00ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.623+0000 7fabdf7fe700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0067400 0x7fabe014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabdeffd700 1 -- 172.21.15.31:0/3618940316 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0067400 msgr2=0x7fabe014bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabdeffd700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0067400 0x7fabe014bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabdeffd700 1 -- 172.21.15.31:0/3618940316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe0158e90 msgr2=0x7fabe00ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabdeffd700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe0158e90 0x7fabe00ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabdeffd700 1 -- 172.21.15.31:0/3618940316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009a20 con 0x7fabe0068c20 2024-08-17T02:28:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabdeffd700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe0068c20 0x7fabe014ae10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fabd000c7c0 tx=0x7fabd0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabc77fe700 1 -- 172.21.15.31:0/3618940316 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0005c00 con 0x7fabe0068c20 2024-08-17T02:28:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabc77fe700 1 -- 172.21.15.31:0/3618940316 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0005d60 con 0x7fabe0068c20 2024-08-17T02:28:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3618940316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd4009420 con 0x7fabe0068c20 2024-08-17T02:28:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabc77fe700 1 -- 172.21.15.31:0/3618940316 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0007300 con 0x7fabe0068c20 2024-08-17T02:28:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3618940316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe014b350 con 0x7fabe0068c20 2024-08-17T02:28:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.627+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3618940316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe016d660 con 0x7fabe0068c20 2024-08-17T02:28:03.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.631+0000 7fabc77fe700 1 -- 172.21.15.31:0/3618940316 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fabd001b3b0 con 0x7fabe0068c20 2024-08-17T02:28:03.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.631+0000 7fabc77fe700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabcc060860 0x7fabcc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.631+0000 7fabc77fe700 1 -- 172.21.15.31:0/3618940316 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fabd007c470 con 0x7fabe0068c20 2024-08-17T02:28:03.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.631+0000 7fabdf7fe700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabcc060860 0x7fabcc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.631+0000 7fabdf7fe700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabcc060860 0x7fabcc062d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fabd40091e0 tx=0x7fabd4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.639+0000 7fabc77fe700 1 -- 172.21.15.31:0/3618940316 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fabd004c590 con 0x7fabe0068c20 2024-08-17T02:28:03.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.807+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3618940316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabe00712b0 con 0x7fabe0068c20 2024-08-17T02:28:03.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabc77fe700 1 -- 172.21.15.31:0/3618940316 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabd004fbb0 con 0x7fabe0068c20 2024-08-17T02:28:03.814 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-08-17T02:28:03.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3618940316 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabcc060860 msgr2=0x7fabcc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabcc060860 0x7fabcc062d10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fabd40091e0 tx=0x7fabd4017000 comp rx=0 tx=0).stop 2024-08-17T02:28:03.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3618940316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe0068c20 msgr2=0x7fabe014ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe0068c20 0x7fabe014ae10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fabd000c7c0 tx=0x7fabd0007dd0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3618940316 shutdown_connections 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabcc060860 0x7fabcc062d10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe0158e90 0x7fabe00ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabe0068c20 0x7fabe014ae10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 --2- 172.21.15.31:0/3618940316 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabe0067400 0x7fabe014bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3618940316 >> 172.21.15.31:0/3618940316 conn(0x7fabe006bbb0 msgr2=0x7fabe00adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3618940316 shutdown_connections 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.811+0000 7fabe4e8d700 1 -- 172.21.15.31:0/3618940316 wait complete. 2024-08-17T02:28:03.829 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000037340.meta pg_num 2024-08-17T02:28:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.939+0000 7f4e5a273700 1 Processor -- start 2024-08-17T02:28:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.939+0000 7f4e5a273700 1 -- start start 2024-08-17T02:28:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e5a273700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4e541596c0 0x7f4e540cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e5a273700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5415a780 con 0x7f4e540cce80 2024-08-17T02:28:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e5a273700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5415ac10 con 0x7f4e541592f0 2024-08-17T02:28:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e5a273700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540cb870 con 0x7f4e541596c0 2024-08-17T02:28:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e59a72700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4e540cce80 0x7f4e540ce240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49844/0 (socket says 172.21.15.31:49844) 2024-08-17T02:28:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e59a72700 1 -- 172.21.15.31:0/748841656 learned_addr learned my addr 172.21.15.31:0/748841656 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e58a70700 1 --2- 172.21.15.31:0/748841656 >> v2:172.21.15.92:3300/0 conn(0x7f4e541596c0 0x7f4e540cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e4bfff700 1 -- 172.21.15.31:0/748841656 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361217344 0 0) 0x7f4e5415a780 con 0x7f4e540cce80 2024-08-17T02:28:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e4bfff700 1 -- 172.21.15.31:0/748841656 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e40003570 con 0x7f4e540cce80 2024-08-17T02:28:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e58a70700 1 -- 172.21.15.31:0/748841656 >> v1:172.21.15.92:6789/0 conn(0x7f4e541592f0 legacy=0x7f4e540cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e58a70700 1 -- 172.21.15.31:0/748841656 >> v1:172.21.15.31:6789/0 conn(0x7f4e540cce80 legacy=0x7f4e540ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e4bfff700 1 -- 172.21.15.31:0/748841656 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1177316241 0 0) 0x7f4e40003570 con 0x7f4e540cce80 2024-08-17T02:28:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e58a70700 1 -- 172.21.15.31:0/748841656 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e54159b70 con 0x7f4e541596c0 2024-08-17T02:28:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e58a70700 1 --2- 172.21.15.31:0/748841656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e541596c0 0x7f4e540cc940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e500098e0 tx=0x7f4e500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b6a6e29c3246873 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e4bfff700 1 -- 172.21.15.31:0/748841656 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0017f0 con 0x7f4e541596c0 2024-08-17T02:28:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e4bfff700 1 -- 172.21.15.31:0/748841656 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e50011420 con 0x7f4e541596c0 2024-08-17T02:28:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e4bfff700 1 -- 172.21.15.31:0/748841656 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500117a0 con 0x7f4e541596c0 2024-08-17T02:28:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e5a273700 1 -- 172.21.15.31:0/748841656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e541596c0 msgr2=0x7f4e540cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e5a273700 1 --2- 172.21.15.31:0/748841656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e541596c0 0x7f4e540cc940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e500098e0 tx=0x7f4e500091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e5a273700 1 -- 172.21.15.31:0/748841656 shutdown_connections 2024-08-17T02:28:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e5a273700 1 --2- 172.21.15.31:0/748841656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e541596c0 0x7f4e540cc940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e5a273700 1 -- 172.21.15.31:0/748841656 >> 172.21.15.31:0/748841656 conn(0x7f4e54067400 msgr2=0x7f4e54067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.943+0000 7f4e5a273700 1 -- 172.21.15.31:0/748841656 shutdown_connections 2024-08-17T02:28:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e5a273700 1 -- 172.21.15.31:0/748841656 wait complete. 2024-08-17T02:28:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e5a273700 1 Processor -- start 2024-08-17T02:28:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e5a273700 1 -- start start 2024-08-17T02:28:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e5a273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e540cce80 0x7f4e540b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e5a273700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e541592f0 0x7f4e5414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e5a273700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e541596c0 0x7f4e5414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e5a273700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5414f5f0 con 0x7f4e541592f0 2024-08-17T02:28:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e5a273700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5414ed20 con 0x7f4e540cce80 2024-08-17T02:28:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e5a273700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5416da80 con 0x7f4e541596c0 2024-08-17T02:28:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e58a70700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e541592f0 0x7f4e5414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e58a70700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e541592f0 0x7f4e5414ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55286/0 (socket says 172.21.15.31:55286) 2024-08-17T02:28:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e58a70700 1 -- 172.21.15.31:0/523409614 learned_addr learned my addr 172.21.15.31:0/523409614 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e59271700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e540cce80 0x7f4e540b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e59a72700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e541596c0 0x7f4e5414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e58a70700 1 -- 172.21.15.31:0/523409614 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e541596c0 msgr2=0x7f4e5414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e58a70700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e541596c0 0x7f4e5414fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e58a70700 1 -- 172.21.15.31:0/523409614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e540cce80 msgr2=0x7f4e540b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e58a70700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e540cce80 0x7f4e540b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.947+0000 7f4e58a70700 1 -- 172.21.15.31:0/523409614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50009420 con 0x7f4e541592f0 2024-08-17T02:28:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.951+0000 7f4e58a70700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e541592f0 0x7f4e5414ad90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4e5415ada0 tx=0x7f4e50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.951+0000 7f4e497fa700 1 -- 172.21.15.31:0/523409614 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5001cc30 con 0x7f4e541592f0 2024-08-17T02:28:03.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.951+0000 7f4e497fa700 1 -- 172.21.15.31:0/523409614 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5001cd90 con 0x7f4e541592f0 2024-08-17T02:28:03.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.951+0000 7f4e497fa700 1 -- 172.21.15.31:0/523409614 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5001a6a0 con 0x7f4e541592f0 2024-08-17T02:28:03.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.951+0000 7f4e5a273700 1 -- 172.21.15.31:0/523409614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5414efa0 con 0x7f4e541592f0 2024-08-17T02:28:03.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.951+0000 7f4e5a273700 1 -- 172.21.15.31:0/523409614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5416d6e0 con 0x7f4e541592f0 2024-08-17T02:28:03.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.951+0000 7f4e5a273700 1 -- 172.21.15.31:0/523409614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5414f760 con 0x7f4e541592f0 2024-08-17T02:28:03.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.951+0000 7f4e497fa700 1 -- 172.21.15.31:0/523409614 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4e5001aa90 con 0x7f4e541592f0 2024-08-17T02:28:03.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.955+0000 7f4e497fa700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e38060890 0x7f4e38062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.955+0000 7f4e59271700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e38060890 0x7f4e38062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.955+0000 7f4e497fa700 1 -- 172.21.15.31:0/523409614 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f4e5007e790 con 0x7f4e541592f0 2024-08-17T02:28:03.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.955+0000 7f4e59271700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e38060890 0x7f4e38062d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4e44003a80 tx=0x7f4e44007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:03.959+0000 7f4e497fa700 1 -- 172.21.15.31:0/523409614 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4e5004e7f0 con 0x7f4e541592f0 2024-08-17T02:28:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.123+0000 7f4e5a273700 1 -- 172.21.15.31:0/523409614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000037340.meta", "var": "pg_num"} v 0) v1 -- 0x7f4e540712b0 con 0x7f4e541592f0 2024-08-17T02:28:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.123+0000 7f4e497fa700 1 -- 172.21.15.31:0/523409614 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000037340.meta", "var": "pg_num"}]=0 v43) v1 ==== 124+0+11 (secure 0 0 0) 0x7f4e50051e10 con 0x7f4e541592f0 2024-08-17T02:28:04.129 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:28:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 -- 172.21.15.31:0/523409614 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e38060890 msgr2=0x7f4e38062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e38060890 0x7f4e38062d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4e44003a80 tx=0x7f4e44007ec0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 -- 172.21.15.31:0/523409614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e541592f0 msgr2=0x7f4e5414ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e541592f0 0x7f4e5414ad90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4e5415ada0 tx=0x7f4e50016000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 -- 172.21.15.31:0/523409614 shutdown_connections 2024-08-17T02:28:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4e38060890 0x7f4e38062d40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e541596c0 0x7f4e5414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e541592f0 0x7f4e5414ad90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 --2- 172.21.15.31:0/523409614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e540cce80 0x7f4e540b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 -- 172.21.15.31:0/523409614 >> 172.21.15.31:0/523409614 conn(0x7f4e54067400 msgr2=0x7f4e540c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 -- 172.21.15.31:0/523409614 shutdown_connections 2024-08-17T02:28:04.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.127+0000 7f4e5a273700 1 -- 172.21.15.31:0/523409614 wait complete. 2024-08-17T02:28:04.144 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000037340.data pg_num 2024-08-17T02:28:04.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036e6a700 1 Processor -- start 2024-08-17T02:28:04.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036e6a700 1 -- start start 2024-08-17T02:28:04.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036e6a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f30301593e0 0x7f30300aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036e6a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3030069ec0 0x7f303006a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036e6a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30300aac70 con 0x7f3030159010 2024-08-17T02:28:04.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036e6a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303006a880 con 0x7f30301593e0 2024-08-17T02:28:04.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036e6a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30300aa060 con 0x7f3030069ec0 2024-08-17T02:28:04.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036669700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3030069ec0 0x7f303006a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3035667700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f30301593e0 0x7f30300aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036669700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3030069ec0 0x7f303006a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:43364/0 (socket says 172.21.15.31:43364) 2024-08-17T02:28:04.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036669700 1 -- 172.21.15.31:0/2018586448 learned_addr learned my addr 172.21.15.31:0/2018586448 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:04.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3035667700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f30301593e0 0x7f30300aff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:37082/0 (socket says 172.21.15.31:37082) 2024-08-17T02:28:04.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3035e68700 1 --1- 172.21.15.31:0/2018586448 >> v1:172.21.15.92:6789/0 conn(0x7f3030159010 0x7f30300a9880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:51650/0 (socket says 172.21.15.31:51650) 2024-08-17T02:28:04.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036669700 1 -- 172.21.15.31:0/2018586448 >> v2:172.21.15.92:3300/0 conn(0x7f30301593e0 msgr2=0x7f30300aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036669700 1 --2- 172.21.15.31:0/2018586448 >> v2:172.21.15.92:3300/0 conn(0x7f30301593e0 0x7f30300aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036669700 1 -- 172.21.15.31:0/2018586448 >> v1:172.21.15.92:6789/0 conn(0x7f3030159010 legacy=0x7f30300a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036669700 1 -- 172.21.15.31:0/2018586448 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30300aa340 con 0x7f3030069ec0 2024-08-17T02:28:04.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.255+0000 7f3036669700 1 --2- 172.21.15.31:0/2018586448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3030069ec0 0x7f303006a340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3028009f20 tx=0x7f3028009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=524030da1f8f07fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3034e66700 1 -- 172.21.15.31:0/2018586448 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302800e070 con 0x7f3030069ec0 2024-08-17T02:28:04.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3034e66700 1 -- 172.21.15.31:0/2018586448 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302800b9d0 con 0x7f3030069ec0 2024-08-17T02:28:04.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3034e66700 1 -- 172.21.15.31:0/2018586448 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30280092e0 con 0x7f3030069ec0 2024-08-17T02:28:04.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3036e6a700 1 -- 172.21.15.31:0/2018586448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3030069ec0 msgr2=0x7f303006a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3036e6a700 1 --2- 172.21.15.31:0/2018586448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3030069ec0 0x7f303006a340 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3028009f20 tx=0x7f3028009840 comp rx=0 tx=0).stop 2024-08-17T02:28:04.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3036e6a700 1 -- 172.21.15.31:0/2018586448 shutdown_connections 2024-08-17T02:28:04.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3036e6a700 1 --2- 172.21.15.31:0/2018586448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3030069ec0 0x7f303006a340 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3036e6a700 1 --2- 172.21.15.31:0/2018586448 >> v2:172.21.15.92:3300/0 conn(0x7f30301593e0 0x7f30300aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3036e6a700 1 -- 172.21.15.31:0/2018586448 >> 172.21.15.31:0/2018586448 conn(0x7f3030067e90 msgr2=0x7f30300cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3036e6a700 1 -- 172.21.15.31:0/2018586448 shutdown_connections 2024-08-17T02:28:04.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3036e6a700 1 -- 172.21.15.31:0/2018586448 wait complete. 2024-08-17T02:28:04.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3036e6a700 1 Processor -- start 2024-08-17T02:28:04.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.259+0000 7f3036e6a700 1 -- start start 2024-08-17T02:28:04.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3036e6a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3030069ec0 0x7f3030156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3036e6a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3030159010 0x7f30301542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3036e6a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30301593e0 0x7f30301547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3036e6a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3030153e90 con 0x7f3030069ec0 2024-08-17T02:28:04.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3036e6a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3030156dc0 con 0x7f3030159010 2024-08-17T02:28:04.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3036e6a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3030157380 con 0x7f30301593e0 2024-08-17T02:28:04.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3035e68700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3030069ec0 0x7f3030156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3035667700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3030159010 0x7f30301542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3035e68700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3030069ec0 0x7f3030156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55302/0 (socket says 172.21.15.31:55302) 2024-08-17T02:28:04.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3035e68700 1 -- 172.21.15.31:0/231733129 learned_addr learned my addr 172.21.15.31:0/231733129 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:04.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3036669700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30301593e0 0x7f30301547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3035667700 1 -- 172.21.15.31:0/231733129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30301593e0 msgr2=0x7f30301547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3035667700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30301593e0 0x7f30301547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3035667700 1 -- 172.21.15.31:0/231733129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3030069ec0 msgr2=0x7f3030156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3035667700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3030069ec0 0x7f3030156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3035667700 1 -- 172.21.15.31:0/231733129 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028009ae0 con 0x7f3030159010 2024-08-17T02:28:04.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3035667700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3030159010 0x7f30301542b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f302000e930 tx=0x7f30200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3025ffb700 1 -- 172.21.15.31:0/231733129 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020009450 con 0x7f3030159010 2024-08-17T02:28:04.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3025ffb700 1 -- 172.21.15.31:0/231733129 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3020013680 con 0x7f3030159010 2024-08-17T02:28:04.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3036e6a700 1 -- 172.21.15.31:0/231733129 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30300cacd0 con 0x7f3030159010 2024-08-17T02:28:04.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3025ffb700 1 -- 172.21.15.31:0/231733129 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020013a40 con 0x7f3030159010 2024-08-17T02:28:04.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3036e6a700 1 -- 172.21.15.31:0/231733129 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30300cb290 con 0x7f3030159010 2024-08-17T02:28:04.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.263+0000 7f3036e6a700 1 -- 172.21.15.31:0/231733129 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30301574f0 con 0x7f3030159010 2024-08-17T02:28:04.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.267+0000 7f3025ffb700 1 -- 172.21.15.31:0/231733129 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3020005a00 con 0x7f3030159010 2024-08-17T02:28:04.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.267+0000 7f3025ffb700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3014060860 0x7f3014062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.267+0000 7f3025ffb700 1 -- 172.21.15.31:0/231733129 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f302007d2c0 con 0x7f3030159010 2024-08-17T02:28:04.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.267+0000 7f3035e68700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3014060860 0x7f3014062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.267+0000 7f3035e68700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3014060860 0x7f3014062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f302c004fd0 tx=0x7f302c007f70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.275+0000 7f3025ffb700 1 -- 172.21.15.31:0/231733129 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3020050db0 con 0x7f3030159010 2024-08-17T02:28:04.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.439+0000 7f3036e6a700 1 -- 172.21.15.31:0/231733129 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000037340.data", "var": "pg_num"} v 0) v1 -- 0x7f30300712b0 con 0x7f3030159010 2024-08-17T02:28:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.439+0000 7f3025ffb700 1 -- 172.21.15.31:0/231733129 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000037340.data", "var": "pg_num"}]=0 v43) v1 ==== 124+0+11 (secure 0 0 0) 0x7f3020050940 con 0x7f3030159010 2024-08-17T02:28:04.444 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:28:04.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 -- 172.21.15.31:0/231733129 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3014060860 msgr2=0x7f3014062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3014060860 0x7f3014062d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f302c004fd0 tx=0x7f302c007f70 comp rx=0 tx=0).stop 2024-08-17T02:28:04.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 -- 172.21.15.31:0/231733129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3030159010 msgr2=0x7f30301542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3030159010 0x7f30301542b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f302000e930 tx=0x7f30200091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 -- 172.21.15.31:0/231733129 shutdown_connections 2024-08-17T02:28:04.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3014060860 0x7f3014062d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30301593e0 0x7f30301547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3030159010 0x7f30301542b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 --2- 172.21.15.31:0/231733129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3030069ec0 0x7f3030156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 -- 172.21.15.31:0/231733129 >> 172.21.15.31:0/231733129 conn(0x7f3030067e90 msgr2=0x7f303015ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 -- 172.21.15.31:0/231733129 shutdown_connections 2024-08-17T02:28:04.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.443+0000 7f3036e6a700 1 -- 172.21.15.31:0/231733129 wait complete. 2024-08-17T02:28:04.465 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:04.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.567+0000 7f48bee4e700 1 Processor -- start 2024-08-17T02:28:04.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.567+0000 7f48bee4e700 1 -- start start 2024-08-17T02:28:04.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f48b815ce20 0x7f48b815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b815b2b0 con 0x7f48b80ad6f0 2024-08-17T02:28:04.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b80ae410 con 0x7f48b815b740 2024-08-17T02:28:04.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b80ae220 con 0x7f48b815ce20 2024-08-17T02:28:04.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bd64b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f48b80ad6f0 0x7f48b80adb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49860/0 (socket says 172.21.15.31:49860) 2024-08-17T02:28:04.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bd64b700 1 -- 172.21.15.31:0/261329470 learned_addr learned my addr 172.21.15.31:0/261329470 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:04.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bde4c700 1 --2- 172.21.15.31:0/261329470 >> v2:172.21.15.92:3300/0 conn(0x7f48b815ce20 0x7f48b815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bce4a700 1 -- 172.21.15.31:0/261329470 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971655494 0 0) 0x7f48b815b2b0 con 0x7f48b80ad6f0 2024-08-17T02:28:04.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bce4a700 1 -- 172.21.15.31:0/261329470 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a4003570 con 0x7f48b80ad6f0 2024-08-17T02:28:04.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bde4c700 1 -- 172.21.15.31:0/261329470 >> v1:172.21.15.92:6789/0 conn(0x7f48b815b740 legacy=0x7f48b815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bde4c700 1 -- 172.21.15.31:0/261329470 >> v1:172.21.15.31:6789/0 conn(0x7f48b80ad6f0 legacy=0x7f48b80adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bde4c700 1 -- 172.21.15.31:0/261329470 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b815aca0 con 0x7f48b815ce20 2024-08-17T02:28:04.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bde4c700 1 --2- 172.21.15.31:0/261329470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b815ce20 0x7f48b815d1f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098e0 tx=0x7f48b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42ac2406dc33085d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bce4a700 1 -- 172.21.15.31:0/261329470 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400b640 con 0x7f48b815ce20 2024-08-17T02:28:04.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bce4a700 1 -- 172.21.15.31:0/261329470 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b400b7a0 con 0x7f48b815ce20 2024-08-17T02:28:04.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bce4a700 1 -- 172.21.15.31:0/261329470 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400bb40 con 0x7f48b815ce20 2024-08-17T02:28:04.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 -- 172.21.15.31:0/261329470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b815ce20 msgr2=0x7f48b815d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 --2- 172.21.15.31:0/261329470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b815ce20 0x7f48b815d1f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098e0 tx=0x7f48b40091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 -- 172.21.15.31:0/261329470 shutdown_connections 2024-08-17T02:28:04.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 --2- 172.21.15.31:0/261329470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b815ce20 0x7f48b815d1f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 -- 172.21.15.31:0/261329470 >> 172.21.15.31:0/261329470 conn(0x7f48b8089cb0 msgr2=0x7f48b80995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 -- 172.21.15.31:0/261329470 shutdown_connections 2024-08-17T02:28:04.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.571+0000 7f48bee4e700 1 -- 172.21.15.31:0/261329470 wait complete. 2024-08-17T02:28:04.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48bee4e700 1 Processor -- start 2024-08-17T02:28:04.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48bee4e700 1 -- start start 2024-08-17T02:28:04.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48bee4e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48b80ad6f0 0x7f48b81697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48bee4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b815b740 0x7f48b81591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48bee4e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b815ce20 0x7f48b816cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48bee4e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8169d00 con 0x7f48b815ce20 2024-08-17T02:28:04.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48bee4e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b816dc30 con 0x7f48b815b740 2024-08-17T02:28:04.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48bee4e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80ccd70 con 0x7f48b80ad6f0 2024-08-17T02:28:04.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48be64d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b815ce20 0x7f48b816cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48be64d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b815ce20 0x7f48b816cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55310/0 (socket says 172.21.15.31:55310) 2024-08-17T02:28:04.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48bde4c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48b80ad6f0 0x7f48b81697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48be64d700 1 -- 172.21.15.31:0/3865326170 learned_addr learned my addr 172.21.15.31:0/3865326170 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:04.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.575+0000 7f48bd64b700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b815b740 0x7f48b81591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48be64d700 1 -- 172.21.15.31:0/3865326170 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48b80ad6f0 msgr2=0x7f48b81697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48be64d700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48b80ad6f0 0x7f48b81697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48be64d700 1 -- 172.21.15.31:0/3865326170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b815b740 msgr2=0x7f48b81591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48be64d700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b815b740 0x7f48b81591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48be64d700 1 -- 172.21.15.31:0/3865326170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4009420 con 0x7f48b815ce20 2024-08-17T02:28:04.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48bd64b700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b815b740 0x7f48b81591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:04.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48be64d700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b815ce20 0x7f48b816cfd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48b000c840 tx=0x7f48b0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48adffb700 1 -- 172.21.15.31:0/3865326170 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0012630 con 0x7f48b815ce20 2024-08-17T02:28:04.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48adffb700 1 -- 172.21.15.31:0/3865326170 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b00127b0 con 0x7f48b815ce20 2024-08-17T02:28:04.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48bee4e700 1 -- 172.21.15.31:0/3865326170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b80cd050 con 0x7f48b815ce20 2024-08-17T02:28:04.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48adffb700 1 -- 172.21.15.31:0/3865326170 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b0012b70 con 0x7f48b815ce20 2024-08-17T02:28:04.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48bee4e700 1 -- 172.21.15.31:0/3865326170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b80cd3e0 con 0x7f48b815ce20 2024-08-17T02:28:04.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.579+0000 7f48bee4e700 1 -- 172.21.15.31:0/3865326170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b80712b0 con 0x7f48b815ce20 2024-08-17T02:28:04.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.583+0000 7f48adffb700 1 -- 172.21.15.31:0/3865326170 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f48b001a3a0 con 0x7f48b815ce20 2024-08-17T02:28:04.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.583+0000 7f48adffb700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f489c060930 0x7f489c062de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.583+0000 7f48adffb700 1 -- 172.21.15.31:0/3865326170 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f48b007d0a0 con 0x7f48b815ce20 2024-08-17T02:28:04.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.583+0000 7f48bde4c700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f489c060930 0x7f489c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.583+0000 7f48bde4c700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f489c060930 0x7f489c062de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f48b40093f0 tx=0x7f48b4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.595+0000 7f48adffb700 1 -- 172.21.15.31:0/3865326170 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f48b004d0e0 con 0x7f48b815ce20 2024-08-17T02:28:04.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.795+0000 7f48bee4e700 1 -- 172.21.15.31:0/3865326170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48b8068280 con 0x7f48b815ce20 2024-08-17T02:28:04.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.795+0000 7f48adffb700 1 -- 172.21.15.31:0/3865326170 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5681 (secure 0 0 0) 0x7f48b0050700 con 0x7f48b815ce20 2024-08-17T02:28:04.801 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:04.802 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1920530016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1920530016},{"type":"v1","addr":"172.21.15.92:6833","nonce":1920530016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3381009547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3381009547},{"type":"v1","addr":"172.21.15.92:6835","nonce":3381009547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:41.765672+0000","modified":"2024-08-17T02:25:44.420703+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6837/1886584780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1886584780},{"type":"v1","addr":"172.21.15.31:6837","nonce":1886584780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:59.737073+0000","modified":"2024-08-17T02:26:01.269310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.31:6836/548139464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":548139464},{"type":"v1","addr":"172.21.15.31:6836","nonce":548139464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000037340","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:04.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 -- 172.21.15.31:0/3865326170 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f489c060930 msgr2=0x7f489c062de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f489c060930 0x7f489c062de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f48b40093f0 tx=0x7f48b4017000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 -- 172.21.15.31:0/3865326170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b815ce20 msgr2=0x7f48b816cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b815ce20 0x7f48b816cfd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48b000c840 tx=0x7f48b0001670 comp rx=0 tx=0).stop 2024-08-17T02:28:04.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 -- 172.21.15.31:0/3865326170 shutdown_connections 2024-08-17T02:28:04.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f489c060930 0x7f489c062de0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48b815ce20 0x7f48b816cfd0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48b815b740 0x7f48b81591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 --2- 172.21.15.31:0/3865326170 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48b80ad6f0 0x7f48b81697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 -- 172.21.15.31:0/3865326170 >> 172.21.15.31:0/3865326170 conn(0x7f48b8089cb0 msgr2=0x7f48b815bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 -- 172.21.15.31:0/3865326170 shutdown_connections 2024-08-17T02:28:04.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.799+0000 7f48bee4e700 1 -- 172.21.15.31:0/3865326170 wait complete. 2024-08-17T02:28:04.806 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-08-17T02:28:04.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:04.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc31dc7700 1 Processor -- start 2024-08-17T02:28:04.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc31dc7700 1 -- start start 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc31dc7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc2c0b2650 0x7fcc2c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc31dc7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc2c067c70 0x7fcc2c0ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc31dc7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcc2c0cb2e0 0x7fcc2c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc31dc7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c0cc420 con 0x7fcc2c0b2650 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc31dc7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c0cb810 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc31dc7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0cbaf0 con 0x7fcc2c067c70 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc30dc5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc2c0b2650 0x7fcc2c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc315c6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcc2c0cb2e0 0x7fcc2c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc30dc5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc2c0b2650 0x7fcc2c0cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55318/0 (socket says 172.21.15.31:55318) 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc315c6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcc2c0cb2e0 0x7fcc2c0ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:37112/0 (socket says 172.21.15.31:37112) 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc30dc5700 1 -- 172.21.15.31:0/3460327539 learned_addr learned my addr 172.21.15.31:0/3460327539 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc2bfff700 1 --2- 172.21.15.31:0/3460327539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc2c067c70 0x7fcc2c0ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc30dc5700 1 -- 172.21.15.31:0/3460327539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc2c067c70 msgr2=0x7fcc2c0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc30dc5700 1 --2- 172.21.15.31:0/3460327539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc2c067c70 0x7fcc2c0ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc30dc5700 1 -- 172.21.15.31:0/3460327539 >> v2:172.21.15.92:3300/0 conn(0x7fcc2c0cb2e0 msgr2=0x7fcc2c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc30dc5700 1 --2- 172.21.15.31:0/3460327539 >> v2:172.21.15.92:3300/0 conn(0x7fcc2c0cb2e0 0x7fcc2c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc30dc5700 1 -- 172.21.15.31:0/3460327539 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c0cbdd0 con 0x7fcc2c0b2650 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.915+0000 7fcc30dc5700 1 --2- 172.21.15.31:0/3460327539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0b2650 0x7fcc2c0cada0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0897a0 tx=0x7fcc1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f40ef254332023 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc2b7fe700 1 -- 172.21.15.31:0/3460327539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00e070 con 0x7fcc2c0b2650 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc2b7fe700 1 -- 172.21.15.31:0/3460327539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c00b970 con 0x7fcc2c0b2650 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc2b7fe700 1 -- 172.21.15.31:0/3460327539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0092e0 con 0x7fcc2c0b2650 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc31dc7700 1 -- 172.21.15.31:0/3460327539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0b2650 msgr2=0x7fcc2c0cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc31dc7700 1 --2- 172.21.15.31:0/3460327539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0b2650 0x7fcc2c0cada0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0897a0 tx=0x7fcc1c009840 comp rx=0 tx=0).stop 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc31dc7700 1 -- 172.21.15.31:0/3460327539 shutdown_connections 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc31dc7700 1 --2- 172.21.15.31:0/3460327539 >> v2:172.21.15.92:3300/0 conn(0x7fcc2c0cb2e0 0x7fcc2c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc31dc7700 1 --2- 172.21.15.31:0/3460327539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc2c067c70 0x7fcc2c0ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc31dc7700 1 --2- 172.21.15.31:0/3460327539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0b2650 0x7fcc2c0cada0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc31dc7700 1 -- 172.21.15.31:0/3460327539 >> 172.21.15.31:0/3460327539 conn(0x7fcc2c089d50 msgr2=0x7fcc2c099670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc31dc7700 1 -- 172.21.15.31:0/3460327539 shutdown_connections 2024-08-17T02:28:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.919+0000 7fcc31dc7700 1 -- 172.21.15.31:0/3460327539 wait complete. 2024-08-17T02:28:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc31dc7700 1 Processor -- start 2024-08-17T02:28:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc31dc7700 1 -- start start 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc31dc7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc2c067c70 0x7fcc2c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc31dc7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c0b2650 0x7fcc2c0b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc31dc7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0cb2e0 0x7fcc2c0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc31dc7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c15bc90 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc31dc7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c15b2f0 con 0x7fcc2c0b2650 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc31dc7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c15b5d0 con 0x7fcc2c067c70 2024-08-17T02:28:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc315c6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0cb2e0 0x7fcc2c0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc315c6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0cb2e0 0x7fcc2c0b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55320/0 (socket says 172.21.15.31:55320) 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc315c6700 1 -- 172.21.15.31:0/1492034839 learned_addr learned my addr 172.21.15.31:0/1492034839 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc2bfff700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c0b2650 0x7fcc2c0b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc30dc5700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc2c067c70 0x7fcc2c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc315c6700 1 -- 172.21.15.31:0/1492034839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc2c067c70 msgr2=0x7fcc2c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc315c6700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc2c067c70 0x7fcc2c0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc315c6700 1 -- 172.21.15.31:0/1492034839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c0b2650 msgr2=0x7fcc2c0b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc315c6700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c0b2650 0x7fcc2c0b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc315c6700 1 -- 172.21.15.31:0/1492034839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c009ae0 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc315c6700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0cb2e0 0x7fcc2c0b55d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400ea50 tx=0x7fcc240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc28ff9700 1 -- 172.21.15.31:0/1492034839 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400ee90 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc31dc7700 1 -- 172.21.15.31:0/1492034839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c15b8b0 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc28ff9700 1 -- 172.21.15.31:0/1492034839 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2400c7f0 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.923+0000 7fcc28ff9700 1 -- 172.21.15.31:0/1492034839 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400cbb0 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.927+0000 7fcc31dc7700 1 -- 172.21.15.31:0/1492034839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c0ca0d0 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.927+0000 7fcc28ff9700 1 -- 172.21.15.31:0/1492034839 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fcc24013470 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.927+0000 7fcc31dc7700 1 -- 172.21.15.31:0/1492034839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c15bdd0 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.927+0000 7fcc28ff9700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcc0c060860 0x7fcc0c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.927+0000 7fcc28ff9700 1 -- 172.21.15.31:0/1492034839 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fcc2407d210 con 0x7fcc2c0cb2e0 2024-08-17T02:28:04.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.927+0000 7fcc30dc5700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcc0c060860 0x7fcc0c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.927+0000 7fcc30dc5700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcc0c060860 0x7fcc0c062d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009880 tx=0x7fcc1c018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:04.935+0000 7fcc28ff9700 1 -- 172.21.15.31:0/1492034839 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fcc2404d270 con 0x7fcc2c0cb2e0 2024-08-17T02:28:05.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.099+0000 7fcc31dc7700 1 -- 172.21.15.31:0/1492034839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc2c0712b0 con 0x7fcc2c0cb2e0 2024-08-17T02:28:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.103+0000 7fcc28ff9700 1 -- 172.21.15.31:0/1492034839 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18740 (secure 0 0 0) 0x7fcc24050890 con 0x7fcc2c0cb2e0 2024-08-17T02:28:05.108 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:05.108 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":43,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:26:27.834101+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:40.183864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:40.754356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000037340.meta","create_time":"2024-08-17T02:25:57.739259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000037340"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000037340.data","create_time":"2024-08-17T02:25:58.749832+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000037340"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.3e","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:05.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.103+0000 7fcc31dc7700 1 -- 172.21.15.31:0/1492034839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcc0c060860 msgr2=0x7fcc0c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.103+0000 7fcc31dc7700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcc0c060860 0x7fcc0c062d10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009880 tx=0x7fcc1c018000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.103+0000 7fcc31dc7700 1 -- 172.21.15.31:0/1492034839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0cb2e0 msgr2=0x7fcc2c0b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.103+0000 7fcc31dc7700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0cb2e0 0x7fcc2c0b55d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400ea50 tx=0x7fcc240091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.107+0000 7fcc31dc7700 1 -- 172.21.15.31:0/1492034839 shutdown_connections 2024-08-17T02:28:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.107+0000 7fcc31dc7700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fcc0c060860 0x7fcc0c062d10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.107+0000 7fcc31dc7700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc2c0cb2e0 0x7fcc2c0b55d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.107+0000 7fcc31dc7700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c0b2650 0x7fcc2c0b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.107+0000 7fcc31dc7700 1 --2- 172.21.15.31:0/1492034839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcc2c067c70 0x7fcc2c0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.107+0000 7fcc31dc7700 1 -- 172.21.15.31:0/1492034839 >> 172.21.15.31:0/1492034839 conn(0x7fcc2c089d50 msgr2=0x7fcc2c0c5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.107+0000 7fcc31dc7700 1 -- 172.21.15.31:0/1492034839 shutdown_connections 2024-08-17T02:28:05.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.107+0000 7fcc31dc7700 1 -- 172.21.15.31:0/1492034839 wait complete. 2024-08-17T02:28:05.122 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:28:05.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57b59e700 1 Processor -- start 2024-08-17T02:28:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57b59e700 1 -- start start 2024-08-17T02:28:05.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57b59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd57c1548a0 0x7fd57c154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd57c0ac000 0x7fd57c158100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57b59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c0ade00 con 0x7fd57c0ae4e0 2024-08-17T02:28:05.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57b59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c158640 con 0x7fd57c0ac000 2024-08-17T02:28:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57b59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c068410 con 0x7fd57c1548a0 2024-08-17T02:28:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd579d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd57c0ac000 0x7fd57c158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd579d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd57c0ac000 0x7fd57c158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55326/0 (socket says 172.21.15.31:55326) 2024-08-17T02:28:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd579d9b700 1 -- 172.21.15.31:0/3110340145 learned_addr learned my addr 172.21.15.31:0/3110340145 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57a59c700 1 --2- 172.21.15.31:0/3110340145 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd57c1548a0 0x7fd57c154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd579d9b700 1 -- 172.21.15.31:0/3110340145 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd57c1548a0 msgr2=0x7fd57c154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd579d9b700 1 --2- 172.21.15.31:0/3110340145 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd57c1548a0 0x7fd57c154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd579d9b700 1 -- 172.21.15.31:0/3110340145 >> v1:172.21.15.92:6789/0 conn(0x7fd57c0ae4e0 legacy=0x7fd57c15ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd579d9b700 1 -- 172.21.15.31:0/3110340145 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0ac4c0 con 0x7fd57c0ac000 2024-08-17T02:28:05.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd579d9b700 1 --2- 172.21.15.31:0/3110340145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd57c0ac000 0x7fd57c158100 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0099b0 tx=0x7fd56c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a7053985f7484d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57959a700 1 -- 172.21.15.31:0/3110340145 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c009ea0 con 0x7fd57c0ac000 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57959a700 1 -- 172.21.15.31:0/3110340145 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c00b860 con 0x7fd57c0ac000 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.219+0000 7fd57959a700 1 -- 172.21.15.31:0/3110340145 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c00bc00 con 0x7fd57c0ac000 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 -- 172.21.15.31:0/3110340145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd57c0ac000 msgr2=0x7fd57c158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 --2- 172.21.15.31:0/3110340145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd57c0ac000 0x7fd57c158100 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0099b0 tx=0x7fd56c009250 comp rx=0 tx=0).stop 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 -- 172.21.15.31:0/3110340145 shutdown_connections 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 --2- 172.21.15.31:0/3110340145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd57c0ac000 0x7fd57c158100 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 --2- 172.21.15.31:0/3110340145 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd57c1548a0 0x7fd57c154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 -- 172.21.15.31:0/3110340145 >> 172.21.15.31:0/3110340145 conn(0x7fd57c0cc5d0 msgr2=0x7fd57c0cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 -- 172.21.15.31:0/3110340145 shutdown_connections 2024-08-17T02:28:05.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 -- 172.21.15.31:0/3110340145 wait complete. 2024-08-17T02:28:05.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 Processor -- start 2024-08-17T02:28:05.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 -- start start 2024-08-17T02:28:05.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd57c0ac000 0x7fd57c1685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd57c0ae4e0 0x7fd57c16a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd57c1548a0 0x7fd57c0a87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0ab8b0 con 0x7fd57c1548a0 2024-08-17T02:28:05.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0caaf0 con 0x7fd57c0ac000 2024-08-17T02:28:05.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57b59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0ab5d0 con 0x7fd57c0ae4e0 2024-08-17T02:28:05.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd57c1548a0 0x7fd57c0a87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd57c0ac000 0x7fd57c1685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd57c0ac000 0x7fd57c1685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:37136/0 (socket says 172.21.15.31:37136) 2024-08-17T02:28:05.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd57a59c700 1 -- 172.21.15.31:0/235437469 learned_addr learned my addr 172.21.15.31:0/235437469 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:05.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.223+0000 7fd579d9b700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd57c0ae4e0 0x7fd57c16a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd57a59c700 1 -- 172.21.15.31:0/235437469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd57c0ae4e0 msgr2=0x7fd57c16a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd57a59c700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd57c0ae4e0 0x7fd57c16a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd57a59c700 1 -- 172.21.15.31:0/235437469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd57c1548a0 msgr2=0x7fd57c0a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd57a59c700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd57c1548a0 0x7fd57c0a87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd57a59c700 1 -- 172.21.15.31:0/235437469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c0094f0 con 0x7fd57c0ac000 2024-08-17T02:28:05.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd57ad9d700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd57c1548a0 0x7fd57c0a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:05.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd57a59c700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd57c0ac000 0x7fd57c1685a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd56400e930 tx=0x7fd5640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd5727fc700 1 -- 172.21.15.31:0/235437469 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564013680 con 0x7fd57c0ac000 2024-08-17T02:28:05.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd5727fc700 1 -- 172.21.15.31:0/235437469 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5640137e0 con 0x7fd57c0ac000 2024-08-17T02:28:05.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd57b59e700 1 -- 172.21.15.31:0/235437469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57c0ca4a0 con 0x7fd57c0ac000 2024-08-17T02:28:05.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd5727fc700 1 -- 172.21.15.31:0/235437469 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564013b80 con 0x7fd57c0ac000 2024-08-17T02:28:05.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd57b59e700 1 -- 172.21.15.31:0/235437469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c0a8d20 con 0x7fd57c0ac000 2024-08-17T02:28:05.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd57b59e700 1 -- 172.21.15.31:0/235437469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c0ca300 con 0x7fd57c0ac000 2024-08-17T02:28:05.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.227+0000 7fd5727fc700 1 -- 172.21.15.31:0/235437469 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd56400c3e0 con 0x7fd57c0ac000 2024-08-17T02:28:05.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.231+0000 7fd5727fc700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd55c060860 0x7fd55c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.231+0000 7fd5727fc700 1 -- 172.21.15.31:0/235437469 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fd56407d0b0 con 0x7fd57c0ac000 2024-08-17T02:28:05.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.231+0000 7fd579d9b700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd55c060860 0x7fd55c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.231+0000 7fd579d9b700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd55c060860 0x7fd55c062d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0099b0 tx=0x7fd56c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.239+0000 7fd5727fc700 1 -- 172.21.15.31:0/235437469 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd57c0ca300 con 0x7fd57c0ac000 2024-08-17T02:28:05.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.447+0000 7fd57b59e700 1 -- 172.21.15.31:0/235437469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd57c0ca300 con 0x7fd57c0ac000 2024-08-17T02:28:05.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.447+0000 7fd5727fc700 1 -- 172.21.15.31:0/235437469 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5681 (secure 0 0 0) 0x7fd57c0ca300 con 0x7fd57c0ac000 2024-08-17T02:28:05.452 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:05.452 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1920530016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1920530016},{"type":"v1","addr":"172.21.15.92:6833","nonce":1920530016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3381009547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3381009547},{"type":"v1","addr":"172.21.15.92:6835","nonce":3381009547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:41.765672+0000","modified":"2024-08-17T02:25:44.420703+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6837/1886584780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1886584780},{"type":"v1","addr":"172.21.15.31:6837","nonce":1886584780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:59.737073+0000","modified":"2024-08-17T02:26:01.269310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.31:6836/548139464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":548139464},{"type":"v1","addr":"172.21.15.31:6836","nonce":548139464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000037340","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 -- 172.21.15.31:0/235437469 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd55c060860 msgr2=0x7fd55c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd55c060860 0x7fd55c062d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0099b0 tx=0x7fd56c017000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 -- 172.21.15.31:0/235437469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd57c0ac000 msgr2=0x7fd57c1685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd57c0ac000 0x7fd57c1685a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd56400e930 tx=0x7fd5640091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 -- 172.21.15.31:0/235437469 shutdown_connections 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd55c060860 0x7fd55c062d10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd57c1548a0 0x7fd57c0a87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd57c0ae4e0 0x7fd57c16a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 --2- 172.21.15.31:0/235437469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd57c0ac000 0x7fd57c1685a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 -- 172.21.15.31:0/235437469 >> 172.21.15.31:0/235437469 conn(0x7fd57c0cc5d0 msgr2=0x7fd57c0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 -- 172.21.15.31:0/235437469 shutdown_connections 2024-08-17T02:28:05.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.451+0000 7fd57b59e700 1 -- 172.21.15.31:0/235437469 wait complete. 2024-08-17T02:28:05.458 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-08-17T02:28:05.470 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:05.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9e471700 1 Processor -- start 2024-08-17T02:28:05.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9e471700 1 -- start start 2024-08-17T02:28:05.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9e471700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f98155fe0 0x7f2f98159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9e471700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f981563b0 0x7f2f98068f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9e471700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2f980adb00 0x7f2f980694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9e471700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9815ad30 con 0x7f2f98155fe0 2024-08-17T02:28:05.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9e471700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f980cbb30 con 0x7f2f980adb00 2024-08-17T02:28:05.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9e471700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9815a490 con 0x7f2f981563b0 2024-08-17T02:28:05.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9d46f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f98155fe0 0x7f2f98159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9d46f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f98155fe0 0x7f2f98159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55334/0 (socket says 172.21.15.31:55334) 2024-08-17T02:28:05.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9d46f700 1 -- 172.21.15.31:0/2068493148 learned_addr learned my addr 172.21.15.31:0/2068493148 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:05.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9cc6e700 1 --2- 172.21.15.31:0/2068493148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f981563b0 0x7f2f98068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.571+0000 7f2f9dc70700 1 --2- 172.21.15.31:0/2068493148 >> v2:172.21.15.92:3300/0 conn(0x7f2f980adb00 0x7f2f980694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9d46f700 1 -- 172.21.15.31:0/2068493148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f981563b0 msgr2=0x7f2f98068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9d46f700 1 --2- 172.21.15.31:0/2068493148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f981563b0 0x7f2f98068f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9d46f700 1 -- 172.21.15.31:0/2068493148 >> v2:172.21.15.92:3300/0 conn(0x7f2f980adb00 msgr2=0x7f2f980694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9d46f700 1 --2- 172.21.15.31:0/2068493148 >> v2:172.21.15.92:3300/0 conn(0x7f2f980adb00 0x7f2f980694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9d46f700 1 -- 172.21.15.31:0/2068493148 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9815a770 con 0x7f2f98155fe0 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9dc70700 1 --2- 172.21.15.31:0/2068493148 >> v2:172.21.15.92:3300/0 conn(0x7f2f980adb00 0x7f2f980694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9d46f700 1 --2- 172.21.15.31:0/2068493148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f98155fe0 0x7f2f98159d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2f9806b7b0 tx=0x7f2f9400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b229c36edfca0e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f8bfff700 1 -- 172.21.15.31:0/2068493148 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400db40 con 0x7f2f98155fe0 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f8bfff700 1 -- 172.21.15.31:0/2068493148 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9400dca0 con 0x7f2f98155fe0 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f8bfff700 1 -- 172.21.15.31:0/2068493148 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f940196d0 con 0x7f2f98155fe0 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 -- 172.21.15.31:0/2068493148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f98155fe0 msgr2=0x7f2f98159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 --2- 172.21.15.31:0/2068493148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f98155fe0 0x7f2f98159d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2f9806b7b0 tx=0x7f2f9400b4f0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 -- 172.21.15.31:0/2068493148 shutdown_connections 2024-08-17T02:28:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 --2- 172.21.15.31:0/2068493148 >> v2:172.21.15.92:3300/0 conn(0x7f2f980adb00 0x7f2f980694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 --2- 172.21.15.31:0/2068493148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f981563b0 0x7f2f98068f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 --2- 172.21.15.31:0/2068493148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f98155fe0 0x7f2f98159d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 -- 172.21.15.31:0/2068493148 >> 172.21.15.31:0/2068493148 conn(0x7f2f98067400 msgr2=0x7f2f98067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 -- 172.21.15.31:0/2068493148 shutdown_connections 2024-08-17T02:28:05.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 -- 172.21.15.31:0/2068493148 wait complete. 2024-08-17T02:28:05.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 Processor -- start 2024-08-17T02:28:05.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.575+0000 7f2f9e471700 1 -- start start 2024-08-17T02:28:05.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9e471700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f980adb00 0x7f2f9814d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9e471700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f98155fe0 0x7f2f98155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9e471700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f981563b0 0x7f2f980c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9e471700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98168d00 con 0x7f2f980adb00 2024-08-17T02:28:05.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9e471700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98168f70 con 0x7f2f981563b0 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9e471700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98169250 con 0x7f2f98155fe0 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9d46f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f980adb00 0x7f2f9814d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9d46f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f980adb00 0x7f2f9814d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55344/0 (socket says 172.21.15.31:55344) 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9d46f700 1 -- 172.21.15.31:0/4287892051 learned_addr learned my addr 172.21.15.31:0/4287892051 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9dc70700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f981563b0 0x7f2f980c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9cc6e700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f98155fe0 0x7f2f98155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9d46f700 1 -- 172.21.15.31:0/4287892051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f98155fe0 msgr2=0x7f2f98155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9d46f700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f98155fe0 0x7f2f98155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9d46f700 1 -- 172.21.15.31:0/4287892051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f981563b0 msgr2=0x7f2f980c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9d46f700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f981563b0 0x7f2f980c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9d46f700 1 -- 172.21.15.31:0/4287892051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90009a20 con 0x7f2f980adb00 2024-08-17T02:28:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9d46f700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f980adb00 0x7f2f9814d760 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2f98063be0 tx=0x7f2f9401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f897fa700 1 -- 172.21.15.31:0/4287892051 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94019480 con 0x7f2f980adb00 2024-08-17T02:28:05.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f897fa700 1 -- 172.21.15.31:0/4287892051 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f940195e0 con 0x7f2f980adb00 2024-08-17T02:28:05.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9e471700 1 -- 172.21.15.31:0/4287892051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f9400b790 con 0x7f2f980adb00 2024-08-17T02:28:05.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f897fa700 1 -- 172.21.15.31:0/4287892051 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f940106a0 con 0x7f2f980adb00 2024-08-17T02:28:05.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.579+0000 7f2f9e471700 1 -- 172.21.15.31:0/4287892051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f98169810 con 0x7f2f980adb00 2024-08-17T02:28:05.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.583+0000 7f2f9e471700 1 -- 172.21.15.31:0/4287892051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f980712b0 con 0x7f2f980adb00 2024-08-17T02:28:05.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.583+0000 7f2f897fa700 1 -- 172.21.15.31:0/4287892051 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2f94022030 con 0x7f2f980adb00 2024-08-17T02:28:05.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.583+0000 7f2f897fa700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2f7c060860 0x7f2f7c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.583+0000 7f2f897fa700 1 -- 172.21.15.31:0/4287892051 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f2f94014070 con 0x7f2f980adb00 2024-08-17T02:28:05.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.583+0000 7f2f9cc6e700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2f7c060860 0x7f2f7c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.583+0000 7f2f9cc6e700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2f7c060860 0x7f2f7c062d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f980b0d60 tx=0x7f2f8c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.591+0000 7f2f897fa700 1 -- 172.21.15.31:0/4287892051 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2f94050b50 con 0x7f2f980adb00 2024-08-17T02:28:05.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.791+0000 7f2f9e471700 1 -- 172.21.15.31:0/4287892051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f980ab2d0 con 0x7f2f980adb00 2024-08-17T02:28:05.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f897fa700 1 -- 172.21.15.31:0/4287892051 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5681 (secure 0 0 0) 0x7f2f94054130 con 0x7f2f980adb00 2024-08-17T02:28:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:05.799 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1920530016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1920530016},{"type":"v1","addr":"172.21.15.92:6833","nonce":1920530016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3381009547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3381009547},{"type":"v1","addr":"172.21.15.92:6835","nonce":3381009547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:41.765672+0000","modified":"2024-08-17T02:25:44.420703+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5043},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5043":{"gid":5043,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6837/1886584780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1886584780},{"type":"v1","addr":"172.21.15.31:6837","nonce":1886584780}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:59.737073+0000","modified":"2024-08-17T02:26:01.269310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.31:6836/548139464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":548139464},{"type":"v1","addr":"172.21.15.31:6836","nonce":548139464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000037340","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 -- 172.21.15.31:0/4287892051 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2f7c060860 msgr2=0x7f2f7c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2f7c060860 0x7f2f7c062d10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f980b0d60 tx=0x7f2f8c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 -- 172.21.15.31:0/4287892051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f980adb00 msgr2=0x7f2f9814d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f980adb00 0x7f2f9814d760 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2f98063be0 tx=0x7f2f9401b000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 -- 172.21.15.31:0/4287892051 shutdown_connections 2024-08-17T02:28:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2f7c060860 0x7f2f7c062d10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f981563b0 0x7f2f980c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2f98155fe0 0x7f2f98155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 --2- 172.21.15.31:0/4287892051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f980adb00 0x7f2f9814d760 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 -- 172.21.15.31:0/4287892051 >> 172.21.15.31:0/4287892051 conn(0x7f2f98067400 msgr2=0x7f2f9806e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 -- 172.21.15.31:0/4287892051 shutdown_connections 2024-08-17T02:28:05.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.795+0000 7f2f9e471700 1 -- 172.21.15.31:0/4287892051 wait complete. 2024-08-17T02:28:05.802 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-08-17T02:28:05.813 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:05.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa65142c700 1 Processor -- start 2024-08-17T02:28:05.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa65142c700 1 -- start start 2024-08-17T02:28:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa65142c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa64c140780 0x7fa64c140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa65142c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa64c0b0fe0 0x7fa64c0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa65142c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64c0ca7c0 con 0x7fa64c0c9c30 2024-08-17T02:28:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa65142c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64c0b1970 con 0x7fa64c0b0fe0 2024-08-17T02:28:05.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa65142c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0ab690 con 0x7fa64c140780 2024-08-17T02:28:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa64b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa64c0b0fe0 0x7fa64c0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa64b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa64c0b0fe0 0x7fa64c0b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55348/0 (socket says 172.21.15.31:55348) 2024-08-17T02:28:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa64b7fe700 1 -- 172.21.15.31:0/1538271852 learned_addr learned my addr 172.21.15.31:0/1538271852 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa64bfff700 1 --2- 172.21.15.31:0/1538271852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa64c140780 0x7fa64c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa64b7fe700 1 -- 172.21.15.31:0/1538271852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa64c140780 msgr2=0x7fa64c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa64b7fe700 1 --2- 172.21.15.31:0/1538271852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa64c140780 0x7fa64c140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa64b7fe700 1 -- 172.21.15.31:0/1538271852 >> v1:172.21.15.92:6789/0 conn(0x7fa64c0c9c30 legacy=0x7fa64c0ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.915+0000 7fa64b7fe700 1 -- 172.21.15.31:0/1538271852 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c0caa00 con 0x7fa64c0b0fe0 2024-08-17T02:28:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa64b7fe700 1 --2- 172.21.15.31:0/1538271852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c0b0fe0 0x7fa64c0b1430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa6340099b0 tx=0x7fa634009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162318625b9fcc55 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa64affd700 1 -- 172.21.15.31:0/1538271852 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63400b860 con 0x7fa64c0b0fe0 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa64affd700 1 -- 172.21.15.31:0/1538271852 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63400b9c0 con 0x7fa64c0b0fe0 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa64affd700 1 -- 172.21.15.31:0/1538271852 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63400bd60 con 0x7fa64c0b0fe0 2024-08-17T02:28:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa65142c700 1 -- 172.21.15.31:0/1538271852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c0b0fe0 msgr2=0x7fa64c0b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa65142c700 1 --2- 172.21.15.31:0/1538271852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c0b0fe0 0x7fa64c0b1430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa6340099b0 tx=0x7fa634009250 comp rx=0 tx=0).stop 2024-08-17T02:28:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa65142c700 1 -- 172.21.15.31:0/1538271852 shutdown_connections 2024-08-17T02:28:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa65142c700 1 --2- 172.21.15.31:0/1538271852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c0b0fe0 0x7fa64c0b1430 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa65142c700 1 --2- 172.21.15.31:0/1538271852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa64c140780 0x7fa64c140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa65142c700 1 -- 172.21.15.31:0/1538271852 >> 172.21.15.31:0/1538271852 conn(0x7fa64c067400 msgr2=0x7fa64c067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa65142c700 1 -- 172.21.15.31:0/1538271852 shutdown_connections 2024-08-17T02:28:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa65142c700 1 -- 172.21.15.31:0/1538271852 wait complete. 2024-08-17T02:28:05.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa65142c700 1 Processor -- start 2024-08-17T02:28:05.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.919+0000 7fa65142c700 1 -- start start 2024-08-17T02:28:05.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa65142c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa64c0b0fe0 0x7fa64c13f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa65142c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa64c0c9c30 0x7fa64c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa65142c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c140780 0x7fa64c1389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa65142c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c1376f0 con 0x7fa64c140780 2024-08-17T02:28:05.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa65142c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c1379d0 con 0x7fa64c0c9c30 2024-08-17T02:28:05.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa65142c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c137cb0 con 0x7fa64c0b0fe0 2024-08-17T02:28:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa650c2b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c140780 0x7fa64c1389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa650c2b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c140780 0x7fa64c1389b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55352/0 (socket says 172.21.15.31:55352) 2024-08-17T02:28:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa650c2b700 1 -- 172.21.15.31:0/187248772 learned_addr learned my addr 172.21.15.31:0/187248772 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa64bfff700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa64c0b0fe0 0x7fa64c13f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa64b7fe700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa64c0c9c30 0x7fa64c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa650c2b700 1 -- 172.21.15.31:0/187248772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa64c0b0fe0 msgr2=0x7fa64c13f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa650c2b700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa64c0b0fe0 0x7fa64c13f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa650c2b700 1 -- 172.21.15.31:0/187248772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa64c0c9c30 msgr2=0x7fa64c1555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa650c2b700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa64c0c9c30 0x7fa64c1555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa650c2b700 1 -- 172.21.15.31:0/187248772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340094f0 con 0x7fa64c140780 2024-08-17T02:28:05.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa650c2b700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c140780 0x7fa64c1389b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c8e0 tx=0x7fa644001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa643fff700 1 -- 172.21.15.31:0/187248772 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa644012630 con 0x7fa64c140780 2024-08-17T02:28:05.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa643fff700 1 -- 172.21.15.31:0/187248772 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa644012790 con 0x7fa64c140780 2024-08-17T02:28:05.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa65142c700 1 -- 172.21.15.31:0/187248772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c137f90 con 0x7fa64c140780 2024-08-17T02:28:05.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa643fff700 1 -- 172.21.15.31:0/187248772 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa644012b50 con 0x7fa64c140780 2024-08-17T02:28:05.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.923+0000 7fa65142c700 1 -- 172.21.15.31:0/187248772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c137310 con 0x7fa64c140780 2024-08-17T02:28:05.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.927+0000 7fa65142c700 1 -- 172.21.15.31:0/187248772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c0712b0 con 0x7fa64c140780 2024-08-17T02:28:05.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.927+0000 7fa643fff700 1 -- 172.21.15.31:0/187248772 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fa64401a3a0 con 0x7fa64c140780 2024-08-17T02:28:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.927+0000 7fa643fff700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa62c060860 0x7fa62c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.927+0000 7fa64bfff700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa62c060860 0x7fa62c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.927+0000 7fa643fff700 1 -- 172.21.15.31:0/187248772 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7fa64407d020 con 0x7fa64c140780 2024-08-17T02:28:05.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.927+0000 7fa64bfff700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa62c060860 0x7fa62c062d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa63c006fd0 tx=0x7fa63c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:05.935+0000 7fa643fff700 1 -- 172.21.15.31:0/187248772 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fa644050a70 con 0x7fa64c140780 2024-08-17T02:28:06.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.103+0000 7fa65142c700 1 -- 172.21.15.31:0/187248772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa64c0ca7c0 con 0x7fa64c140780 2024-08-17T02:28:06.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.103+0000 7fa643fff700 1 -- 172.21.15.31:0/187248772 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18740 (secure 0 0 0) 0x7fa64c0ca7c0 con 0x7fa64c140780 2024-08-17T02:28:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:06.110 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":43,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:26:27.834101+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:40.183864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:40.754356+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000037340.meta","create_time":"2024-08-17T02:25:57.739259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000037340"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000037340.data","create_time":"2024-08-17T02:25:58.749832+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000037340"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.8","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.3e","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:06.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 -- 172.21.15.31:0/187248772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa62c060860 msgr2=0x7fa62c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa62c060860 0x7fa62c062d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa63c006fd0 tx=0x7fa63c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 -- 172.21.15.31:0/187248772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c140780 msgr2=0x7fa64c1389b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c140780 0x7fa64c1389b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c8e0 tx=0x7fa644001710 comp rx=0 tx=0).stop 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 -- 172.21.15.31:0/187248772 shutdown_connections 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fa62c060860 0x7fa62c062d10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa64c140780 0x7fa64c1389b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa64c0c9c30 0x7fa64c1555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 --2- 172.21.15.31:0/187248772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa64c0b0fe0 0x7fa64c13f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 -- 172.21.15.31:0/187248772 >> 172.21.15.31:0/187248772 conn(0x7fa64c067400 msgr2=0x7fa64c0abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 -- 172.21.15.31:0/187248772 shutdown_connections 2024-08-17T02:28:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.107+0000 7fa65142c700 1 -- 172.21.15.31:0/187248772 wait complete. 2024-08-17T02:28:06.125 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:28:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.227+0000 7f936181c700 1 Processor -- start 2024-08-17T02:28:06.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.227+0000 7f936181c700 1 -- start start 2024-08-17T02:28:06.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f935c155be0 0x7f935c155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f935c06f2b0 0x7f935c068960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935c068ea0 con 0x7f935c068510 2024-08-17T02:28:06.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935c06f710 con 0x7f935c06f2b0 2024-08-17T02:28:06.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c06f910 con 0x7f935c155be0 2024-08-17T02:28:06.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936101b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f935c06f2b0 0x7f935c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936101b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f935c06f2b0 0x7f935c068960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55362/0 (socket says 172.21.15.31:55362) 2024-08-17T02:28:06.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936101b700 1 -- 172.21.15.31:0/3371538622 learned_addr learned my addr 172.21.15.31:0/3371538622 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936081a700 1 --2- 172.21.15.31:0/3371538622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f935c155be0 0x7f935c155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936101b700 1 -- 172.21.15.31:0/3371538622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f935c155be0 msgr2=0x7f935c155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936101b700 1 --2- 172.21.15.31:0/3371538622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f935c155be0 0x7f935c155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936101b700 1 -- 172.21.15.31:0/3371538622 >> v1:172.21.15.92:6789/0 conn(0x7f935c068510 legacy=0x7f935c06eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936101b700 1 -- 172.21.15.31:0/3371538622 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c156630 con 0x7f935c06f2b0 2024-08-17T02:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936101b700 1 --2- 172.21.15.31:0/3371538622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c06f2b0 0x7f935c068960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9354009f20 tx=0x7f9354009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06e5ec5da6a2def server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f935b7fe700 1 -- 172.21.15.31:0/3371538622 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935400e070 con 0x7f935c06f2b0 2024-08-17T02:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f935b7fe700 1 -- 172.21.15.31:0/3371538622 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935400ba80 con 0x7f935c06f2b0 2024-08-17T02:28:06.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f935b7fe700 1 -- 172.21.15.31:0/3371538622 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93540092e0 con 0x7f935c06f2b0 2024-08-17T02:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 -- 172.21.15.31:0/3371538622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c06f2b0 msgr2=0x7f935c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 --2- 172.21.15.31:0/3371538622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c06f2b0 0x7f935c068960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9354009f20 tx=0x7f9354009840 comp rx=0 tx=0).stop 2024-08-17T02:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 -- 172.21.15.31:0/3371538622 shutdown_connections 2024-08-17T02:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 --2- 172.21.15.31:0/3371538622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c06f2b0 0x7f935c068960 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 --2- 172.21.15.31:0/3371538622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f935c155be0 0x7f935c155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 -- 172.21.15.31:0/3371538622 >> 172.21.15.31:0/3371538622 conn(0x7f935c06a050 msgr2=0x7f935c06a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 -- 172.21.15.31:0/3371538622 shutdown_connections 2024-08-17T02:28:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.231+0000 7f936181c700 1 -- 172.21.15.31:0/3371538622 wait complete. 2024-08-17T02:28:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936181c700 1 Processor -- start 2024-08-17T02:28:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936181c700 1 -- start start 2024-08-17T02:28:06.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936181c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f935c068510 0x7f935c14e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936181c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f935c06f2b0 0x7f935c159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936181c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c155be0 0x7f935c159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936181c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c1588c0 con 0x7f935c155be0 2024-08-17T02:28:06.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936181c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c158ba0 con 0x7f935c068510 2024-08-17T02:28:06.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936181c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c158e80 con 0x7f935c06f2b0 2024-08-17T02:28:06.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936101b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c155be0 0x7f935c159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936101b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c155be0 0x7f935c159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55370/0 (socket says 172.21.15.31:55370) 2024-08-17T02:28:06.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936101b700 1 -- 172.21.15.31:0/2653594896 learned_addr learned my addr 172.21.15.31:0/2653594896 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:06.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936081a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f935c068510 0x7f935c14e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f935bfff700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f935c06f2b0 0x7f935c159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936101b700 1 -- 172.21.15.31:0/2653594896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f935c06f2b0 msgr2=0x7f935c159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936101b700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f935c06f2b0 0x7f935c159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936101b700 1 -- 172.21.15.31:0/2653594896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f935c068510 msgr2=0x7f935c14e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936101b700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f935c068510 0x7f935c14e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936101b700 1 -- 172.21.15.31:0/2653594896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9354009ae0 con 0x7f935c155be0 2024-08-17T02:28:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936081a700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f935c068510 0x7f935c14e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:06.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.235+0000 7f936101b700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c155be0 0x7f935c159bc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f935c069aa0 tx=0x7f9354018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.239+0000 7f9358ff9700 1 -- 172.21.15.31:0/2653594896 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93540032f0 con 0x7f935c155be0 2024-08-17T02:28:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.239+0000 7f9358ff9700 1 -- 172.21.15.31:0/2653594896 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354008d20 con 0x7f935c155be0 2024-08-17T02:28:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.239+0000 7f936181c700 1 -- 172.21.15.31:0/2653594896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935c159160 con 0x7f935c155be0 2024-08-17T02:28:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.239+0000 7f9358ff9700 1 -- 172.21.15.31:0/2653594896 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93540266b0 con 0x7f935c155be0 2024-08-17T02:28:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.239+0000 7f936181c700 1 -- 172.21.15.31:0/2653594896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935c14ec00 con 0x7f935c155be0 2024-08-17T02:28:06.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.239+0000 7f936181c700 1 -- 172.21.15.31:0/2653594896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935c159350 con 0x7f935c155be0 2024-08-17T02:28:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.239+0000 7f9358ff9700 1 -- 172.21.15.31:0/2653594896 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9354003040 con 0x7f935c155be0 2024-08-17T02:28:06.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.239+0000 7f9358ff9700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9348060860 0x7f9348062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.243+0000 7f936081a700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9348060860 0x7f9348062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.243+0000 7f9358ff9700 1 -- 172.21.15.31:0/2653594896 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6719+0+0 (secure 0 0 0) 0x7f935407eec0 con 0x7f935c155be0 2024-08-17T02:28:06.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.243+0000 7f936081a700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9348060860 0x7f9348062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9350006fd0 tx=0x7f9350008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.251+0000 7f9358ff9700 1 -- 172.21.15.31:0/2653594896 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f935404efd0 con 0x7f935c155be0 2024-08-17T02:28:06.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.455+0000 7f936181c700 1 -- 172.21.15.31:0/2653594896 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f935c158a00 con 0x7f935c155be0 2024-08-17T02:28:06.460 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-08-17T02:28:06.455+0000 7fb5491b8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:28:06.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.459+0000 7f9358ff9700 1 -- 172.21.15.31:0/2653594896 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f935c158a00 con 0x7f935c155be0 2024-08-17T02:28:06.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.463+0000 7f936181c700 1 -- 172.21.15.31:0/2653594896 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9348060860 msgr2=0x7f9348062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.463+0000 7f936181c700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9348060860 0x7f9348062d10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9350006fd0 tx=0x7f9350008040 comp rx=0 tx=0).stop 2024-08-17T02:28:06.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.463+0000 7f936181c700 1 -- 172.21.15.31:0/2653594896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c155be0 msgr2=0x7f935c159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.463+0000 7f936181c700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c155be0 0x7f935c159bc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f935c069aa0 tx=0x7f9354018000 comp rx=0 tx=0).stop 2024-08-17T02:28:06.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.471+0000 7f936181c700 1 -- 172.21.15.31:0/2653594896 shutdown_connections 2024-08-17T02:28:06.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.471+0000 7f936181c700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9348060860 0x7f9348062d10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.471+0000 7f936181c700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f935c155be0 0x7f935c159bc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.471+0000 7f936181c700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f935c06f2b0 0x7f935c159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.471+0000 7f936181c700 1 --2- 172.21.15.31:0/2653594896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f935c068510 0x7f935c14e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.471+0000 7f936181c700 1 -- 172.21.15.31:0/2653594896 >> 172.21.15.31:0/2653594896 conn(0x7f935c06a050 msgr2=0x7f935c1496b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.471+0000 7f936181c700 1 -- 172.21.15.31:0/2653594896 shutdown_connections 2024-08-17T02:28:06.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.471+0000 7f936181c700 1 -- 172.21.15.31:0/2653594896 wait complete. 2024-08-17T02:28:06.476 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:28:06.477 INFO:tasks.ceph.mds.c.smithi031.stderr: -7402> 2024-08-17T02:25:45.201+0000 7f566e59a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:06.487 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:28:06.505 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-08-17T02:28:06.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3adb59e700 1 Processor -- start 2024-08-17T02:28:06.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3adb59e700 1 -- start start 2024-08-17T02:28:06.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3adb59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3adc140630 0x7f3adc0aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3adb59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 0x7f3adc0af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3adb59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3adc0ccab0 con 0x7f3adc0cba30 2024-08-17T02:28:06.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3adb59e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3adc068880 con 0x7f3adc140630 2024-08-17T02:28:06.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3adb59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0cbea0 con 0x7f3adc158650 2024-08-17T02:28:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3ada59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3adc140630 0x7f3adc0aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3ada59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3adc140630 0x7f3adc0aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55406/0 (socket says 172.21.15.31:55406) 2024-08-17T02:28:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3ada59c700 1 -- 172.21.15.31:0/3167111146 learned_addr learned my addr 172.21.15.31:0/3167111146 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3adad9d700 1 --2- 172.21.15.31:0/3167111146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 0x7f3adc0af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3ada59c700 1 -- 172.21.15.31:0/3167111146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 msgr2=0x7f3adc0af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3ada59c700 1 --2- 172.21.15.31:0/3167111146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 0x7f3adc0af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3ada59c700 1 -- 172.21.15.31:0/3167111146 >> v1:172.21.15.92:6789/0 conn(0x7f3adc0cba30 legacy=0x7f3adc06e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.591+0000 7f3ada59c700 1 -- 172.21.15.31:0/3167111146 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc0cc180 con 0x7f3adc140630 2024-08-17T02:28:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3ada59c700 1 --2- 172.21.15.31:0/3167111146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 0x7f3adc0aed30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0099b0 tx=0x7f3acc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46c7dae0baf1425 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3ad959a700 1 -- 172.21.15.31:0/3167111146 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc009ea0 con 0x7f3adc140630 2024-08-17T02:28:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3ad959a700 1 -- 172.21.15.31:0/3167111146 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc00b860 con 0x7f3adc140630 2024-08-17T02:28:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3ad959a700 1 -- 172.21.15.31:0/3167111146 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00bc00 con 0x7f3adc140630 2024-08-17T02:28:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3adb59e700 1 -- 172.21.15.31:0/3167111146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 msgr2=0x7f3adc0aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3adb59e700 1 --2- 172.21.15.31:0/3167111146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 0x7f3adc0aed30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0099b0 tx=0x7f3acc009250 comp rx=0 tx=0).stop 2024-08-17T02:28:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3adb59e700 1 -- 172.21.15.31:0/3167111146 shutdown_connections 2024-08-17T02:28:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3adb59e700 1 --2- 172.21.15.31:0/3167111146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 0x7f3adc0af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3adb59e700 1 --2- 172.21.15.31:0/3167111146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 0x7f3adc0aed30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3adb59e700 1 -- 172.21.15.31:0/3167111146 >> 172.21.15.31:0/3167111146 conn(0x7f3adc06a0c0 msgr2=0x7f3adc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3adb59e700 1 -- 172.21.15.31:0/3167111146 shutdown_connections 2024-08-17T02:28:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.595+0000 7f3adb59e700 1 -- 172.21.15.31:0/3167111146 wait complete. 2024-08-17T02:28:06.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3adb59e700 1 Processor -- start 2024-08-17T02:28:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3adb59e700 1 -- start start 2024-08-17T02:28:06.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3adb59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3adc0cba30 0x7f3adc156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3adb59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 0x7f3adc15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3adb59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 0x7f3adc15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3adb59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc15d040 con 0x7f3adc140630 2024-08-17T02:28:06.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3adb59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc15bf70 con 0x7f3adc0cba30 2024-08-17T02:28:06.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3adb59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc15c250 con 0x7f3adc158650 2024-08-17T02:28:06.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3ad9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 0x7f3adc15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3ad9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 0x7f3adc15b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55420/0 (socket says 172.21.15.31:55420) 2024-08-17T02:28:06.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3ad9d9b700 1 -- 172.21.15.31:0/3792831644 learned_addr learned my addr 172.21.15.31:0/3792831644 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3adad9d700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 0x7f3adc15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.599+0000 7f3ada59c700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3adc0cba30 0x7f3adc156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3ad9d9b700 1 -- 172.21.15.31:0/3792831644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 msgr2=0x7f3adc15b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3ad9d9b700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 0x7f3adc15b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3ad9d9b700 1 -- 172.21.15.31:0/3792831644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3adc0cba30 msgr2=0x7f3adc156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3ad9d9b700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3adc0cba30 0x7f3adc156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3ad9d9b700 1 -- 172.21.15.31:0/3792831644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc0094f0 con 0x7f3adc140630 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3ada59c700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3adc0cba30 0x7f3adc156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3adad9d700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 0x7f3adc15b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3ad9d9b700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 0x7f3adc15b420 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c790 tx=0x7f3ad0007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3aca7fc700 1 -- 172.21.15.31:0/3792831644 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0011590 con 0x7f3adc140630 2024-08-17T02:28:06.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3aca7fc700 1 -- 172.21.15.31:0/3792831644 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad00116f0 con 0x7f3adc140630 2024-08-17T02:28:06.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3adb59e700 1 -- 172.21.15.31:0/3792831644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc167680 con 0x7f3adc140630 2024-08-17T02:28:06.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3aca7fc700 1 -- 172.21.15.31:0/3792831644 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0011ab0 con 0x7f3adc140630 2024-08-17T02:28:06.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3adb59e700 1 -- 172.21.15.31:0/3792831644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc167330 con 0x7f3adc140630 2024-08-17T02:28:06.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3adb59e700 1 -- 172.21.15.31:0/3792831644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc167b80 con 0x7f3adc140630 2024-08-17T02:28:06.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3aca7fc700 1 -- 172.21.15.31:0/3792831644 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3ad001a360 con 0x7f3adc140630 2024-08-17T02:28:06.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3aca7fc700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3abc060860 0x7f3abc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3aca7fc700 1 -- 172.21.15.31:0/3792831644 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f3ad007c010 con 0x7f3adc140630 2024-08-17T02:28:06.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.603+0000 7f3ada59c700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3abc060860 0x7f3abc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.607+0000 7f3ada59c700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3abc060860 0x7f3abc062d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0099b0 tx=0x7f3acc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.615+0000 7f3aca7fc700 1 -- 172.21.15.31:0/3792831644 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3ad004c010 con 0x7f3adc140630 2024-08-17T02:28:06.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:06.819+0000 7f3adb59e700 1 -- 172.21.15.31:0/3792831644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3adc0712b0 con 0x7f3adc140630 2024-08-17T02:28:07.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.463+0000 7f3aca7fc700 1 -- 172.21.15.31:0/3792831644 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3ad004f630 con 0x7f3adc140630 2024-08-17T02:28:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 -- 172.21.15.31:0/3792831644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3abc060860 msgr2=0x7f3abc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3abc060860 0x7f3abc062d10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0099b0 tx=0x7f3acc017000 comp rx=0 tx=0).stop 2024-08-17T02:28:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 -- 172.21.15.31:0/3792831644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 msgr2=0x7f3adc15b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 0x7f3adc15b420 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c790 tx=0x7f3ad0007f20 comp rx=0 tx=0).stop 2024-08-17T02:28:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 -- 172.21.15.31:0/3792831644 shutdown_connections 2024-08-17T02:28:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3abc060860 0x7f3abc062d10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3adc158650 0x7f3adc15b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3adc140630 0x7f3adc15b420 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 --2- 172.21.15.31:0/3792831644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3adc0cba30 0x7f3adc156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 -- 172.21.15.31:0/3792831644 >> 172.21.15.31:0/3792831644 conn(0x7f3adc06a0c0 msgr2=0x7f3adc15a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 -- 172.21.15.31:0/3792831644 shutdown_connections 2024-08-17T02:28:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.471+0000 7f3adb59e700 1 -- 172.21.15.31:0/3792831644 wait complete. 2024-08-17T02:28:07.491 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:28:07.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.607+0000 7f59cc930700 1 Processor -- start 2024-08-17T02:28:07.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59cc930700 1 -- start start 2024-08-17T02:28:07.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59cc930700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f59c80cd050 0x7f59c8164370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59cc930700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c815a780 con 0x7f59c81596c0 2024-08-17T02:28:07.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59cc930700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c815ac10 con 0x7f59c81592f0 2024-08-17T02:28:07.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59cc930700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c80cb870 con 0x7f59c80cd050 2024-08-17T02:28:07.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59be59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f59c81596c0 0x7f59c80cc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49866/0 (socket says 172.21.15.31:49866) 2024-08-17T02:28:07.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59be59c700 1 -- 172.21.15.31:0/73658452 learned_addr learned my addr 172.21.15.31:0/73658452 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:07.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c759e700 1 --2- 172.21.15.31:0/73658452 >> v2:172.21.15.92:3300/0 conn(0x7f59c80cd050 0x7f59c8164370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c659c700 1 -- 172.21.15.31:0/73658452 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638934122 0 0) 0x7f59c815a780 con 0x7f59c81596c0 2024-08-17T02:28:07.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c659c700 1 -- 172.21.15.31:0/73658452 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b4003570 con 0x7f59c81596c0 2024-08-17T02:28:07.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c659c700 1 -- 172.21.15.31:0/73658452 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502866043 0 0) 0x7f59c815ac10 con 0x7f59c81592f0 2024-08-17T02:28:07.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c659c700 1 -- 172.21.15.31:0/73658452 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c815a780 con 0x7f59c81592f0 2024-08-17T02:28:07.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c759e700 1 -- 172.21.15.31:0/73658452 >> v1:172.21.15.92:6789/0 conn(0x7f59c81592f0 legacy=0x7f59c80cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c759e700 1 -- 172.21.15.31:0/73658452 >> v1:172.21.15.31:6789/0 conn(0x7f59c81596c0 legacy=0x7f59c80cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c659c700 1 -- 172.21.15.31:0/73658452 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2953871419 0 0) 0x7f59b4003570 con 0x7f59c81596c0 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c759e700 1 -- 172.21.15.31:0/73658452 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8159b70 con 0x7f59c80cd050 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c759e700 1 --2- 172.21.15.31:0/73658452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c80cd050 0x7f59c8164370 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009e60 tx=0x7f59c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=270afc296836cbd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c659c700 1 -- 172.21.15.31:0/73658452 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000e070 con 0x7f59c80cd050 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c659c700 1 -- 172.21.15.31:0/73658452 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000b7a0 con 0x7f59c80cd050 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.611+0000 7f59c659c700 1 -- 172.21.15.31:0/73658452 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0001470 con 0x7f59c80cd050 2024-08-17T02:28:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.615+0000 7f59cc930700 1 -- 172.21.15.31:0/73658452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c80cd050 msgr2=0x7f59c8164370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.615+0000 7f59cc930700 1 --2- 172.21.15.31:0/73658452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c80cd050 0x7f59c8164370 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009e60 tx=0x7f59c0009780 comp rx=0 tx=0).stop 2024-08-17T02:28:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.615+0000 7f59cc930700 1 -- 172.21.15.31:0/73658452 shutdown_connections 2024-08-17T02:28:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.615+0000 7f59cc930700 1 --2- 172.21.15.31:0/73658452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c80cd050 0x7f59c8164370 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.615+0000 7f59cc930700 1 -- 172.21.15.31:0/73658452 >> 172.21.15.31:0/73658452 conn(0x7f59c8067400 msgr2=0x7f59c8067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.615+0000 7f59cc930700 1 -- 172.21.15.31:0/73658452 shutdown_connections 2024-08-17T02:28:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.615+0000 7f59cc930700 1 -- 172.21.15.31:0/73658452 wait complete. 2024-08-17T02:28:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.615+0000 7f59cc930700 1 Processor -- start 2024-08-17T02:28:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.615+0000 7f59cc930700 1 -- start start 2024-08-17T02:28:07.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59cc930700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59c80cd050 0x7f59c80c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59cc930700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c81592f0 0x7f59c814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59cc930700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c81596c0 0x7f59c814d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59cc930700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b44d0 con 0x7f59c81592f0 2024-08-17T02:28:07.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59cc930700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c814fcf0 con 0x7f59c81596c0 2024-08-17T02:28:07.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59cc930700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c814ffd0 con 0x7f59c80cd050 2024-08-17T02:28:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59be59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c81592f0 0x7f59c814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59be59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c81592f0 0x7f59c814f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55424/0 (socket says 172.21.15.31:55424) 2024-08-17T02:28:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59be59c700 1 -- 172.21.15.31:0/1813843601 learned_addr learned my addr 172.21.15.31:0/1813843601 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59c759e700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c81596c0 0x7f59c814d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59c6d9d700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59c80cd050 0x7f59c80c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59be59c700 1 -- 172.21.15.31:0/1813843601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59c80cd050 msgr2=0x7f59c80c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59be59c700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59c80cd050 0x7f59c80c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59be59c700 1 -- 172.21.15.31:0/1813843601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c81596c0 msgr2=0x7f59c814d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59be59c700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c81596c0 0x7f59c814d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59be59c700 1 -- 172.21.15.31:0/1813843601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c0009a20 con 0x7f59c81592f0 2024-08-17T02:28:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59be59c700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c81592f0 0x7f59c814f410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f59b000cb70 tx=0x7f59b0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59bf7fe700 1 -- 172.21.15.31:0/1813843601 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0007150 con 0x7f59c81592f0 2024-08-17T02:28:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59bf7fe700 1 -- 172.21.15.31:0/1813843601 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b00072b0 con 0x7f59c81592f0 2024-08-17T02:28:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59cc930700 1 -- 172.21.15.31:0/1813843601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c80b4160 con 0x7f59c81592f0 2024-08-17T02:28:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59bf7fe700 1 -- 172.21.15.31:0/1813843601 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0007670 con 0x7f59c81592f0 2024-08-17T02:28:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.619+0000 7f59cc930700 1 -- 172.21.15.31:0/1813843601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c814dd40 con 0x7f59c81592f0 2024-08-17T02:28:07.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.623+0000 7f59cc930700 1 -- 172.21.15.31:0/1813843601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c80b4680 con 0x7f59c81592f0 2024-08-17T02:28:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.623+0000 7f59bf7fe700 1 -- 172.21.15.31:0/1813843601 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f59b0004a40 con 0x7f59c81592f0 2024-08-17T02:28:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.623+0000 7f59bf7fe700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f59a8060860 0x7f59a8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.623+0000 7f59bf7fe700 1 -- 172.21.15.31:0/1813843601 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f59b007c340 con 0x7f59c81592f0 2024-08-17T02:28:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.623+0000 7f59c6d9d700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f59a8060860 0x7f59a8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.623+0000 7f59c6d9d700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f59a8060860 0x7f59a8062d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f59b8007fd0 tx=0x7f59b8007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.631+0000 7f59bf7fe700 1 -- 172.21.15.31:0/1813843601 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f59c80b4680 con 0x7f59c81592f0 2024-08-17T02:28:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:07.803+0000 7f59cc930700 1 -- 172.21.15.31:0/1813843601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59c80712b0 con 0x7f59c81592f0 2024-08-17T02:28:08.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.471+0000 7f59bf7fe700 1 -- 172.21.15.31:0/1813843601 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7f59b004faa0 con 0x7f59c81592f0 2024-08-17T02:28:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 -- 172.21.15.31:0/1813843601 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f59a8060860 msgr2=0x7f59a8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f59a8060860 0x7f59a8062d10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f59b8007fd0 tx=0x7f59b8007d50 comp rx=0 tx=0).stop 2024-08-17T02:28:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 -- 172.21.15.31:0/1813843601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c81592f0 msgr2=0x7f59c814f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c81592f0 0x7f59c814f410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f59b000cb70 tx=0x7f59b0001ab0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 -- 172.21.15.31:0/1813843601 shutdown_connections 2024-08-17T02:28:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f59a8060860 0x7f59a8062d10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c81596c0 0x7f59c814d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c81592f0 0x7f59c814f410 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 --2- 172.21.15.31:0/1813843601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59c80cd050 0x7f59c80c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 -- 172.21.15.31:0/1813843601 >> 172.21.15.31:0/1813843601 conn(0x7f59c8067400 msgr2=0x7f59c80c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 -- 172.21.15.31:0/1813843601 shutdown_connections 2024-08-17T02:28:08.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.479+0000 7f59cc930700 1 -- 172.21.15.31:0/1813843601 wait complete. 2024-08-17T02:28:08.487 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:28:08.500 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:28:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.607+0000 7f8e5239b700 1 Processor -- start 2024-08-17T02:28:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.607+0000 7f8e5239b700 1 -- start start 2024-08-17T02:28:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.607+0000 7f8e5239b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e4c1553b0 0x7f8e4c155780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.607+0000 7f8e5239b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c155cc0 0x7f8e4c067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.607+0000 7f8e5239b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8e4c067940 0x7f8e4c067dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.607+0000 7f8e5239b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c156150 con 0x7f8e4c1553b0 2024-08-17T02:28:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.607+0000 7f8e5239b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c156430 con 0x7f8e4c067940 2024-08-17T02:28:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.607+0000 7f8e5239b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c156710 con 0x7f8e4c155cc0 2024-08-17T02:28:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e51399700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e4c1553b0 0x7f8e4c155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e51399700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e4c1553b0 0x7f8e4c155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55438/0 (socket says 172.21.15.31:55438) 2024-08-17T02:28:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e51399700 1 -- 172.21.15.31:0/213326178 learned_addr learned my addr 172.21.15.31:0/213326178 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e51b9a700 1 --2- 172.21.15.31:0/213326178 >> v2:172.21.15.92:3300/0 conn(0x7f8e4c067940 0x7f8e4c067dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e50b98700 1 --2- 172.21.15.31:0/213326178 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c155cc0 0x7f8e4c067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e51399700 1 -- 172.21.15.31:0/213326178 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c155cc0 msgr2=0x7f8e4c067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e51399700 1 --2- 172.21.15.31:0/213326178 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c155cc0 0x7f8e4c067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e51399700 1 -- 172.21.15.31:0/213326178 >> v2:172.21.15.92:3300/0 conn(0x7f8e4c067940 msgr2=0x7f8e4c067dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e51399700 1 --2- 172.21.15.31:0/213326178 >> v2:172.21.15.92:3300/0 conn(0x7f8e4c067940 0x7f8e4c067dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e51399700 1 -- 172.21.15.31:0/213326178 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c1569f0 con 0x7f8e4c1553b0 2024-08-17T02:28:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e51399700 1 --2- 172.21.15.31:0/213326178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c1553b0 0x7f8e4c155780 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0cc650 tx=0x7f8e4800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27d7dc06fa2f17c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e43fff700 1 -- 172.21.15.31:0/213326178 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800c970 con 0x7f8e4c1553b0 2024-08-17T02:28:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e43fff700 1 -- 172.21.15.31:0/213326178 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4800cad0 con 0x7f8e4c1553b0 2024-08-17T02:28:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e43fff700 1 -- 172.21.15.31:0/213326178 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800ce70 con 0x7f8e4c1553b0 2024-08-17T02:28:08.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e5239b700 1 -- 172.21.15.31:0/213326178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c1553b0 msgr2=0x7f8e4c155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e5239b700 1 --2- 172.21.15.31:0/213326178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c1553b0 0x7f8e4c155780 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0cc650 tx=0x7f8e4800a3f0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e5239b700 1 -- 172.21.15.31:0/213326178 shutdown_connections 2024-08-17T02:28:08.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e5239b700 1 --2- 172.21.15.31:0/213326178 >> v2:172.21.15.92:3300/0 conn(0x7f8e4c067940 0x7f8e4c067dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e5239b700 1 --2- 172.21.15.31:0/213326178 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c155cc0 0x7f8e4c067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e5239b700 1 --2- 172.21.15.31:0/213326178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c1553b0 0x7f8e4c155780 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e5239b700 1 -- 172.21.15.31:0/213326178 >> 172.21.15.31:0/213326178 conn(0x7f8e4c06bbb0 msgr2=0x7f8e4c0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e5239b700 1 -- 172.21.15.31:0/213326178 shutdown_connections 2024-08-17T02:28:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.611+0000 7f8e5239b700 1 -- 172.21.15.31:0/213326178 wait complete. 2024-08-17T02:28:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e5239b700 1 Processor -- start 2024-08-17T02:28:08.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e5239b700 1 -- start start 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e5239b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c067940 0x7f8e4c146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e5239b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e4c1553b0 0x7f8e4c144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e5239b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c155cc0 0x7f8e4c144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e5239b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c145ff0 con 0x7f8e4c155cc0 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e5239b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1453e0 con 0x7f8e4c1553b0 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e5239b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1456c0 con 0x7f8e4c067940 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e51b9a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c155cc0 0x7f8e4c144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e51b9a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c155cc0 0x7f8e4c144b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55450/0 (socket says 172.21.15.31:55450) 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e51b9a700 1 -- 172.21.15.31:0/2121691161 learned_addr learned my addr 172.21.15.31:0/2121691161 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e50b98700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e4c1553b0 0x7f8e4c144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e51399700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c067940 0x7f8e4c146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e51b9a700 1 -- 172.21.15.31:0/2121691161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c067940 msgr2=0x7f8e4c146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e51b9a700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c067940 0x7f8e4c146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e51b9a700 1 -- 172.21.15.31:0/2121691161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e4c1553b0 msgr2=0x7f8e4c144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e51b9a700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e4c1553b0 0x7f8e4c144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e51b9a700 1 -- 172.21.15.31:0/2121691161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4800a690 con 0x7f8e4c155cc0 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e51b9a700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c155cc0 0x7f8e4c144b80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400e380 tx=0x7f8e4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e417fa700 1 -- 172.21.15.31:0/2121691161 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400eec0 con 0x7f8e4c155cc0 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e417fa700 1 -- 172.21.15.31:0/2121691161 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44012430 con 0x7f8e4c155cc0 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e5239b700 1 -- 172.21.15.31:0/2121691161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c1459a0 con 0x7f8e4c155cc0 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e417fa700 1 -- 172.21.15.31:0/2121691161 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e440127f0 con 0x7f8e4c155cc0 2024-08-17T02:28:08.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.615+0000 7f8e5239b700 1 -- 172.21.15.31:0/2121691161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c1450c0 con 0x7f8e4c155cc0 2024-08-17T02:28:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.619+0000 7f8e5239b700 1 -- 172.21.15.31:0/2121691161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c1461a0 con 0x7f8e4c155cc0 2024-08-17T02:28:08.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.619+0000 7f8e417fa700 1 -- 172.21.15.31:0/2121691161 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8e44012ba0 con 0x7f8e4c155cc0 2024-08-17T02:28:08.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.619+0000 7f8e417fa700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060890 0x7f8e30062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.619+0000 7f8e417fa700 1 -- 172.21.15.31:0/2121691161 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6367+0+0 (secure 0 0 0) 0x7f8e44016070 con 0x7f8e4c155cc0 2024-08-17T02:28:08.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.619+0000 7f8e51399700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060890 0x7f8e30062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.619+0000 7f8e51399700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060890 0x7f8e30062d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0cc650 tx=0x7f8e4801a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.627+0000 7f8e417fa700 1 -- 172.21.15.31:0/2121691161 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f8e4c1461a0 con 0x7f8e4c155cc0 2024-08-17T02:28:08.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:08.795+0000 7f8e5239b700 1 -- 172.21.15.31:0/2121691161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e4c0712b0 con 0x7f8e4c155cc0 2024-08-17T02:28:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.479+0000 7f8e417fa700 1 -- 172.21.15.31:0/2121691161 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8e4404ffc0 con 0x7f8e4c155cc0 2024-08-17T02:28:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 -- 172.21.15.31:0/2121691161 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060890 msgr2=0x7f8e30062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060890 0x7f8e30062d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0cc650 tx=0x7f8e4801a000 comp rx=0 tx=0).stop 2024-08-17T02:28:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 -- 172.21.15.31:0/2121691161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c155cc0 msgr2=0x7f8e4c144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c155cc0 0x7f8e4c144b80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400e380 tx=0x7f8e4400b040 comp rx=0 tx=0).stop 2024-08-17T02:28:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 -- 172.21.15.31:0/2121691161 shutdown_connections 2024-08-17T02:28:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f8e30060890 0x7f8e30062d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e4c155cc0 0x7f8e4c144b80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e4c1553b0 0x7f8e4c144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 --2- 172.21.15.31:0/2121691161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c067940 0x7f8e4c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 -- 172.21.15.31:0/2121691161 >> 172.21.15.31:0/2121691161 conn(0x7f8e4c06bbb0 msgr2=0x7f8e4c0b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 -- 172.21.15.31:0/2121691161 shutdown_connections 2024-08-17T02:28:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.483+0000 7f8e5239b700 1 -- 172.21.15.31:0/2121691161 wait complete. 2024-08-17T02:28:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-08-17T02:28:09.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:09.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb9091700 1 Processor -- start 2024-08-17T02:28:09.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb9091700 1 -- start start 2024-08-17T02:28:09.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb9091700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7efeb415ce20 0x7efeb415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb9091700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efeb40ad6f0 0x7efeb40adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb9091700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb415b2b0 con 0x7efeb4159830 2024-08-17T02:28:09.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb9091700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb40ae410 con 0x7efeb40ad6f0 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb9091700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb415aca0 con 0x7efeb415ce20 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efeb40ad6f0 0x7efeb40adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efeb40ad6f0 0x7efeb40adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55458/0 (socket says 172.21.15.31:55458) 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb37fe700 1 -- 172.21.15.31:0/4243094563 learned_addr learned my addr 172.21.15.31:0/4243094563 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb3fff700 1 --2- 172.21.15.31:0/4243094563 >> v2:172.21.15.92:3300/0 conn(0x7efeb415ce20 0x7efeb415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb37fe700 1 -- 172.21.15.31:0/4243094563 >> v2:172.21.15.92:3300/0 conn(0x7efeb415ce20 msgr2=0x7efeb415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb37fe700 1 --2- 172.21.15.31:0/4243094563 >> v2:172.21.15.92:3300/0 conn(0x7efeb415ce20 0x7efeb415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb37fe700 1 -- 172.21.15.31:0/4243094563 >> v1:172.21.15.92:6789/0 conn(0x7efeb4159830 legacy=0x7efeb4159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb37fe700 1 -- 172.21.15.31:0/4243094563 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb415d730 con 0x7efeb40ad6f0 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.603+0000 7efeb3fff700 1 --2- 172.21.15.31:0/4243094563 >> v2:172.21.15.92:3300/0 conn(0x7efeb415ce20 0x7efeb415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:09.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb37fe700 1 --2- 172.21.15.31:0/4243094563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb40ad6f0 0x7efeb40adb10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efeb40686d0 tx=0x7efe9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15ddee1ae328465 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb2ffd700 1 -- 172.21.15.31:0/4243094563 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00b860 con 0x7efeb40ad6f0 2024-08-17T02:28:09.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb2ffd700 1 -- 172.21.15.31:0/4243094563 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c00b9c0 con 0x7efeb40ad6f0 2024-08-17T02:28:09.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb2ffd700 1 -- 172.21.15.31:0/4243094563 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00bd60 con 0x7efeb40ad6f0 2024-08-17T02:28:09.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb9091700 1 -- 172.21.15.31:0/4243094563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb40ad6f0 msgr2=0x7efeb40adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb9091700 1 --2- 172.21.15.31:0/4243094563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb40ad6f0 0x7efeb40adb10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efeb40686d0 tx=0x7efe9c009250 comp rx=0 tx=0).stop 2024-08-17T02:28:09.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb9091700 1 -- 172.21.15.31:0/4243094563 shutdown_connections 2024-08-17T02:28:09.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb9091700 1 --2- 172.21.15.31:0/4243094563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb40ad6f0 0x7efeb40adb10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb9091700 1 --2- 172.21.15.31:0/4243094563 >> v2:172.21.15.92:3300/0 conn(0x7efeb415ce20 0x7efeb415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb9091700 1 -- 172.21.15.31:0/4243094563 >> 172.21.15.31:0/4243094563 conn(0x7efeb4089cb0 msgr2=0x7efeb40995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb9091700 1 -- 172.21.15.31:0/4243094563 shutdown_connections 2024-08-17T02:28:09.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb9091700 1 -- 172.21.15.31:0/4243094563 wait complete. 2024-08-17T02:28:09.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb9091700 1 Processor -- start 2024-08-17T02:28:09.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.607+0000 7efeb9091700 1 -- start start 2024-08-17T02:28:09.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb9091700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb40ad6f0 0x7efeb40b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb9091700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efeb4159830 0x7efeb40cf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb9091700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb415ce20 0x7efeb4158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb9091700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4169f20 con 0x7efeb415ce20 2024-08-17T02:28:09.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb9091700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40afe70 con 0x7efeb40ad6f0 2024-08-17T02:28:09.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb9091700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb416d9b0 con 0x7efeb4159830 2024-08-17T02:28:09.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb8890700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb415ce20 0x7efeb4158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb40ad6f0 0x7efeb40b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb8890700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb415ce20 0x7efeb4158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55472/0 (socket says 172.21.15.31:55472) 2024-08-17T02:28:09.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb8890700 1 -- 172.21.15.31:0/1633412461 learned_addr learned my addr 172.21.15.31:0/1633412461 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:09.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb37fe700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efeb4159830 0x7efeb40cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb8890700 1 -- 172.21.15.31:0/1633412461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efeb4159830 msgr2=0x7efeb40cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb8890700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efeb4159830 0x7efeb40cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb8890700 1 -- 172.21.15.31:0/1633412461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb40ad6f0 msgr2=0x7efeb40b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb8890700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb40ad6f0 0x7efeb40b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb8890700 1 -- 172.21.15.31:0/1633412461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c0094f0 con 0x7efeb415ce20 2024-08-17T02:28:09.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb8890700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb415ce20 0x7efeb4158820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efeac00c4c0 tx=0x7efeac007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeabfff700 1 -- 172.21.15.31:0/1633412461 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00ce70 con 0x7efeb415ce20 2024-08-17T02:28:09.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeabfff700 1 -- 172.21.15.31:0/1633412461 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac011590 con 0x7efeb415ce20 2024-08-17T02:28:09.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb9091700 1 -- 172.21.15.31:0/1633412461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb416dc90 con 0x7efeb415ce20 2024-08-17T02:28:09.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeabfff700 1 -- 172.21.15.31:0/1633412461 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac011970 con 0x7efeb415ce20 2024-08-17T02:28:09.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb9091700 1 -- 172.21.15.31:0/1633412461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb416e250 con 0x7efeb415ce20 2024-08-17T02:28:09.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeb9091700 1 -- 172.21.15.31:0/1633412461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb416a090 con 0x7efeb415ce20 2024-08-17T02:28:09.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.611+0000 7efeabfff700 1 -- 172.21.15.31:0/1633412461 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7efeac011ce0 con 0x7efeb415ce20 2024-08-17T02:28:09.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.615+0000 7efeabfff700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7efe94060860 0x7efe94062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.615+0000 7efeabfff700 1 -- 172.21.15.31:0/1633412461 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5837+0+0 (secure 0 0 0) 0x7efeac07bfe0 con 0x7efeb415ce20 2024-08-17T02:28:09.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.615+0000 7efeb3fff700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7efe94060860 0x7efe94062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.615+0000 7efeb3fff700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7efe94060860 0x7efe94062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efeb4159740 tx=0x7efea40099d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.619+0000 7efeabfff700 1 -- 172.21.15.31:0/1633412461 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7efeb416a090 con 0x7efeb415ce20 2024-08-17T02:28:09.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.791+0000 7efeb9091700 1 -- 172.21.15.31:0/1633412461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeb416a060 con 0x7efeb415ce20 2024-08-17T02:28:09.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeabfff700 1 -- 172.21.15.31:0/1633412461 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15464 (secure 0 0 0) 0x7efeac017020 con 0x7efeb415ce20 2024-08-17T02:28:09.800 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:09.800 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":46,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:28:09.474761+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000037340.meta","create_time":"2024-08-17T02:25:57.739259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000037340"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000037340.data","create_time":"2024-08-17T02:25:58.749832+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000037340"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6837/1886584780":"2024-08-18T02:28:06.459399+0000","172.21.15.31:6835/1886584780":"2024-08-18T02:28:06.459399+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 -- 172.21.15.31:0/1633412461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7efe94060860 msgr2=0x7efe94062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7efe94060860 0x7efe94062d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efeb4159740 tx=0x7efea40099d0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 -- 172.21.15.31:0/1633412461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb415ce20 msgr2=0x7efeb4158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb415ce20 0x7efeb4158820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efeac00c4c0 tx=0x7efeac007f50 comp rx=0 tx=0).stop 2024-08-17T02:28:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 -- 172.21.15.31:0/1633412461 shutdown_connections 2024-08-17T02:28:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7efe94060860 0x7efe94062d10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efeb415ce20 0x7efeb4158820 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efeb4159830 0x7efeb40cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 --2- 172.21.15.31:0/1633412461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efeb40ad6f0 0x7efeb40b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 -- 172.21.15.31:0/1633412461 >> 172.21.15.31:0/1633412461 conn(0x7efeb4089cb0 msgr2=0x7efeb40b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 -- 172.21.15.31:0/1633412461 shutdown_connections 2024-08-17T02:28:09.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.795+0000 7efeb9091700 1 -- 172.21.15.31:0/1633412461 wait complete. 2024-08-17T02:28:09.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:24:33.649413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000037340.meta', 'create_time': '2024-08-17T02:25:57.739259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000037340'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000037340.data', 'create_time': '2024-08-17T02:25:58.749832+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000037340'}}}] 2024-08-17T02:28:09.814 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:09.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2377265700 1 Processor -- start 2024-08-17T02:28:09.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2377265700 1 -- start start 2024-08-17T02:28:09.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2377265700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f237006a5d0 0x7f237014f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2377265700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23700ac540 0x7f2370156b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2377265700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700ae4c0 con 0x7f237006b190 2024-08-17T02:28:09.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2377265700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237014fca0 con 0x7f237006a5d0 2024-08-17T02:28:09.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2377265700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23700ae740 con 0x7f23700ac540 2024-08-17T02:28:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2376a64700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23700ac540 0x7f2370156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2375a62700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f237006a5d0 0x7f237014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2376263700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f237006b190 0x7f2370069ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:51722/0 (socket says 172.21.15.31:51722) 2024-08-17T02:28:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2376263700 1 -- 172.21.15.31:0/3440250804 learned_addr learned my addr 172.21.15.31:0/3440250804 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2376a64700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23700ac540 0x7f2370156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:43534/0 (socket says 172.21.15.31:43534) 2024-08-17T02:28:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2375261700 1 -- 172.21.15.31:0/3440250804 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529358275 0 0) 0x7f23700ae4c0 con 0x7f237006b190 2024-08-17T02:28:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2375261700 1 -- 172.21.15.31:0/3440250804 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2358003570 con 0x7f237006b190 2024-08-17T02:28:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2376a64700 1 -- 172.21.15.31:0/3440250804 >> v2:172.21.15.92:3300/0 conn(0x7f237006a5d0 msgr2=0x7f237014f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:09.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2376a64700 1 --2- 172.21.15.31:0/3440250804 >> v2:172.21.15.92:3300/0 conn(0x7f237006a5d0 0x7f237014f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2376a64700 1 -- 172.21.15.31:0/3440250804 >> v1:172.21.15.92:6789/0 conn(0x7f237006b190 legacy=0x7f2370069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2376a64700 1 -- 172.21.15.31:0/3440250804 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700ab780 con 0x7f23700ac540 2024-08-17T02:28:09.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.919+0000 7f2375a62700 1 --2- 172.21.15.31:0/3440250804 >> v2:172.21.15.92:3300/0 conn(0x7f237006a5d0 0x7f237014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:09.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2376a64700 1 --2- 172.21.15.31:0/3440250804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23700ac540 0x7f2370156b40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f236800aac0 tx=0x7f236800a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cead4eac6d68eb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2375261700 1 -- 172.21.15.31:0/3440250804 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800c930 con 0x7f23700ac540 2024-08-17T02:28:09.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2375261700 1 -- 172.21.15.31:0/3440250804 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236800ca90 con 0x7f23700ac540 2024-08-17T02:28:09.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2375261700 1 -- 172.21.15.31:0/3440250804 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800ce30 con 0x7f23700ac540 2024-08-17T02:28:09.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2377265700 1 -- 172.21.15.31:0/3440250804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23700ac540 msgr2=0x7f2370156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2377265700 1 --2- 172.21.15.31:0/3440250804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23700ac540 0x7f2370156b40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f236800aac0 tx=0x7f236800a330 comp rx=0 tx=0).stop 2024-08-17T02:28:09.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2377265700 1 -- 172.21.15.31:0/3440250804 shutdown_connections 2024-08-17T02:28:09.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2377265700 1 --2- 172.21.15.31:0/3440250804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23700ac540 0x7f2370156b40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2377265700 1 --2- 172.21.15.31:0/3440250804 >> v2:172.21.15.92:3300/0 conn(0x7f237006a5d0 0x7f237014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2377265700 1 -- 172.21.15.31:0/3440250804 >> 172.21.15.31:0/3440250804 conn(0x7f2370067e90 msgr2=0x7f23700cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2377265700 1 -- 172.21.15.31:0/3440250804 shutdown_connections 2024-08-17T02:28:09.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2377265700 1 -- 172.21.15.31:0/3440250804 wait complete. 2024-08-17T02:28:09.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2377265700 1 Processor -- start 2024-08-17T02:28:09.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.923+0000 7f2377265700 1 -- start start 2024-08-17T02:28:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2377265700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237006a5d0 0x7f237014bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2377265700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f237006b190 0x7f23700cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2377265700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23700ac540 0x7f23700cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2377265700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237014c9c0 con 0x7f23700ac540 2024-08-17T02:28:09.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2377265700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23701590f0 con 0x7f237006a5d0 2024-08-17T02:28:09.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2377265700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23701527d0 con 0x7f237006b190 2024-08-17T02:28:09.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2376a64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23700ac540 0x7f23700cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2376a64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23700ac540 0x7f23700cbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55480/0 (socket says 172.21.15.31:55480) 2024-08-17T02:28:09.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2376a64700 1 -- 172.21.15.31:0/3995533949 learned_addr learned my addr 172.21.15.31:0/3995533949 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:09.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2375a62700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f237006b190 0x7f23700cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2376263700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237006a5d0 0x7f237014bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2376a64700 1 -- 172.21.15.31:0/3995533949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f237006b190 msgr2=0x7f23700cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2376a64700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f237006b190 0x7f23700cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2376a64700 1 -- 172.21.15.31:0/3995533949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237006a5d0 msgr2=0x7f237014bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2376a64700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237006a5d0 0x7f237014bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2376a64700 1 -- 172.21.15.31:0/3995533949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c009a20 con 0x7f23700ac540 2024-08-17T02:28:09.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2376a64700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23700ac540 0x7f23700cbbb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f236800aa90 tx=0x7f236801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f23667fc700 1 -- 172.21.15.31:0/3995533949 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2368019e50 con 0x7f23700ac540 2024-08-17T02:28:09.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f23667fc700 1 -- 172.21.15.31:0/3995533949 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2368010600 con 0x7f23700ac540 2024-08-17T02:28:09.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2377265700 1 -- 172.21.15.31:0/3995533949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236800a5d0 con 0x7f23700ac540 2024-08-17T02:28:09.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f23667fc700 1 -- 172.21.15.31:0/3995533949 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23680109c0 con 0x7f23700ac540 2024-08-17T02:28:09.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2377265700 1 -- 172.21.15.31:0/3995533949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2370158aa0 con 0x7f23700ac540 2024-08-17T02:28:09.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.927+0000 7f2377265700 1 -- 172.21.15.31:0/3995533949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2370158900 con 0x7f23700ac540 2024-08-17T02:28:09.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.931+0000 7f23667fc700 1 -- 172.21.15.31:0/3995533949 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2368022070 con 0x7f23700ac540 2024-08-17T02:28:09.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.931+0000 7f23667fc700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f235c060890 0x7f235c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.931+0000 7f23667fc700 1 -- 172.21.15.31:0/3995533949 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f236807f940 con 0x7f23700ac540 2024-08-17T02:28:09.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.931+0000 7f2376263700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f235c060890 0x7f235c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.931+0000 7f2376263700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f235c060890 0x7f235c062d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2360007fd0 tx=0x7f2360009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:09.939+0000 7f23667fc700 1 -- 172.21.15.31:0/3995533949 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f236804fdc0 con 0x7f23700ac540 2024-08-17T02:28:10.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.099+0000 7f2377265700 1 -- 172.21.15.31:0/3995533949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2370158900 con 0x7f23700ac540 2024-08-17T02:28:10.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.099+0000 7f23667fc700 1 -- 172.21.15.31:0/3995533949 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2368029020 con 0x7f23700ac540 2024-08-17T02:28:10.104 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.099+0000 7f2377265700 1 -- 172.21.15.31:0/3995533949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f235c060890 msgr2=0x7f235c062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.099+0000 7f2377265700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f235c060890 0x7f235c062d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2360007fd0 tx=0x7f2360009040 comp rx=0 tx=0).stop 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.099+0000 7f2377265700 1 -- 172.21.15.31:0/3995533949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23700ac540 msgr2=0x7f23700cbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.099+0000 7f2377265700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23700ac540 0x7f23700cbbb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f236800aa90 tx=0x7f236801a000 comp rx=0 tx=0).stop 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.103+0000 7f2377265700 1 -- 172.21.15.31:0/3995533949 shutdown_connections 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.103+0000 7f2377265700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f235c060890 0x7f235c062d40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.103+0000 7f2377265700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23700ac540 0x7f23700cbbb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.103+0000 7f2377265700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f237006b190 0x7f23700cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.103+0000 7f2377265700 1 --2- 172.21.15.31:0/3995533949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237006a5d0 0x7f237014bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.103+0000 7f2377265700 1 -- 172.21.15.31:0/3995533949 >> 172.21.15.31:0/3995533949 conn(0x7f2370067e90 msgr2=0x7f23700afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.103+0000 7f2377265700 1 -- 172.21.15.31:0/3995533949 shutdown_connections 2024-08-17T02:28:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.103+0000 7f2377265700 1 -- 172.21.15.31:0/3995533949 wait complete. 2024-08-17T02:28:10.118 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000037340.meta pg_num 2024-08-17T02:28:10.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 Processor -- start 2024-08-17T02:28:10.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 -- start start 2024-08-17T02:28:10.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 0x7f4cc40b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc415ef10 con 0x7f4cc41603b0 2024-08-17T02:28:10.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc415e300 con 0x7f4cc415d6c0 2024-08-17T02:28:10.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc415e5e0 con 0x7f4cc40af5d0 2024-08-17T02:28:10.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc37fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4cc41603b0 0x7f4cc40aeec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49868/0 (socket says 172.21.15.31:49868) 2024-08-17T02:28:10.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc37fe700 1 -- 172.21.15.31:0/2840196192 learned_addr learned my addr 172.21.15.31:0/2840196192 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:10.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc8c20700 1 --2- 172.21.15.31:0/2840196192 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 0x7f4cc40b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc2ffd700 1 -- 172.21.15.31:0/2840196192 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213860994 0 0) 0x7f4cc415ef10 con 0x7f4cc41603b0 2024-08-17T02:28:10.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc2ffd700 1 -- 172.21.15.31:0/2840196192 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cac003570 con 0x7f4cc41603b0 2024-08-17T02:28:10.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc2ffd700 1 -- 172.21.15.31:0/2840196192 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1405642817 0 0) 0x7f4cac003570 con 0x7f4cc41603b0 2024-08-17T02:28:10.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc8c20700 1 -- 172.21.15.31:0/2840196192 >> v1:172.21.15.92:6789/0 conn(0x7f4cc415d6c0 legacy=0x7f4cc415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc8c20700 1 -- 172.21.15.31:0/2840196192 >> v1:172.21.15.31:6789/0 conn(0x7f4cc41603b0 legacy=0x7f4cc40aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc8c20700 1 -- 172.21.15.31:0/2840196192 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc415e8c0 con 0x7f4cc40af5d0 2024-08-17T02:28:10.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc8c20700 1 --2- 172.21.15.31:0/2840196192 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 0x7f4cc40b1b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009e90 tx=0x7f4cbc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5a921ccef326360 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc2ffd700 1 -- 172.21.15.31:0/2840196192 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc00e070 con 0x7f4cc40af5d0 2024-08-17T02:28:10.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc2ffd700 1 -- 172.21.15.31:0/2840196192 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cbc00b920 con 0x7f4cc40af5d0 2024-08-17T02:28:10.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cc2ffd700 1 -- 172.21.15.31:0/2840196192 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8001470 con 0x7f4cc40af5d0 2024-08-17T02:28:10.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 -- 172.21.15.31:0/2840196192 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 msgr2=0x7f4cc40b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 --2- 172.21.15.31:0/2840196192 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 0x7f4cc40b1b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009e90 tx=0x7f4cbc009780 comp rx=0 tx=0).stop 2024-08-17T02:28:10.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 -- 172.21.15.31:0/2840196192 shutdown_connections 2024-08-17T02:28:10.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 --2- 172.21.15.31:0/2840196192 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 0x7f4cc40b1b90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 -- 172.21.15.31:0/2840196192 >> 172.21.15.31:0/2840196192 conn(0x7f4cc4067e40 msgr2=0x7f4cc4068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.231+0000 7f4cca683700 1 -- 172.21.15.31:0/2840196192 shutdown_connections 2024-08-17T02:28:10.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cca683700 1 -- 172.21.15.31:0/2840196192 wait complete. 2024-08-17T02:28:10.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cca683700 1 Processor -- start 2024-08-17T02:28:10.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cca683700 1 -- start start 2024-08-17T02:28:10.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cca683700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 0x7f4cc40c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cca683700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc415d6c0 0x7f4cc40a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cca683700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cc41603b0 0x7f4cc40a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cca683700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40c9ee0 con 0x7f4cc415d6c0 2024-08-17T02:28:10.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cca683700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40cb6a0 con 0x7f4cc41603b0 2024-08-17T02:28:10.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cca683700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40c9920 con 0x7f4cc40af5d0 2024-08-17T02:28:10.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc415d6c0 0x7f4cc40a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc415d6c0 0x7f4cc40a57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55482/0 (socket says 172.21.15.31:55482) 2024-08-17T02:28:10.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc37fe700 1 -- 172.21.15.31:0/996495125 learned_addr learned my addr 172.21.15.31:0/996495125 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:10.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc3fff700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 0x7f4cc40c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc8c20700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cc41603b0 0x7f4cc40a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc37fe700 1 -- 172.21.15.31:0/996495125 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 msgr2=0x7f4cc40c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc37fe700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 0x7f4cc40c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc37fe700 1 -- 172.21.15.31:0/996495125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cc41603b0 msgr2=0x7f4cc40a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc37fe700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cc41603b0 0x7f4cc40a5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc37fe700 1 -- 172.21.15.31:0/996495125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc009a20 con 0x7f4cc415d6c0 2024-08-17T02:28:10.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc3fff700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 0x7f4cc40c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:10.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cc37fe700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc415d6c0 0x7f4cc40a57a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800c810 tx=0x7f4cb80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.235+0000 7f4cabfff700 1 -- 172.21.15.31:0/996495125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8007360 con 0x7f4cc415d6c0 2024-08-17T02:28:10.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.239+0000 7f4cabfff700 1 -- 172.21.15.31:0/996495125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb80074e0 con 0x7f4cc415d6c0 2024-08-17T02:28:10.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.239+0000 7f4cca683700 1 -- 172.21.15.31:0/996495125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc40c9c00 con 0x7f4cc415d6c0 2024-08-17T02:28:10.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.239+0000 7f4cabfff700 1 -- 172.21.15.31:0/996495125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8004830 con 0x7f4cc415d6c0 2024-08-17T02:28:10.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.239+0000 7f4cca683700 1 -- 172.21.15.31:0/996495125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc40a7f20 con 0x7f4cc415d6c0 2024-08-17T02:28:10.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.239+0000 7f4cca683700 1 -- 172.21.15.31:0/996495125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc40712b0 con 0x7f4cc415d6c0 2024-08-17T02:28:10.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.239+0000 7f4cabfff700 1 -- 172.21.15.31:0/996495125 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4cb8004c00 con 0x7f4cc415d6c0 2024-08-17T02:28:10.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.239+0000 7f4cabfff700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4cb0060860 0x7f4cb0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.239+0000 7f4cabfff700 1 -- 172.21.15.31:0/996495125 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f4cb807c060 con 0x7f4cc415d6c0 2024-08-17T02:28:10.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.239+0000 7f4cc3fff700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4cb0060860 0x7f4cb0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.243+0000 7f4cc3fff700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4cb0060860 0x7f4cb0062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4007fd0 tx=0x7f4cb4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.247+0000 7f4cabfff700 1 -- 172.21.15.31:0/996495125 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f4cb804fe20 con 0x7f4cc415d6c0 2024-08-17T02:28:10.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.407+0000 7f4cca683700 1 -- 172.21.15.31:0/996495125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000037340.meta", "var": "pg_num"} v 0) v1 -- 0x7f4cc4068d60 con 0x7f4cc415d6c0 2024-08-17T02:28:10.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cabfff700 1 -- 172.21.15.31:0/996495125 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000037340.meta", "var": "pg_num"}]=0 v46) v1 ==== 124+0+11 (secure 0 0 0) 0x7f4cb8018020 con 0x7f4cc415d6c0 2024-08-17T02:28:10.415 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:28:10.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 -- 172.21.15.31:0/996495125 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4cb0060860 msgr2=0x7f4cb0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4cb0060860 0x7f4cb0062d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4007fd0 tx=0x7f4cb4009040 comp rx=0 tx=0).stop 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 -- 172.21.15.31:0/996495125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc415d6c0 msgr2=0x7f4cc40a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc415d6c0 0x7f4cc40a57a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800c810 tx=0x7f4cb80019b0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 -- 172.21.15.31:0/996495125 shutdown_connections 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4cb0060860 0x7f4cb0062d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cc41603b0 0x7f4cc40a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4cc415d6c0 0x7f4cc40a57a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 --2- 172.21.15.31:0/996495125 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cc40af5d0 0x7f4cc40c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 -- 172.21.15.31:0/996495125 >> 172.21.15.31:0/996495125 conn(0x7f4cc4067e40 msgr2=0x7f4cc406d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 -- 172.21.15.31:0/996495125 shutdown_connections 2024-08-17T02:28:10.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.411+0000 7f4cca683700 1 -- 172.21.15.31:0/996495125 wait complete. 2024-08-17T02:28:10.429 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000037340.data pg_num 2024-08-17T02:28:10.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.535+0000 7f412dae1700 1 Processor -- start 2024-08-17T02:28:10.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.535+0000 7f412dae1700 1 -- start start 2024-08-17T02:28:10.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4128159330 0x7f41280b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41280b0c40 0x7f41280b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41280b2a60 con 0x7f4128159700 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41280b11b0 con 0x7f41280b0c40 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41280b1490 con 0x7f4128159330 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f4127fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41280b0c40 0x7f41280b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f4127fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f41280b0c40 0x7f41280b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55488/0 (socket says 172.21.15.31:55488) 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f4127fff700 1 -- 172.21.15.31:0/3643569312 learned_addr learned my addr 172.21.15.31:0/3643569312 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f41277fe700 1 --2- 172.21.15.31:0/3643569312 >> v2:172.21.15.92:3300/0 conn(0x7f4128159330 0x7f41280b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f4127fff700 1 -- 172.21.15.31:0/3643569312 >> v2:172.21.15.92:3300/0 conn(0x7f4128159330 msgr2=0x7f41280b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f4127fff700 1 --2- 172.21.15.31:0/3643569312 >> v2:172.21.15.92:3300/0 conn(0x7f4128159330 0x7f41280b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f4127fff700 1 -- 172.21.15.31:0/3643569312 >> v1:172.21.15.92:6789/0 conn(0x7f4128159700 legacy=0x7f41280b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f4127fff700 1 -- 172.21.15.31:0/3643569312 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41280b1770 con 0x7f41280b0c40 2024-08-17T02:28:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f4127fff700 1 --2- 172.21.15.31:0/3643569312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41280b0c40 0x7f41280b4170 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f41280890f0 tx=0x7f4120009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19acad8648b6585e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f41267fc700 1 -- 172.21.15.31:0/3643569312 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412000e070 con 0x7f41280b0c40 2024-08-17T02:28:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f41267fc700 1 -- 172.21.15.31:0/3643569312 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412000ba50 con 0x7f41280b0c40 2024-08-17T02:28:10.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f41267fc700 1 -- 172.21.15.31:0/3643569312 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41200092e0 con 0x7f41280b0c40 2024-08-17T02:28:10.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 -- 172.21.15.31:0/3643569312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41280b0c40 msgr2=0x7f41280b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 --2- 172.21.15.31:0/3643569312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41280b0c40 0x7f41280b4170 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f41280890f0 tx=0x7f4120009840 comp rx=0 tx=0).stop 2024-08-17T02:28:10.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 -- 172.21.15.31:0/3643569312 shutdown_connections 2024-08-17T02:28:10.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 --2- 172.21.15.31:0/3643569312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41280b0c40 0x7f41280b4170 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 --2- 172.21.15.31:0/3643569312 >> v2:172.21.15.92:3300/0 conn(0x7f4128159330 0x7f41280b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 -- 172.21.15.31:0/3643569312 >> 172.21.15.31:0/3643569312 conn(0x7f4128099610 msgr2=0x7f4128067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 -- 172.21.15.31:0/3643569312 shutdown_connections 2024-08-17T02:28:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.539+0000 7f412dae1700 1 -- 172.21.15.31:0/3643569312 wait complete. 2024-08-17T02:28:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f412dae1700 1 Processor -- start 2024-08-17T02:28:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f412dae1700 1 -- start start 2024-08-17T02:28:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f412dae1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41280b0c40 0x7f412816c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f412dae1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4128159330 0x7f412816c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f412dae1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4128159700 0x7f4128153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f412dae1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412816a740 con 0x7f4128159330 2024-08-17T02:28:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f412dae1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4128154820 con 0x7f41280b0c40 2024-08-17T02:28:10.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f412dae1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4128154b00 con 0x7f4128159700 2024-08-17T02:28:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f4126ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4128159330 0x7f412816c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f4126ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4128159330 0x7f412816c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55494/0 (socket says 172.21.15.31:55494) 2024-08-17T02:28:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f4126ffd700 1 -- 172.21.15.31:0/3579596644 learned_addr learned my addr 172.21.15.31:0/3579596644 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f41277fe700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41280b0c40 0x7f412816c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f4127fff700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4128159700 0x7f4128153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f4126ffd700 1 -- 172.21.15.31:0/3579596644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4128159700 msgr2=0x7f4128153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f4126ffd700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4128159700 0x7f4128153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f4126ffd700 1 -- 172.21.15.31:0/3579596644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41280b0c40 msgr2=0x7f412816c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f4126ffd700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41280b0c40 0x7f412816c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f4126ffd700 1 -- 172.21.15.31:0/3579596644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4120009ae0 con 0x7f4128159330 2024-08-17T02:28:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f41277fe700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41280b0c40 0x7f412816c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f4126ffd700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4128159330 0x7f412816c9c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f411000c4e0 tx=0x7f411000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f411f7fe700 1 -- 172.21.15.31:0/3579596644 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110011590 con 0x7f4128159330 2024-08-17T02:28:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f411f7fe700 1 -- 172.21.15.31:0/3579596644 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4110011710 con 0x7f4128159330 2024-08-17T02:28:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f411f7fe700 1 -- 172.21.15.31:0/3579596644 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110011ad0 con 0x7f4128159330 2024-08-17T02:28:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f412dae1700 1 -- 172.21.15.31:0/3579596644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412816a0f0 con 0x7f4128159330 2024-08-17T02:28:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.543+0000 7f412dae1700 1 -- 172.21.15.31:0/3579596644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4128153a40 con 0x7f4128159330 2024-08-17T02:28:10.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.547+0000 7f412dae1700 1 -- 172.21.15.31:0/3579596644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412816a8f0 con 0x7f4128159330 2024-08-17T02:28:10.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.547+0000 7f411f7fe700 1 -- 172.21.15.31:0/3579596644 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f411001b3b0 con 0x7f4128159330 2024-08-17T02:28:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.547+0000 7f411f7fe700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4108060890 0x7f4108062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.547+0000 7f411f7fe700 1 -- 172.21.15.31:0/3579596644 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f411007c240 con 0x7f4128159330 2024-08-17T02:28:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.547+0000 7f41277fe700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4108060890 0x7f4108062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.547+0000 7f41277fe700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4108060890 0x7f4108062d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4118006fd0 tx=0x7f4118008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.551+0000 7f411f7fe700 1 -- 172.21.15.31:0/3579596644 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f412816a8f0 con 0x7f4128159330 2024-08-17T02:28:10.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.715+0000 7f412dae1700 1 -- 172.21.15.31:0/3579596644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000037340.data", "var": "pg_num"} v 0) v1 -- 0x7f41280712b0 con 0x7f4128159330 2024-08-17T02:28:10.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.715+0000 7f411f7fe700 1 -- 172.21.15.31:0/3579596644 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000037340.data", "var": "pg_num"}]=0 v46) v1 ==== 124+0+11 (secure 0 0 0) 0x7f411004c570 con 0x7f4128159330 2024-08-17T02:28:10.722 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-08-17T02:28:10.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 -- 172.21.15.31:0/3579596644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4108060890 msgr2=0x7f4108062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4108060890 0x7f4108062d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4118006fd0 tx=0x7f4118008040 comp rx=0 tx=0).stop 2024-08-17T02:28:10.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 -- 172.21.15.31:0/3579596644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4128159330 msgr2=0x7f412816c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4128159330 0x7f412816c9c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f411000c4e0 tx=0x7f411000c8a0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 -- 172.21.15.31:0/3579596644 shutdown_connections 2024-08-17T02:28:10.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4108060890 0x7f4108062d40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4128159700 0x7f4128153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4128159330 0x7f412816c9c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 --2- 172.21.15.31:0/3579596644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41280b0c40 0x7f412816c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 -- 172.21.15.31:0/3579596644 >> 172.21.15.31:0/3579596644 conn(0x7f4128099610 msgr2=0x7f41281578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 -- 172.21.15.31:0/3579596644 shutdown_connections 2024-08-17T02:28:10.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.719+0000 7f412dae1700 1 -- 172.21.15.31:0/3579596644 wait complete. 2024-08-17T02:28:10.737 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:10.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 Processor -- start 2024-08-17T02:28:10.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 -- start start 2024-08-17T02:28:10.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f482815ce20 0x7f482815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482815b2b0 con 0x7f482815b740 2024-08-17T02:28:10.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48280ae410 con 0x7f48280ad6f0 2024-08-17T02:28:10.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48280ae220 con 0x7f482815ce20 2024-08-17T02:28:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482eb0c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f482815b740 0x7f482815bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50492/0 (socket says 172.21.15.31:50492) 2024-08-17T02:28:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482e30b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f482815ce20 0x7f482815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482eb0c700 1 -- 172.21.15.31:0/1602392777 learned_addr learned my addr 172.21.15.31:0/1602392777 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482d309700 1 -- 172.21.15.31:0/1602392777 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242069507 0 0) 0x7f482815b2b0 con 0x7f482815b740 2024-08-17T02:28:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482d309700 1 -- 172.21.15.31:0/1602392777 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4814003570 con 0x7f482815b740 2024-08-17T02:28:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482d309700 1 -- 172.21.15.31:0/1602392777 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770807568 0 0) 0x7f48280ae410 con 0x7f48280ad6f0 2024-08-17T02:28:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482d309700 1 -- 172.21.15.31:0/1602392777 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f482815b2b0 con 0x7f48280ad6f0 2024-08-17T02:28:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482e30b700 1 -- 172.21.15.31:0/1602392777 >> v1:172.21.15.92:6789/0 conn(0x7f48280ad6f0 legacy=0x7f48280adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482e30b700 1 -- 172.21.15.31:0/1602392777 >> v1:172.21.15.31:6789/0 conn(0x7f482815b740 legacy=0x7f482815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482e30b700 1 -- 172.21.15.31:0/1602392777 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482815aca0 con 0x7f482815ce20 2024-08-17T02:28:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482e30b700 1 --2- 172.21.15.31:0/1602392777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f482815ce20 0x7f482815d1f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f48240098e0 tx=0x7f48240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63eff277ac70ebcc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482d309700 1 -- 172.21.15.31:0/1602392777 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824011630 con 0x7f482815ce20 2024-08-17T02:28:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482d309700 1 -- 172.21.15.31:0/1602392777 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824011790 con 0x7f482815ce20 2024-08-17T02:28:10.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482d309700 1 -- 172.21.15.31:0/1602392777 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824011b30 con 0x7f482815ce20 2024-08-17T02:28:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 -- 172.21.15.31:0/1602392777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f482815ce20 msgr2=0x7f482815d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 --2- 172.21.15.31:0/1602392777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f482815ce20 0x7f482815d1f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f48240098e0 tx=0x7f48240091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 -- 172.21.15.31:0/1602392777 shutdown_connections 2024-08-17T02:28:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 --2- 172.21.15.31:0/1602392777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f482815ce20 0x7f482815d1f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 -- 172.21.15.31:0/1602392777 >> 172.21.15.31:0/1602392777 conn(0x7f4828089cb0 msgr2=0x7f48280995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.843+0000 7f482f30d700 1 -- 172.21.15.31:0/1602392777 shutdown_connections 2024-08-17T02:28:10.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482f30d700 1 -- 172.21.15.31:0/1602392777 wait complete. 2024-08-17T02:28:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482f30d700 1 Processor -- start 2024-08-17T02:28:10.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482f30d700 1 -- start start 2024-08-17T02:28:10.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482f30d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280ad6f0 0x7f48280b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482f30d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f482815b740 0x7f48280cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482f30d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f482815ce20 0x7f4828153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482f30d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48280cd820 con 0x7f48280ad6f0 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482f30d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4828099da0 con 0x7f482815b740 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482f30d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48280cead0 con 0x7f482815ce20 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482e30b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280ad6f0 0x7f48280b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482e30b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280ad6f0 0x7f48280b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60814/0 (socket says 172.21.15.31:60814) 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482e30b700 1 -- 172.21.15.31:0/507709126 learned_addr learned my addr 172.21.15.31:0/507709126 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482db0a700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f482815b740 0x7f48280cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.847+0000 7f482eb0c700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f482815ce20 0x7f4828153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482e30b700 1 -- 172.21.15.31:0/507709126 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f482815ce20 msgr2=0x7f4828153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482e30b700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f482815ce20 0x7f4828153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482e30b700 1 -- 172.21.15.31:0/507709126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f482815b740 msgr2=0x7f48280cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482e30b700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f482815b740 0x7f48280cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482e30b700 1 -- 172.21.15.31:0/507709126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4824009420 con 0x7f48280ad6f0 2024-08-17T02:28:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482db0a700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f482815b740 0x7f48280cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482eb0c700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f482815ce20 0x7f4828153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482e30b700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280ad6f0 0x7f48280b0cd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f482808a990 tx=0x7f4824017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f481e7fc700 1 -- 172.21.15.31:0/507709126 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482401f070 con 0x7f48280ad6f0 2024-08-17T02:28:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f481e7fc700 1 -- 172.21.15.31:0/507709126 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824000c90 con 0x7f48280ad6f0 2024-08-17T02:28:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482f30d700 1 -- 172.21.15.31:0/507709126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48280cda30 con 0x7f48280ad6f0 2024-08-17T02:28:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f481e7fc700 1 -- 172.21.15.31:0/507709126 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824025420 con 0x7f48280ad6f0 2024-08-17T02:28:10.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482f30d700 1 -- 172.21.15.31:0/507709126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48280ce2d0 con 0x7f48280ad6f0 2024-08-17T02:28:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f482f30d700 1 -- 172.21.15.31:0/507709126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48280712b0 con 0x7f48280ad6f0 2024-08-17T02:28:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.851+0000 7f481e7fc700 1 -- 172.21.15.31:0/507709126 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4824023070 con 0x7f48280ad6f0 2024-08-17T02:28:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.855+0000 7f481e7fc700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f480c060860 0x7f480c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.855+0000 7f481e7fc700 1 -- 172.21.15.31:0/507709126 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f482407e000 con 0x7f48280ad6f0 2024-08-17T02:28:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.855+0000 7f482db0a700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f480c060860 0x7f480c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.855+0000 7f482db0a700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f480c060860 0x7f480c062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f482816d530 tx=0x7f4818009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:10.863+0000 7f481e7fc700 1 -- 172.21.15.31:0/507709126 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f482404e450 con 0x7f48280ad6f0 2024-08-17T02:28:11.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.063+0000 7f482f30d700 1 -- 172.21.15.31:0/507709126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4828068280 con 0x7f48280ad6f0 2024-08-17T02:28:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.063+0000 7f481e7fc700 1 -- 172.21.15.31:0/507709126 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4612 (secure 0 0 0) 0x7f4824015090 con 0x7f48280ad6f0 2024-08-17T02:28:11.068 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:11.069 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1920530016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1920530016},{"type":"v1","addr":"172.21.15.92:6833","nonce":1920530016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3381009547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3381009547},{"type":"v1","addr":"172.21.15.92:6835","nonce":3381009547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5406,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1337392645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1337392645},{"type":"v1","addr":"172.21.15.31:6837","nonce":1337392645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:59.737073+0000","modified":"2024-08-17T02:26:01.269310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.31:6836/548139464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":548139464},{"type":"v1","addr":"172.21.15.31:6836","nonce":548139464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000037340","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:11.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 -- 172.21.15.31:0/507709126 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f480c060860 msgr2=0x7f480c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f480c060860 0x7f480c062d10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f482816d530 tx=0x7f4818009040 comp rx=0 tx=0).stop 2024-08-17T02:28:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 -- 172.21.15.31:0/507709126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280ad6f0 msgr2=0x7f48280b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280ad6f0 0x7f48280b0cd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f482808a990 tx=0x7f4824017000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 -- 172.21.15.31:0/507709126 shutdown_connections 2024-08-17T02:28:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f480c060860 0x7f480c062d10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f482815ce20 0x7f4828153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f482815b740 0x7f48280cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 --2- 172.21.15.31:0/507709126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48280ad6f0 0x7f48280b0cd0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 -- 172.21.15.31:0/507709126 >> 172.21.15.31:0/507709126 conn(0x7f4828089cb0 msgr2=0x7f4828155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 -- 172.21.15.31:0/507709126 shutdown_connections 2024-08-17T02:28:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.067+0000 7f482f30d700 1 -- 172.21.15.31:0/507709126 wait complete. 2024-08-17T02:28:11.074 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 19 2024-08-17T02:28:11.089 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:11.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46b5357700 1 Processor -- start 2024-08-17T02:28:11.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46b5357700 1 -- start start 2024-08-17T02:28:11.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46b5357700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f46b013c270 0x7f46b006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46b5357700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f46b015a1e0 0x7f46b006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46b5357700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b006ba20 0x7f46b00c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46b5357700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b006bea0 con 0x7f46b015a1e0 2024-08-17T02:28:11.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46b5357700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b00cbf40 con 0x7f46b013c270 2024-08-17T02:28:11.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46b5357700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00cc220 con 0x7f46b006ba20 2024-08-17T02:28:11.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46af7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f46b015a1e0 0x7f46b006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46af7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f46b015a1e0 0x7f46b006b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60816/0 (socket says 172.21.15.31:60816) 2024-08-17T02:28:11.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46af7fe700 1 -- 172.21.15.31:0/1991676640 learned_addr learned my addr 172.21.15.31:0/1991676640 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:11.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.187+0000 7f46affff700 1 --2- 172.21.15.31:0/1991676640 >> v2:172.21.15.92:3300/0 conn(0x7f46b013c270 0x7f46b006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b4b56700 1 --2- 172.21.15.31:0/1991676640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b006ba20 0x7f46b00c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46af7fe700 1 -- 172.21.15.31:0/1991676640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b006ba20 msgr2=0x7f46b00c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46af7fe700 1 --2- 172.21.15.31:0/1991676640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b006ba20 0x7f46b00c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46af7fe700 1 -- 172.21.15.31:0/1991676640 >> v2:172.21.15.92:3300/0 conn(0x7f46b013c270 msgr2=0x7f46b006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46af7fe700 1 --2- 172.21.15.31:0/1991676640 >> v2:172.21.15.92:3300/0 conn(0x7f46b013c270 0x7f46b006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46af7fe700 1 -- 172.21.15.31:0/1991676640 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b006caa0 con 0x7f46b015a1e0 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b4b56700 1 --2- 172.21.15.31:0/1991676640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b006ba20 0x7f46b00c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46af7fe700 1 --2- 172.21.15.31:0/1991676640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b015a1e0 0x7f46b006b4e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f46b006f240 tx=0x7f4698009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3123db878db4815f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46aeffd700 1 -- 172.21.15.31:0/1991676640 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800e070 con 0x7f46b015a1e0 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46aeffd700 1 -- 172.21.15.31:0/1991676640 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800ba50 con 0x7f46b015a1e0 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46aeffd700 1 -- 172.21.15.31:0/1991676640 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980092e0 con 0x7f46b015a1e0 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b5357700 1 -- 172.21.15.31:0/1991676640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b015a1e0 msgr2=0x7f46b006b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b5357700 1 --2- 172.21.15.31:0/1991676640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b015a1e0 0x7f46b006b4e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f46b006f240 tx=0x7f4698009840 comp rx=0 tx=0).stop 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b5357700 1 -- 172.21.15.31:0/1991676640 shutdown_connections 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b5357700 1 --2- 172.21.15.31:0/1991676640 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b006ba20 0x7f46b00c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b5357700 1 --2- 172.21.15.31:0/1991676640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b015a1e0 0x7f46b006b4e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b5357700 1 --2- 172.21.15.31:0/1991676640 >> v2:172.21.15.92:3300/0 conn(0x7f46b013c270 0x7f46b006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b5357700 1 -- 172.21.15.31:0/1991676640 >> 172.21.15.31:0/1991676640 conn(0x7f46b00cdf90 msgr2=0x7f46b00ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b5357700 1 -- 172.21.15.31:0/1991676640 shutdown_connections 2024-08-17T02:28:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.191+0000 7f46b5357700 1 -- 172.21.15.31:0/1991676640 wait complete. 2024-08-17T02:28:11.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46b5357700 1 Processor -- start 2024-08-17T02:28:11.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46b5357700 1 -- start start 2024-08-17T02:28:11.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46b5357700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b006ba20 0x7f46b0068510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46b5357700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b013c270 0x7f46b00b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46b5357700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b015a1e0 0x7f46b0141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46b5357700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b0069790 con 0x7f46b006ba20 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46b5357700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b0139720 con 0x7f46b013c270 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46b5357700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b0068b80 con 0x7f46b015a1e0 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46affff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b006ba20 0x7f46b0068510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46affff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b006ba20 0x7f46b0068510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60820/0 (socket says 172.21.15.31:60820) 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46affff700 1 -- 172.21.15.31:0/3119546455 learned_addr learned my addr 172.21.15.31:0/3119546455 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46af7fe700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b013c270 0x7f46b00b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46b4b56700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b015a1e0 0x7f46b0141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46affff700 1 -- 172.21.15.31:0/3119546455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b015a1e0 msgr2=0x7f46b0141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46affff700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b015a1e0 0x7f46b0141f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46affff700 1 -- 172.21.15.31:0/3119546455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b013c270 msgr2=0x7f46b00b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46affff700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b013c270 0x7f46b00b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46affff700 1 -- 172.21.15.31:0/3119546455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4698009ae0 con 0x7f46b006ba20 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46af7fe700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b013c270 0x7f46b00b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46b4b56700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b015a1e0 0x7f46b0141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.195+0000 7f46affff700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b006ba20 0x7f46b0068510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f46a000d890 tx=0x7f46a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46a7fff700 1 -- 172.21.15.31:0/3119546455 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000b600 con 0x7f46b006ba20 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46a7fff700 1 -- 172.21.15.31:0/3119546455 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a000b760 con 0x7f46b006ba20 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46a7fff700 1 -- 172.21.15.31:0/3119546455 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000bae0 con 0x7f46b006ba20 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46b5357700 1 -- 172.21.15.31:0/3119546455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b0068e60 con 0x7f46b006ba20 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46b5357700 1 -- 172.21.15.31:0/3119546455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b0069420 con 0x7f46b006ba20 2024-08-17T02:28:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46b5357700 1 -- 172.21.15.31:0/3119546455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b00712b0 con 0x7f46b006ba20 2024-08-17T02:28:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46a7fff700 1 -- 172.21.15.31:0/3119546455 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f46a001e460 con 0x7f46b006ba20 2024-08-17T02:28:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46a7fff700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4690060860 0x7f4690062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46af7fe700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4690060860 0x7f4690062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46a7fff700 1 -- 172.21.15.31:0/3119546455 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f46a007d340 con 0x7f46b006ba20 2024-08-17T02:28:11.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.199+0000 7f46af7fe700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4690060860 0x7f4690062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4698009880 tx=0x7f4698018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.207+0000 7f46a7fff700 1 -- 172.21.15.31:0/3119546455 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f46a004d710 con 0x7f46b006ba20 2024-08-17T02:28:11.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.375+0000 7f46b5357700 1 -- 172.21.15.31:0/3119546455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46b006d050 con 0x7f46b006ba20 2024-08-17T02:28:11.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.375+0000 7f46a7fff700 1 -- 172.21.15.31:0/3119546455 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15464 (secure 0 0 0) 0x7f46a0050d30 con 0x7f46b006ba20 2024-08-17T02:28:11.381 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:11.381 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":46,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:28:09.474761+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000037340.meta","create_time":"2024-08-17T02:25:57.739259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000037340"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000037340.data","create_time":"2024-08-17T02:25:58.749832+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000037340"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6837/1886584780":"2024-08-18T02:28:06.459399+0000","172.21.15.31:6835/1886584780":"2024-08-18T02:28:06.459399+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 -- 172.21.15.31:0/3119546455 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4690060860 msgr2=0x7f4690062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4690060860 0x7f4690062d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4698009880 tx=0x7f4698018000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 -- 172.21.15.31:0/3119546455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b006ba20 msgr2=0x7f46b0068510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b006ba20 0x7f46b0068510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f46a000d890 tx=0x7f46a0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 -- 172.21.15.31:0/3119546455 shutdown_connections 2024-08-17T02:28:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4690060860 0x7f4690062d10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46b015a1e0 0x7f46b0141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b013c270 0x7f46b00b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 --2- 172.21.15.31:0/3119546455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b006ba20 0x7f46b0068510 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 -- 172.21.15.31:0/3119546455 >> 172.21.15.31:0/3119546455 conn(0x7f46b00cdf90 msgr2=0x7f46b00ce360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 -- 172.21.15.31:0/3119546455 shutdown_connections 2024-08-17T02:28:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.379+0000 7f46b5357700 1 -- 172.21.15.31:0/3119546455 wait complete. 2024-08-17T02:28:11.396 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000037340 and related pools 2024-08-17T02:28:11.396 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:11.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.499+0000 7f974a027700 1 Processor -- start 2024-08-17T02:28:11.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.499+0000 7f974a027700 1 -- start start 2024-08-17T02:28:11.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.499+0000 7f974a027700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9744142c10 0x7f97440b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.499+0000 7f974a027700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f97440b12a0 0x7f974406b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.499+0000 7f974a027700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97440b1710 con 0x7f974406bab0 2024-08-17T02:28:11.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.499+0000 7f974a027700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97440b3a00 con 0x7f9744142c10 2024-08-17T02:28:11.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.499+0000 7f974a027700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97440b3e90 con 0x7f97440b12a0 2024-08-17T02:28:11.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9749025700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9744142c10 0x7f97440b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9749025700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9744142c10 0x7f97440b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60822/0 (socket says 172.21.15.31:60822) 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9749025700 1 -- 172.21.15.31:0/3444221304 learned_addr learned my addr 172.21.15.31:0/3444221304 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9748824700 1 --2- 172.21.15.31:0/3444221304 >> v2:172.21.15.92:3300/0 conn(0x7f97440b12a0 0x7f974406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9749025700 1 -- 172.21.15.31:0/3444221304 >> v2:172.21.15.92:3300/0 conn(0x7f97440b12a0 msgr2=0x7f974406b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9749025700 1 --2- 172.21.15.31:0/3444221304 >> v2:172.21.15.92:3300/0 conn(0x7f97440b12a0 0x7f974406b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9749025700 1 -- 172.21.15.31:0/3444221304 >> v1:172.21.15.92:6789/0 conn(0x7f974406bab0 legacy=0x7f974415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9749025700 1 -- 172.21.15.31:0/3444221304 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97440b30d0 con 0x7f9744142c10 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9743fff700 1 -- 172.21.15.31:0/3444221304 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017759192 0 0) 0x7f97440b1710 con 0x7f974406bab0 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9749025700 1 --2- 172.21.15.31:0/3444221304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9744142c10 0x7f97440b0d60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f974406f1f0 tx=0x7f973c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdc54ecf5284307 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9743fff700 1 -- 172.21.15.31:0/3444221304 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c009e70 con 0x7f9744142c10 2024-08-17T02:28:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9743fff700 1 -- 172.21.15.31:0/3444221304 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c00b860 con 0x7f9744142c10 2024-08-17T02:28:11.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f9743fff700 1 -- 172.21.15.31:0/3444221304 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c00bc00 con 0x7f9744142c10 2024-08-17T02:28:11.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f974a027700 1 -- 172.21.15.31:0/3444221304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9744142c10 msgr2=0x7f97440b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f974a027700 1 --2- 172.21.15.31:0/3444221304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9744142c10 0x7f97440b0d60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f974406f1f0 tx=0x7f973c009250 comp rx=0 tx=0).stop 2024-08-17T02:28:11.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f974a027700 1 -- 172.21.15.31:0/3444221304 shutdown_connections 2024-08-17T02:28:11.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f974a027700 1 --2- 172.21.15.31:0/3444221304 >> v2:172.21.15.92:3300/0 conn(0x7f97440b12a0 0x7f974406b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f974a027700 1 --2- 172.21.15.31:0/3444221304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9744142c10 0x7f97440b0d60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f974a027700 1 -- 172.21.15.31:0/3444221304 >> 172.21.15.31:0/3444221304 conn(0x7f97440cdfa0 msgr2=0x7f97440ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f974a027700 1 -- 172.21.15.31:0/3444221304 shutdown_connections 2024-08-17T02:28:11.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.503+0000 7f974a027700 1 -- 172.21.15.31:0/3444221304 wait complete. 2024-08-17T02:28:11.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f974a027700 1 Processor -- start 2024-08-17T02:28:11.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f974a027700 1 -- start start 2024-08-17T02:28:11.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f974a027700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f974406bab0 0x7f974415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f974a027700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97440b12a0 0x7f97440ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f974a027700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9744169700 0x7f97440c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f974a027700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440ca7c0 con 0x7f97440b12a0 2024-08-17T02:28:11.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f974a027700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974415aaf0 con 0x7f9744169700 2024-08-17T02:28:11.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f974a027700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974415add0 con 0x7f974406bab0 2024-08-17T02:28:11.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9748824700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97440b12a0 0x7f97440ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9748824700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97440b12a0 0x7f97440ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60824/0 (socket says 172.21.15.31:60824) 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9748824700 1 -- 172.21.15.31:0/3811809695 learned_addr learned my addr 172.21.15.31:0/3811809695 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9749826700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9744169700 0x7f97440c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9749025700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f974406bab0 0x7f974415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9748824700 1 -- 172.21.15.31:0/3811809695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f974406bab0 msgr2=0x7f974415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9748824700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f974406bab0 0x7f974415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9748824700 1 -- 172.21.15.31:0/3811809695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9744169700 msgr2=0x7f97440c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9748824700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9744169700 0x7f97440c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9748824700 1 -- 172.21.15.31:0/3811809695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0094f0 con 0x7f97440b12a0 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f9748824700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97440b12a0 0x7f97440ca280 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9738009ef0 tx=0x7f973800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f97417fa700 1 -- 172.21.15.31:0/3811809695 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800cc50 con 0x7f97440b12a0 2024-08-17T02:28:11.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f974a027700 1 -- 172.21.15.31:0/3811809695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974415b0b0 con 0x7f97440b12a0 2024-08-17T02:28:11.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f97417fa700 1 -- 172.21.15.31:0/3811809695 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973800f040 con 0x7f97440b12a0 2024-08-17T02:28:11.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f974a027700 1 -- 172.21.15.31:0/3811809695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974415b670 con 0x7f97440b12a0 2024-08-17T02:28:11.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.507+0000 7f97417fa700 1 -- 172.21.15.31:0/3811809695 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738014480 con 0x7f97440b12a0 2024-08-17T02:28:11.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.511+0000 7f974a027700 1 -- 172.21.15.31:0/3811809695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97440712b0 con 0x7f97440b12a0 2024-08-17T02:28:11.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.511+0000 7f97417fa700 1 -- 172.21.15.31:0/3811809695 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f97380147f0 con 0x7f97440b12a0 2024-08-17T02:28:11.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.511+0000 7f97417fa700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9730060860 0x7f9730062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.511+0000 7f97417fa700 1 -- 172.21.15.31:0/3811809695 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f973807daa0 con 0x7f97440b12a0 2024-08-17T02:28:11.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.511+0000 7f9749025700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9730060860 0x7f9730062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.511+0000 7f9749025700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9730060860 0x7f9730062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f974406f1f0 tx=0x7f973c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.519+0000 7f97417fa700 1 -- 172.21.15.31:0/3811809695 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f973804ddd0 con 0x7f97440b12a0 2024-08-17T02:28:11.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.718+0000 7f974a027700 1 -- 172.21.15.31:0/3811809695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97440c7e50 con 0x7f97440b12a0 2024-08-17T02:28:11.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.718+0000 7f97417fa700 1 -- 172.21.15.31:0/3811809695 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4612 (secure 0 0 0) 0x7f97380513f0 con 0x7f97440b12a0 2024-08-17T02:28:11.725 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:11.726 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1920530016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1920530016},{"type":"v1","addr":"172.21.15.92:6833","nonce":1920530016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3381009547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3381009547},{"type":"v1","addr":"172.21.15.92:6835","nonce":3381009547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5406,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1337392645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1337392645},{"type":"v1","addr":"172.21.15.31:6837","nonce":1337392645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:59.737073+0000","modified":"2024-08-17T02:26:01.269310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.31:6836/548139464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":548139464},{"type":"v1","addr":"172.21.15.31:6836","nonce":548139464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000037340","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:11.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 -- 172.21.15.31:0/3811809695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9730060860 msgr2=0x7f9730062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9730060860 0x7f9730062d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f974406f1f0 tx=0x7f973c017000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 -- 172.21.15.31:0/3811809695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97440b12a0 msgr2=0x7f97440ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97440b12a0 0x7f97440ca280 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9738009ef0 tx=0x7f973800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:11.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 -- 172.21.15.31:0/3811809695 shutdown_connections 2024-08-17T02:28:11.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f9730060860 0x7f9730062d10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9744169700 0x7f97440c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97440b12a0 0x7f97440ca280 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 --2- 172.21.15.31:0/3811809695 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f974406bab0 0x7f974415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 -- 172.21.15.31:0/3811809695 >> 172.21.15.31:0/3811809695 conn(0x7f97440cdfa0 msgr2=0x7f9744140560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 -- 172.21.15.31:0/3811809695 shutdown_connections 2024-08-17T02:28:11.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.722+0000 7f974a027700 1 -- 172.21.15.31:0/3811809695 wait complete. 2024-08-17T02:28:11.729 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 19 2024-08-17T02:28:11.740 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:11.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.846+0000 7fabe3d3b700 1 Processor -- start 2024-08-17T02:28:11.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.846+0000 7fabe3d3b700 1 -- start start 2024-08-17T02:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc069d90 0x7fabdc06a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fabdc0cb0b0 0x7fabdc155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc156e60 con 0x7fabdc0cc020 2024-08-17T02:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc0cb620 con 0x7fabdc0cb0b0 2024-08-17T02:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0cb900 con 0x7fabdc069d90 2024-08-17T02:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe22d8700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fabdc0cc020 0x7fabdc155fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50504/0 (socket says 172.21.15.31:50504) 2024-08-17T02:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe22d8700 1 -- 172.21.15.31:0/697846445 learned_addr learned my addr 172.21.15.31:0/697846445 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe1ad7700 1 --2- 172.21.15.31:0/697846445 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc069d90 0x7fabdc06a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe12d6700 1 --2- 172.21.15.31:0/697846445 >> v2:172.21.15.92:3300/0 conn(0x7fabdc0cb0b0 0x7fabdc155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe0ad5700 1 -- 172.21.15.31:0/697846445 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440249909 0 0) 0x7fabdc156e60 con 0x7fabdc0cc020 2024-08-17T02:28:11.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe0ad5700 1 -- 172.21.15.31:0/697846445 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc8003570 con 0x7fabdc0cc020 2024-08-17T02:28:11.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe1ad7700 1 -- 172.21.15.31:0/697846445 >> v2:172.21.15.92:3300/0 conn(0x7fabdc0cb0b0 msgr2=0x7fabdc155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe1ad7700 1 --2- 172.21.15.31:0/697846445 >> v2:172.21.15.92:3300/0 conn(0x7fabdc0cb0b0 0x7fabdc155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe1ad7700 1 -- 172.21.15.31:0/697846445 >> v1:172.21.15.31:6789/0 conn(0x7fabdc0cc020 legacy=0x7fabdc155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe1ad7700 1 -- 172.21.15.31:0/697846445 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc156810 con 0x7fabdc069d90 2024-08-17T02:28:11.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe1ad7700 1 --2- 172.21.15.31:0/697846445 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc069d90 0x7fabdc06a160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fabd80098e0 tx=0x7fabd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d79240112712e72c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe0ad5700 1 -- 172.21.15.31:0/697846445 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8011630 con 0x7fabdc069d90 2024-08-17T02:28:11.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe0ad5700 1 -- 172.21.15.31:0/697846445 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8011790 con 0x7fabdc069d90 2024-08-17T02:28:11.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe0ad5700 1 -- 172.21.15.31:0/697846445 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8011b30 con 0x7fabdc069d90 2024-08-17T02:28:11.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 -- 172.21.15.31:0/697846445 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc069d90 msgr2=0x7fabdc06a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 --2- 172.21.15.31:0/697846445 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc069d90 0x7fabdc06a160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fabd80098e0 tx=0x7fabd80091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 -- 172.21.15.31:0/697846445 shutdown_connections 2024-08-17T02:28:11.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 --2- 172.21.15.31:0/697846445 >> v2:172.21.15.92:3300/0 conn(0x7fabdc0cb0b0 0x7fabdc155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 --2- 172.21.15.31:0/697846445 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc069d90 0x7fabdc06a160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 -- 172.21.15.31:0/697846445 >> 172.21.15.31:0/697846445 conn(0x7fabdc069790 msgr2=0x7fabdc0b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 -- 172.21.15.31:0/697846445 shutdown_connections 2024-08-17T02:28:11.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.850+0000 7fabe3d3b700 1 -- 172.21.15.31:0/697846445 wait complete. 2024-08-17T02:28:11.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe3d3b700 1 Processor -- start 2024-08-17T02:28:11.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe3d3b700 1 -- start start 2024-08-17T02:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe3d3b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabdc069d90 0x7fabdc143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe3d3b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc0cb0b0 0x7fabdc144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe3d3b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabdc0cc020 0x7fabdc0a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe3d3b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc150850 con 0x7fabdc0cc020 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe3d3b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0a6c40 con 0x7fabdc069d90 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe3d3b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc0a6030 con 0x7fabdc0cb0b0 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe22d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabdc0cc020 0x7fabdc0a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe1ad7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabdc069d90 0x7fabdc143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe22d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabdc0cc020 0x7fabdc0a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60832/0 (socket says 172.21.15.31:60832) 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe1ad7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabdc069d90 0x7fabdc143ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:44326/0 (socket says 172.21.15.31:44326) 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe22d8700 1 -- 172.21.15.31:0/3541296592 learned_addr learned my addr 172.21.15.31:0/3541296592 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe12d6700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc0cb0b0 0x7fabdc144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe22d8700 1 -- 172.21.15.31:0/3541296592 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc0cb0b0 msgr2=0x7fabdc144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe22d8700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc0cb0b0 0x7fabdc144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe22d8700 1 -- 172.21.15.31:0/3541296592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabdc069d90 msgr2=0x7fabdc143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe22d8700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabdc069d90 0x7fabdc143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe22d8700 1 -- 172.21.15.31:0/3541296592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009420 con 0x7fabdc0cc020 2024-08-17T02:28:11.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe22d8700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabdc0cc020 0x7fabdc0a5470 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fabd4001460 tx=0x7fabd4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabd1ffb700 1 -- 172.21.15.31:0/3541296592 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd400a900 con 0x7fabdc0cc020 2024-08-17T02:28:11.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabd1ffb700 1 -- 172.21.15.31:0/3541296592 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd400aa60 con 0x7fabdc0cc020 2024-08-17T02:28:11.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.854+0000 7fabe3d3b700 1 -- 172.21.15.31:0/3541296592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc0a6310 con 0x7fabdc0cc020 2024-08-17T02:28:11.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.858+0000 7fabd1ffb700 1 -- 172.21.15.31:0/3541296592 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd400ade0 con 0x7fabdc0cc020 2024-08-17T02:28:11.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.858+0000 7fabe3d3b700 1 -- 172.21.15.31:0/3541296592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc0a68d0 con 0x7fabdc0cc020 2024-08-17T02:28:11.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.858+0000 7fabe3d3b700 1 -- 172.21.15.31:0/3541296592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc0cbe80 con 0x7fabdc0cc020 2024-08-17T02:28:11.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.858+0000 7fabd1ffb700 1 -- 172.21.15.31:0/3541296592 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fabd4007300 con 0x7fabdc0cc020 2024-08-17T02:28:11.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.858+0000 7fabd1ffb700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabc0060860 0x7fabc0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.858+0000 7fabd1ffb700 1 -- 172.21.15.31:0/3541296592 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fabd407d0b0 con 0x7fabdc0cc020 2024-08-17T02:28:11.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.858+0000 7fabe1ad7700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabc0060860 0x7fabc0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.858+0000 7fabe1ad7700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabc0060860 0x7fabc0062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fabd80091e0 tx=0x7fabd8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:11.866+0000 7fabd1ffb700 1 -- 172.21.15.31:0/3541296592 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fabdc0cbe80 con 0x7fabdc0cc020 2024-08-17T02:28:12.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.066+0000 7fabe3d3b700 1 -- 172.21.15.31:0/3541296592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabdc0cbe80 con 0x7fabdc0cc020 2024-08-17T02:28:12.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.066+0000 7fabd1ffb700 1 -- 172.21.15.31:0/3541296592 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4612 (secure 0 0 0) 0x7fabdc0cbe80 con 0x7fabdc0cc020 2024-08-17T02:28:12.074 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1920530016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1920530016},{"type":"v1","addr":"172.21.15.92:6833","nonce":1920530016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3381009547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3381009547},{"type":"v1","addr":"172.21.15.92:6835","nonce":3381009547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5406,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1337392645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1337392645},{"type":"v1","addr":"172.21.15.31:6837","nonce":1337392645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:59.737073+0000","modified":"2024-08-17T02:26:01.269310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":10,"addr":"172.21.15.31:6836/548139464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":548139464},{"type":"v1","addr":"172.21.15.31:6836","nonce":548139464}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000037340","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 -- 172.21.15.31:0/3541296592 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabc0060860 msgr2=0x7fabc0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabc0060860 0x7fabc0062d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fabd80091e0 tx=0x7fabd8017000 comp rx=0 tx=0).stop 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 -- 172.21.15.31:0/3541296592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabdc0cc020 msgr2=0x7fabdc0a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabdc0cc020 0x7fabdc0a5470 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fabd4001460 tx=0x7fabd4001a40 comp rx=0 tx=0).stop 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 -- 172.21.15.31:0/3541296592 shutdown_connections 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fabc0060860 0x7fabc0062d10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabdc0cc020 0x7fabdc0a5470 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabdc0cb0b0 0x7fabdc144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 --2- 172.21.15.31:0/3541296592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabdc069d90 0x7fabdc143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 -- 172.21.15.31:0/3541296592 >> 172.21.15.31:0/3541296592 conn(0x7fabdc069790 msgr2=0x7fabdc0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 -- 172.21.15.31:0/3541296592 shutdown_connections 2024-08-17T02:28:12.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.070+0000 7fabe3d3b700 1 -- 172.21.15.31:0/3541296592 wait complete. 2024-08-17T02:28:12.077 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 19 2024-08-17T02:28:12.092 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:12.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.194+0000 7f05ab433700 1 Processor -- start 2024-08-17T02:28:12.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.194+0000 7f05ab433700 1 -- start start 2024-08-17T02:28:12.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.194+0000 7f05ab433700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 0x7f05a4068f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.194+0000 7f05ab433700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f05a40aa1c0 0x7f05a40694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.194+0000 7f05ab433700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a40ab430 con 0x7f05a4153c30 2024-08-17T02:28:12.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.194+0000 7f05ab433700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a40aedd0 con 0x7f05a40aa1c0 2024-08-17T02:28:12.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.194+0000 7f05ab433700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40aa630 con 0x7f05a4153860 2024-08-17T02:28:12.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.194+0000 7f05a9c30700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f05a4153c30 0x7f05a40a9ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:60244/0 (socket says 172.21.15.31:60244) 2024-08-17T02:28:12.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.194+0000 7f05a9c30700 1 -- 172.21.15.31:0/2744269961 learned_addr learned my addr 172.21.15.31:0/2744269961 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:12.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.194+0000 7f05aa431700 1 --2- 172.21.15.31:0/2744269961 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 0x7f05a4068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05aac32700 1 --2- 172.21.15.31:0/2744269961 >> v2:172.21.15.92:3300/0 conn(0x7f05a40aa1c0 0x7f05a40694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05a942f700 1 -- 172.21.15.31:0/2744269961 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978822808 0 0) 0x7f05a40ab430 con 0x7f05a4153c30 2024-08-17T02:28:12.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05a942f700 1 -- 172.21.15.31:0/2744269961 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0590003570 con 0x7f05a4153c30 2024-08-17T02:28:12.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05aa431700 1 -- 172.21.15.31:0/2744269961 >> v2:172.21.15.92:3300/0 conn(0x7f05a40aa1c0 msgr2=0x7f05a40694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05aa431700 1 --2- 172.21.15.31:0/2744269961 >> v2:172.21.15.92:3300/0 conn(0x7f05a40aa1c0 0x7f05a40694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05aa431700 1 -- 172.21.15.31:0/2744269961 >> v1:172.21.15.92:6789/0 conn(0x7f05a4153c30 legacy=0x7f05a40a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05aa431700 1 -- 172.21.15.31:0/2744269961 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a40aa820 con 0x7f05a4153860 2024-08-17T02:28:12.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05aac32700 1 --2- 172.21.15.31:0/2744269961 >> v2:172.21.15.92:3300/0 conn(0x7f05a40aa1c0 0x7f05a40694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:12.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05aa431700 1 --2- 172.21.15.31:0/2744269961 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 0x7f05a4068f80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05a00098e0 tx=0x7f05a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c6552308e84cc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05a942f700 1 -- 172.21.15.31:0/2744269961 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0011630 con 0x7f05a4153860 2024-08-17T02:28:12.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05a942f700 1 -- 172.21.15.31:0/2744269961 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a0011790 con 0x7f05a4153860 2024-08-17T02:28:12.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05a942f700 1 -- 172.21.15.31:0/2744269961 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0011b10 con 0x7f05a4153860 2024-08-17T02:28:12.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05ab433700 1 -- 172.21.15.31:0/2744269961 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 msgr2=0x7f05a4068f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05ab433700 1 --2- 172.21.15.31:0/2744269961 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 0x7f05a4068f80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05a00098e0 tx=0x7f05a00091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05ab433700 1 -- 172.21.15.31:0/2744269961 shutdown_connections 2024-08-17T02:28:12.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05ab433700 1 --2- 172.21.15.31:0/2744269961 >> v2:172.21.15.92:3300/0 conn(0x7f05a40aa1c0 0x7f05a40694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05ab433700 1 --2- 172.21.15.31:0/2744269961 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 0x7f05a4068f80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05ab433700 1 -- 172.21.15.31:0/2744269961 >> 172.21.15.31:0/2744269961 conn(0x7f05a4067400 msgr2=0x7f05a4067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05ab433700 1 -- 172.21.15.31:0/2744269961 shutdown_connections 2024-08-17T02:28:12.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.198+0000 7f05ab433700 1 -- 172.21.15.31:0/2744269961 wait complete. 2024-08-17T02:28:12.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05ab433700 1 Processor -- start 2024-08-17T02:28:12.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05ab433700 1 -- start start 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05ab433700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a40aa1c0 0x7f05a4152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05ab433700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 0x7f05a414b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05ab433700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4153c30 0x7f05a415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05ab433700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40aef20 con 0x7f05a40aa1c0 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05ab433700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a4152120 con 0x7f05a4153c30 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05ab433700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a4152b60 con 0x7f05a4153860 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05aa431700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a40aa1c0 0x7f05a4152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05a9c30700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 0x7f05a414b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05aa431700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a40aa1c0 0x7f05a4152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60836/0 (socket says 172.21.15.31:60836) 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05aa431700 1 -- 172.21.15.31:0/1728166641 learned_addr learned my addr 172.21.15.31:0/1728166641 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:12.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05aac32700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4153c30 0x7f05a415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05a9c30700 1 -- 172.21.15.31:0/1728166641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4153c30 msgr2=0x7f05a415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05a9c30700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4153c30 0x7f05a415bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05a9c30700 1 -- 172.21.15.31:0/1728166641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a40aa1c0 msgr2=0x7f05a4152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05a9c30700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a40aa1c0 0x7f05a4152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05a9c30700 1 -- 172.21.15.31:0/1728166641 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c009a20 con 0x7f05a4153860 2024-08-17T02:28:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05a9c30700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 0x7f05a414b050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05980058d0 tx=0x7f0598007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05967fc700 1 -- 172.21.15.31:0/1728166641 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598005b30 con 0x7f05a4153860 2024-08-17T02:28:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05967fc700 1 -- 172.21.15.31:0/1728166641 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0598005cd0 con 0x7f05a4153860 2024-08-17T02:28:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05ab433700 1 -- 172.21.15.31:0/1728166641 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a0009420 con 0x7f05a4153860 2024-08-17T02:28:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05967fc700 1 -- 172.21.15.31:0/1728166641 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598007320 con 0x7f05a4153860 2024-08-17T02:28:12.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.202+0000 7f05ab433700 1 -- 172.21.15.31:0/1728166641 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a4150ef0 con 0x7f05a4153860 2024-08-17T02:28:12.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.206+0000 7f05ab433700 1 -- 172.21.15.31:0/1728166641 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a40712b0 con 0x7f05a4153860 2024-08-17T02:28:12.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.206+0000 7f05967fc700 1 -- 172.21.15.31:0/1728166641 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0598007690 con 0x7f05a4153860 2024-08-17T02:28:12.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.206+0000 7f05967fc700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0588060890 0x7f0588062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.206+0000 7f05aa431700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0588060890 0x7f0588062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.206+0000 7f05967fc700 1 -- 172.21.15.31:0/1728166641 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f059807bea0 con 0x7f05a4153860 2024-08-17T02:28:12.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.206+0000 7f05aa431700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0588060890 0x7f0588062d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f05a40cb940 tx=0x7f05a0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.214+0000 7f05967fc700 1 -- 172.21.15.31:0/1728166641 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f059804c340 con 0x7f05a4153860 2024-08-17T02:28:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.390+0000 7f05ab433700 1 -- 172.21.15.31:0/1728166641 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05a406a0b0 con 0x7f05a4153860 2024-08-17T02:28:12.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.390+0000 7f05967fc700 1 -- 172.21.15.31:0/1728166641 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15464 (secure 0 0 0) 0x7f0598017020 con 0x7f05a4153860 2024-08-17T02:28:12.397 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:12.397 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":46,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:28:09.474761+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000037340.meta","create_time":"2024-08-17T02:25:57.739259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000037340"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000037340.data","create_time":"2024-08-17T02:25:58.749832+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000037340"}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6837/1886584780":"2024-08-18T02:28:06.459399+0000","172.21.15.31:6835/1886584780":"2024-08-18T02:28:06.459399+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:12.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 -- 172.21.15.31:0/1728166641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0588060890 msgr2=0x7f0588062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0588060890 0x7f0588062d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f05a40cb940 tx=0x7f05a0017000 comp rx=0 tx=0).stop 2024-08-17T02:28:12.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 -- 172.21.15.31:0/1728166641 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 msgr2=0x7f05a414b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 0x7f05a414b050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05980058d0 tx=0x7f0598007d10 comp rx=0 tx=0).stop 2024-08-17T02:28:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 -- 172.21.15.31:0/1728166641 shutdown_connections 2024-08-17T02:28:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0588060890 0x7f0588062d40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4153c30 0x7f05a415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05a4153860 0x7f05a414b050 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 --2- 172.21.15.31:0/1728166641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05a40aa1c0 0x7f05a4152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 -- 172.21.15.31:0/1728166641 >> 172.21.15.31:0/1728166641 conn(0x7f05a4067400 msgr2=0x7f05a414f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 -- 172.21.15.31:0/1728166641 shutdown_connections 2024-08-17T02:28:12.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.394+0000 7f05ab433700 1 -- 172.21.15.31:0/1728166641 wait complete. 2024-08-17T02:28:12.413 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000037340 2024-08-17T02:28:12.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.510+0000 7f82412b9700 1 Processor -- start 2024-08-17T02:28:12.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.510+0000 7f82412b9700 1 -- start start 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f82412b9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f823c0ccb70 0x7f823c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f82412b9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c0cd510 con 0x7f823c1594f0 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f82412b9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c0b2a30 con 0x7f823c0b21e0 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f82412b9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823c1598c0 con 0x7f823c0ccb70 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f823c1594f0 0x7f823c0cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50518/0 (socket says 172.21.15.31:50518) 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823bfff700 1 -- 172.21.15.31:0/949993659 learned_addr learned my addr 172.21.15.31:0/949993659 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f8240ab8700 1 --2- 172.21.15.31:0/949993659 >> v2:172.21.15.92:3300/0 conn(0x7f823c0ccb70 0x7f823c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116659481 0 0) 0x7f822c001490 con 0x7f823c1594f0 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8228003570 con 0x7f823c1594f0 2024-08-17T02:28:12.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3964049621 0 0) 0x7f8228003570 con 0x7f823c1594f0 2024-08-17T02:28:12.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 >> v2:172.21.15.92:3300/0 conn(0x7f823c0ccb70 msgr2=0x7f823c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 --2- 172.21.15.31:0/949993659 >> v2:172.21.15.92:3300/0 conn(0x7f823c0ccb70 0x7f823c0ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 >> v1:172.21.15.92:6789/0 conn(0x7f823c0b21e0 legacy=0x7f823c0b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c0b2750 con 0x7f823c1594f0 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7f822c001980 con 0x7f823c1594f0 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 >> v1:172.21.15.31:6789/0 conn(0x7f823c1594f0 legacy=0x7f823c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8228003a60 0x7f8228003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8228004810 0x7f8228004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82280052e0 0x7f822800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1598c0 con 0x7f8228003a60 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822800c2a0 con 0x7f8228004810 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822800c460 con 0x7f82280052e0 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823bfff700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8228003a60 0x7f8228003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823b7fe700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8228004810 0x7f8228004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823bfff700 1 -- 172.21.15.31:0/949993659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82280052e0 msgr2=0x7f822800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f8240ab8700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82280052e0 0x7f822800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823bfff700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f82280052e0 0x7f822800ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823bfff700 1 -- 172.21.15.31:0/949993659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8228004810 msgr2=0x7f8228004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823bfff700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8228004810 0x7f8228004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823bfff700 1 -- 172.21.15.31:0/949993659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228003570 con 0x7f8228003a60 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f8240ab8700 1 -- 172.21.15.31:0/949993659 reap_dead start 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823bfff700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8228003a60 0x7f8228003e70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f822c00aaa0 tx=0x7f822c00a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94fcd31c7145fab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c00c550 con 0x7f8228003a60 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c00c6d0 con 0x7f8228003a60 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.514+0000 7f823affd700 1 -- 172.21.15.31:0/949993659 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c00ca90 con 0x7f8228003a60 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 -- 172.21.15.31:0/949993659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8228003a60 msgr2=0x7f8228003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8228003a60 0x7f8228003e70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f822c00aaa0 tx=0x7f822c00a170 comp rx=0 tx=0).stop 2024-08-17T02:28:12.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 -- 172.21.15.31:0/949993659 shutdown_connections 2024-08-17T02:28:12.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 --2- 172.21.15.31:0/949993659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8228003a60 0x7f8228003e70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 -- 172.21.15.31:0/949993659 >> 172.21.15.31:0/949993659 conn(0x7f823c0995c0 msgr2=0x7f823c067b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 -- 172.21.15.31:0/949993659 shutdown_connections 2024-08-17T02:28:12.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 -- 172.21.15.31:0/949993659 wait complete. 2024-08-17T02:28:12.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 Processor -- start 2024-08-17T02:28:12.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 -- start start 2024-08-17T02:28:12.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8228003a60 0x7f823c0ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823c09d770 0x7f823c154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f823c0b45b0 0x7f823c0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0b4f60 con 0x7f823c09d770 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c09ba70 con 0x7f8228003a60 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f82412b9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c09cad0 con 0x7f823c0b45b0 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f823b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823c09d770 0x7f823c154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f823b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823c09d770 0x7f823c154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60846/0 (socket says 172.21.15.31:60846) 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f823b7fe700 1 -- 172.21.15.31:0/3718885682 learned_addr learned my addr 172.21.15.31:0/3718885682 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f823bfff700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8228003a60 0x7f823c0ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.518+0000 7f8240ab8700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f823c0b45b0 0x7f823c0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f823b7fe700 1 -- 172.21.15.31:0/3718885682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f823c0b45b0 msgr2=0x7f823c0b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f823b7fe700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f823c0b45b0 0x7f823c0b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f823b7fe700 1 -- 172.21.15.31:0/3718885682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8228003a60 msgr2=0x7f823c0ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f823b7fe700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8228003a60 0x7f823c0ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f823b7fe700 1 -- 172.21.15.31:0/3718885682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c09bd10 con 0x7f823c09d770 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f823b7fe700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823c09d770 0x7f823c154ef0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f822400e590 tx=0x7f8224009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f8233fff700 1 -- 172.21.15.31:0/3718885682 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224012590 con 0x7f823c09d770 2024-08-17T02:28:12.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f8233fff700 1 -- 172.21.15.31:0/3718885682 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82240126f0 con 0x7f823c09d770 2024-08-17T02:28:12.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f82412b9700 1 -- 172.21.15.31:0/3718885682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c09bff0 con 0x7f823c09d770 2024-08-17T02:28:12.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f8233fff700 1 -- 172.21.15.31:0/3718885682 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224012ab0 con 0x7f823c09d770 2024-08-17T02:28:12.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f82412b9700 1 -- 172.21.15.31:0/3718885682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c09c5b0 con 0x7f823c09d770 2024-08-17T02:28:12.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f82412b9700 1 -- 172.21.15.31:0/3718885682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c0712b0 con 0x7f823c09d770 2024-08-17T02:28:12.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.522+0000 7f8233fff700 1 -- 172.21.15.31:0/3718885682 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f8224013420 con 0x7f823c09d770 2024-08-17T02:28:12.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.526+0000 7f8233fff700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f821c060860 0x7f821c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.526+0000 7f823bfff700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f821c060860 0x7f821c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.526+0000 7f8233fff700 1 -- 172.21.15.31:0/3718885682 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f822407cb20 con 0x7f823c09d770 2024-08-17T02:28:12.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.526+0000 7f823bfff700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f821c060860 0x7f821c062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f822c00a0b0 tx=0x7f822c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.534+0000 7f8233fff700 1 -- 172.21.15.31:0/3718885682 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f822404cef0 con 0x7f823c09d770 2024-08-17T02:28:12.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.730+0000 7f82412b9700 1 -- 172.21.15.31:0/3718885682 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000037340"} v 0) v1 -- 0x7f823c0afb70 con 0x7f823c09d770 2024-08-17T02:28:12.737 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-08-17T02:28:12.730+0000 7fb5491b8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:28:12.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.738+0000 7f8233fff700 1 -- 172.21.15.31:0/3718885682 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000037340"}]=0 volume_0000000000037340 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 195+0+0 (secure 0 0 0) 0x7f8224050510 con 0x7f823c09d770 2024-08-17T02:28:12.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 -- 172.21.15.31:0/3718885682 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f821c060860 msgr2=0x7f821c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f821c060860 0x7f821c062d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f822c00a0b0 tx=0x7f822c016000 comp rx=0 tx=0).stop 2024-08-17T02:28:12.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 -- 172.21.15.31:0/3718885682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823c09d770 msgr2=0x7f823c154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823c09d770 0x7f823c154ef0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f822400e590 tx=0x7f8224009040 comp rx=0 tx=0).stop 2024-08-17T02:28:12.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 -- 172.21.15.31:0/3718885682 shutdown_connections 2024-08-17T02:28:12.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f821c060860 0x7f821c062d10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f823c0b45b0 0x7f823c0b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823c09d770 0x7f823c154ef0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 --2- 172.21.15.31:0/3718885682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8228003a60 0x7f823c0ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 -- 172.21.15.31:0/3718885682 >> 172.21.15.31:0/3718885682 conn(0x7f823c0995c0 msgr2=0x7f823c0cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 -- 172.21.15.31:0/3718885682 shutdown_connections 2024-08-17T02:28:12.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.742+0000 7f82412b9700 1 -- 172.21.15.31:0/3718885682 wait complete. 2024-08-17T02:28:12.750 INFO:teuthology.orchestra.run.smithi031.stderr:volume_0000000000037340 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:28:12.751 INFO:tasks.ceph.mds.a.smithi031.stderr: -3078> 2024-08-17T02:26:05.201+0000 7fd780d3c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:12.760 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000037340 --yes-i-really-mean-it 2024-08-17T02:28:12.782 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-08-17T02:28:12.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.858+0000 7f1b9ae88700 1 Processor -- start 2024-08-17T02:28:12.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.858+0000 7f1b9ae88700 1 -- start start 2024-08-17T02:28:12.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b9ae88700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1b940b1cd0 0x7f1b940b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b9ae88700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b94063310 0x7f1b9415b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b9ae88700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9415b370 con 0x7f1b940aeda0 2024-08-17T02:28:12.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b9ae88700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b940674a0 con 0x7f1b940b1cd0 2024-08-17T02:28:12.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b9ae88700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94067780 con 0x7f1b94063310 2024-08-17T02:28:12.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b98c24700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1b940b1cd0 0x7f1b940b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b93fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b94063310 0x7f1b9415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b98c24700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1b940b1cd0 0x7f1b940b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:44398/0 (socket says 172.21.15.31:44398) 2024-08-17T02:28:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b98c24700 1 -- 172.21.15.31:0/671284843 learned_addr learned my addr 172.21.15.31:0/671284843 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b98c24700 1 -- 172.21.15.31:0/671284843 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b94063310 msgr2=0x7f1b9415b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b98c24700 1 --2- 172.21.15.31:0/671284843 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b94063310 0x7f1b9415b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b98c24700 1 -- 172.21.15.31:0/671284843 >> v1:172.21.15.92:6789/0 conn(0x7f1b940aeda0 legacy=0x7f1b94156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b98c24700 1 -- 172.21.15.31:0/671284843 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94067a60 con 0x7f1b940b1cd0 2024-08-17T02:28:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b93fff700 1 --2- 172.21.15.31:0/671284843 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b94063310 0x7f1b9415b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b98c24700 1 --2- 172.21.15.31:0/671284843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b940b1cd0 0x7f1b940b20a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c009f20 tx=0x7f1b8c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfbbce2186c7cdb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b937fe700 1 -- 172.21.15.31:0/671284843 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00e070 con 0x7f1b940b1cd0 2024-08-17T02:28:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b937fe700 1 -- 172.21.15.31:0/671284843 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00b9d0 con 0x7f1b940b1cd0 2024-08-17T02:28:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b937fe700 1 -- 172.21.15.31:0/671284843 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c0092e0 con 0x7f1b940b1cd0 2024-08-17T02:28:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b9ae88700 1 -- 172.21.15.31:0/671284843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b940b1cd0 msgr2=0x7f1b940b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b9ae88700 1 --2- 172.21.15.31:0/671284843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b940b1cd0 0x7f1b940b20a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c009f20 tx=0x7f1b8c009840 comp rx=0 tx=0).stop 2024-08-17T02:28:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b9ae88700 1 -- 172.21.15.31:0/671284843 shutdown_connections 2024-08-17T02:28:12.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b9ae88700 1 --2- 172.21.15.31:0/671284843 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b94063310 0x7f1b9415b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.862+0000 7f1b9ae88700 1 --2- 172.21.15.31:0/671284843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b940b1cd0 0x7f1b940b20a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 -- 172.21.15.31:0/671284843 >> 172.21.15.31:0/671284843 conn(0x7f1b940cc720 msgr2=0x7f1b940ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 -- 172.21.15.31:0/671284843 shutdown_connections 2024-08-17T02:28:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 -- 172.21.15.31:0/671284843 wait complete. 2024-08-17T02:28:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 Processor -- start 2024-08-17T02:28:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 -- start start 2024-08-17T02:28:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94063310 0x7f1b9414dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b940aeda0 0x7f1b9413d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b940b1cd0 0x7f1b9413d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9413eaf0 con 0x7f1b940b1cd0 2024-08-17T02:28:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9413dee0 con 0x7f1b94063310 2024-08-17T02:28:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b9ae88700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9413e1c0 con 0x7f1b940aeda0 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b99425700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b940b1cd0 0x7f1b9413d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b99425700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b940b1cd0 0x7f1b9413d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60872/0 (socket says 172.21.15.31:60872) 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b99425700 1 -- 172.21.15.31:0/695896323 learned_addr learned my addr 172.21.15.31:0/695896323 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b98c24700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94063310 0x7f1b9414dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b93fff700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b940aeda0 0x7f1b9413d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b99425700 1 -- 172.21.15.31:0/695896323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b940aeda0 msgr2=0x7f1b9413d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b99425700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b940aeda0 0x7f1b9413d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b99425700 1 -- 172.21.15.31:0/695896323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94063310 msgr2=0x7f1b9414dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b99425700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94063310 0x7f1b9414dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b99425700 1 -- 172.21.15.31:0/695896323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b88009420 con 0x7f1b940b1cd0 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.866+0000 7f1b98c24700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94063310 0x7f1b9414dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b99425700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b940b1cd0 0x7f1b9413d6c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c560 tx=0x7f1b84007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b90ff9700 1 -- 172.21.15.31:0/695896323 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84011590 con 0x7f1b940b1cd0 2024-08-17T02:28:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b90ff9700 1 -- 172.21.15.31:0/695896323 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b840116f0 con 0x7f1b940b1cd0 2024-08-17T02:28:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b9ae88700 1 -- 172.21.15.31:0/695896323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c009ae0 con 0x7f1b940b1cd0 2024-08-17T02:28:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b90ff9700 1 -- 172.21.15.31:0/695896323 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84011ab0 con 0x7f1b940b1cd0 2024-08-17T02:28:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b9ae88700 1 -- 172.21.15.31:0/695896323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9413e780 con 0x7f1b940b1cd0 2024-08-17T02:28:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b9ae88700 1 -- 172.21.15.31:0/695896323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9413dc60 con 0x7f1b940b1cd0 2024-08-17T02:28:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b90ff9700 1 -- 172.21.15.31:0/695896323 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1b8401b3b0 con 0x7f1b940b1cd0 2024-08-17T02:28:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b90ff9700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1b80060860 0x7f1b80062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b90ff9700 1 -- 172.21.15.31:0/695896323 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f1b8407c1d0 con 0x7f1b940b1cd0 2024-08-17T02:28:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b98c24700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1b80060860 0x7f1b80062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.870+0000 7f1b98c24700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1b80060860 0x7f1b80062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1b9413c010 tx=0x7f1b8c018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:12.882+0000 7f1b90ff9700 1 -- 172.21.15.31:0/695896323 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1b8404c540 con 0x7f1b940b1cd0 2024-08-17T02:28:13.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.082+0000 7f1b9ae88700 1 -- 172.21.15.31:0/695896323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000037340", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1b940712b0 con 0x7f1b940b1cd0 2024-08-17T02:28:13.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.738+0000 7f1b90ff9700 1 -- 172.21.15.31:0/695896323 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000037340", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f1b8404fb60 con 0x7f1b940b1cd0 2024-08-17T02:28:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 -- 172.21.15.31:0/695896323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1b80060860 msgr2=0x7f1b80062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1b80060860 0x7f1b80062d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1b9413c010 tx=0x7f1b8c018000 comp rx=0 tx=0).stop 2024-08-17T02:28:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 -- 172.21.15.31:0/695896323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b940b1cd0 msgr2=0x7f1b9413d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b940b1cd0 0x7f1b9413d6c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c560 tx=0x7f1b84007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 -- 172.21.15.31:0/695896323 shutdown_connections 2024-08-17T02:28:13.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1b80060860 0x7f1b80062d10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b940b1cd0 0x7f1b9413d6c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b940aeda0 0x7f1b9413d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 --2- 172.21.15.31:0/695896323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94063310 0x7f1b9414dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 -- 172.21.15.31:0/695896323 >> 172.21.15.31:0/695896323 conn(0x7f1b940cc720 msgr2=0x7f1b941534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 -- 172.21.15.31:0/695896323 shutdown_connections 2024-08-17T02:28:13.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.746+0000 7f1b9ae88700 1 -- 172.21.15.31:0/695896323 wait complete. 2024-08-17T02:28:13.759 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:13.761 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:13.768 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000037340.meta cephfs.volume_0000000000037340.meta --yes-i-really-really-mean-it 2024-08-17T02:28:13.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986b59e700 1 Processor -- start 2024-08-17T02:28:13.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986b59e700 1 -- start start 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986b59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c142810 0x7f986c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986b59e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c06c320 con 0x7f986c15cdf0 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986b59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c06b430 con 0x7f986c142be0 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986b59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c06b710 con 0x7f986c142810 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986ad9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f986c15cdf0 0x7f986c069250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50532/0 (socket says 172.21.15.31:50532) 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986ad9d700 1 -- 172.21.15.31:0/1414700921 learned_addr learned my addr 172.21.15.31:0/1414700921 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:13.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986a59c700 1 --2- 172.21.15.31:0/1414700921 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c142810 0x7f986c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986959a700 1 -- 172.21.15.31:0/1414700921 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208437584 0 0) 0x7f986c06c320 con 0x7f986c15cdf0 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986959a700 1 -- 172.21.15.31:0/1414700921 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9854003570 con 0x7f986c15cdf0 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986959a700 1 -- 172.21.15.31:0/1414700921 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901150782 0 0) 0x7f986c06b430 con 0x7f986c142be0 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986959a700 1 -- 172.21.15.31:0/1414700921 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f986c06c320 con 0x7f986c142be0 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986a59c700 1 -- 172.21.15.31:0/1414700921 >> v1:172.21.15.92:6789/0 conn(0x7f986c142be0 legacy=0x7f986c068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986a59c700 1 -- 172.21.15.31:0/1414700921 >> v1:172.21.15.31:6789/0 conn(0x7f986c15cdf0 legacy=0x7f986c069250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986a59c700 1 -- 172.21.15.31:0/1414700921 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c06b9f0 con 0x7f986c142810 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986a59c700 1 --2- 172.21.15.31:0/1414700921 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c142810 0x7f986c0ad700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f985c009910 tx=0x7f985c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1eb10525750051a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.962+0000 7f986959a700 1 -- 172.21.15.31:0/1414700921 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c011630 con 0x7f986c142810 2024-08-17T02:28:13.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986959a700 1 -- 172.21.15.31:0/1414700921 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c011790 con 0x7f986c142810 2024-08-17T02:28:13.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986959a700 1 -- 172.21.15.31:0/1414700921 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c011b30 con 0x7f986c142810 2024-08-17T02:28:13.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986b59e700 1 -- 172.21.15.31:0/1414700921 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c142810 msgr2=0x7f986c0ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986b59e700 1 --2- 172.21.15.31:0/1414700921 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c142810 0x7f986c0ad700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f985c009910 tx=0x7f985c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986b59e700 1 -- 172.21.15.31:0/1414700921 shutdown_connections 2024-08-17T02:28:13.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986b59e700 1 --2- 172.21.15.31:0/1414700921 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c142810 0x7f986c0ad700 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986b59e700 1 -- 172.21.15.31:0/1414700921 >> 172.21.15.31:0/1414700921 conn(0x7f986c0b33c0 msgr2=0x7f986c0b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986b59e700 1 -- 172.21.15.31:0/1414700921 shutdown_connections 2024-08-17T02:28:13.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986b59e700 1 -- 172.21.15.31:0/1414700921 wait complete. 2024-08-17T02:28:13.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986b59e700 1 Processor -- start 2024-08-17T02:28:13.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.966+0000 7f986b59e700 1 -- start start 2024-08-17T02:28:13.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986b59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f986c142810 0x7f986c1372f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986b59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f986c142be0 0x7f986c13b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986b59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c15cdf0 0x7f986c13bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986b59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c1699f0 con 0x7f986c142810 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986b59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c1696a0 con 0x7f986c142be0 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986b59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c137bb0 con 0x7f986c15cdf0 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f986c142810 0x7f986c1372f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f986c142810 0x7f986c1372f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60884/0 (socket says 172.21.15.31:60884) 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986a59c700 1 -- 172.21.15.31:0/2002696003 learned_addr learned my addr 172.21.15.31:0/2002696003 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f9869d9b700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f986c142be0 0x7f986c13b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986ad9d700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c15cdf0 0x7f986c13bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986a59c700 1 -- 172.21.15.31:0/2002696003 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c15cdf0 msgr2=0x7f986c13bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986a59c700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c15cdf0 0x7f986c13bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986a59c700 1 -- 172.21.15.31:0/2002696003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f986c142be0 msgr2=0x7f986c13b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986a59c700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f986c142be0 0x7f986c13b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986a59c700 1 -- 172.21.15.31:0/2002696003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c009420 con 0x7f986c142810 2024-08-17T02:28:13.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986a59c700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f986c142810 0x7f986c1372f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f985c009f00 tx=0x7f985c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f985a7fc700 1 -- 172.21.15.31:0/2002696003 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c01f070 con 0x7f986c142810 2024-08-17T02:28:13.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f985a7fc700 1 -- 172.21.15.31:0/2002696003 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c002f70 con 0x7f986c142810 2024-08-17T02:28:13.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986b59e700 1 -- 172.21.15.31:0/2002696003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c137e90 con 0x7f986c142810 2024-08-17T02:28:13.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f985a7fc700 1 -- 172.21.15.31:0/2002696003 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c011900 con 0x7f986c142810 2024-08-17T02:28:13.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.970+0000 7f986b59e700 1 -- 172.21.15.31:0/2002696003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c137830 con 0x7f986c142810 2024-08-17T02:28:13.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.974+0000 7f986b59e700 1 -- 172.21.15.31:0/2002696003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c0712b0 con 0x7f986c142810 2024-08-17T02:28:13.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.974+0000 7f985a7fc700 1 -- 172.21.15.31:0/2002696003 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f985c023070 con 0x7f986c142810 2024-08-17T02:28:13.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.974+0000 7f985a7fc700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f984c060860 0x7f984c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.974+0000 7f985a7fc700 1 -- 172.21.15.31:0/2002696003 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f985c07df90 con 0x7f986c142810 2024-08-17T02:28:13.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.974+0000 7f9869d9b700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f984c060860 0x7f984c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.974+0000 7f9869d9b700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f984c060860 0x7f984c062d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f986c0686f0 tx=0x7f9860007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:13.982+0000 7f985a7fc700 1 -- 172.21.15.31:0/2002696003 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f985c0ae480 con 0x7f986c142810 2024-08-17T02:28:14.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.150+0000 7f986b59e700 1 -- 172.21.15.31:0/2002696003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000037340.meta", "pool2": "cephfs.volume_0000000000037340.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f986c1384d0 con 0x7f986c142810 2024-08-17T02:28:14.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.746+0000 7f985a7fc700 1 -- 172.21.15.31:0/2002696003 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000037340.meta", "pool2": "cephfs.volume_0000000000037340.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000037340.meta' removed v48) v1 ==== 241+0+0 (secure 0 0 0) 0x7f985c015100 con 0x7f986c142810 2024-08-17T02:28:14.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.750+0000 7f986b59e700 1 -- 172.21.15.31:0/2002696003 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f984c060860 msgr2=0x7f984c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.750+0000 7f986b59e700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f984c060860 0x7f984c062d10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f986c0686f0 tx=0x7f9860007d50 comp rx=0 tx=0).stop 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.750+0000 7f986b59e700 1 -- 172.21.15.31:0/2002696003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f986c142810 msgr2=0x7f986c1372f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.750+0000 7f986b59e700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f986c142810 0x7f986c1372f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f985c009f00 tx=0x7f985c017000 comp rx=0 tx=0).stop 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.754+0000 7f986b59e700 1 -- 172.21.15.31:0/2002696003 shutdown_connections 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.754+0000 7f986b59e700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f984c060860 0x7f984c062d10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.754+0000 7f986b59e700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f986c15cdf0 0x7f986c13bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.754+0000 7f986b59e700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f986c142be0 0x7f986c13b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.754+0000 7f986b59e700 1 --2- 172.21.15.31:0/2002696003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f986c142810 0x7f986c1372f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.754+0000 7f986b59e700 1 -- 172.21.15.31:0/2002696003 >> 172.21.15.31:0/2002696003 conn(0x7f986c0b33c0 msgr2=0x7f986c13d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.754+0000 7f986b59e700 1 -- 172.21.15.31:0/2002696003 shutdown_connections 2024-08-17T02:28:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.754+0000 7f986b59e700 1 -- 172.21.15.31:0/2002696003 wait complete. 2024-08-17T02:28:14.760 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs.volume_0000000000037340.meta' removed 2024-08-17T02:28:14.773 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000037340.data cephfs.volume_0000000000037340.data --yes-i-really-really-mean-it 2024-08-17T02:28:14.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.882+0000 7fd3248ba700 1 Processor -- start 2024-08-17T02:28:14.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.882+0000 7fd3248ba700 1 -- start start 2024-08-17T02:28:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd3248ba700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd32006a0f0 0x7fd32006a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd3248ba700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3200ab6e0 con 0x7fd3200cc3c0 2024-08-17T02:28:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd3248ba700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3200abf80 con 0x7fd3200b0f80 2024-08-17T02:28:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd3248ba700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32015a7f0 con 0x7fd32006a0f0 2024-08-17T02:28:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd3200cc3c0 0x7fd3200ac410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50538/0 (socket says 172.21.15.31:50538) 2024-08-17T02:28:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31ffff700 1 -- 172.21.15.31:0/367003134 learned_addr learned my addr 172.21.15.31:0/367003134 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31f7fe700 1 --2- 172.21.15.31:0/367003134 >> v2:172.21.15.92:3300/0 conn(0x7fd32006a0f0 0x7fd32006a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772275381 0 0) 0x7fd3200ab6e0 con 0x7fd3200cc3c0 2024-08-17T02:28:14.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd30c003570 con 0x7fd3200cc3c0 2024-08-17T02:28:14.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3538715635 0 0) 0x7fd30c003570 con 0x7fd3200cc3c0 2024-08-17T02:28:14.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 >> v2:172.21.15.92:3300/0 conn(0x7fd32006a0f0 msgr2=0x7fd32006a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:14.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 --2- 172.21.15.31:0/367003134 >> v2:172.21.15.92:3300/0 conn(0x7fd32006a0f0 0x7fd32006a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 >> v1:172.21.15.92:6789/0 conn(0x7fd3200b0f80 legacy=0x7fd3201557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3200ab930 con 0x7fd3200cc3c0 2024-08-17T02:28:14.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3214449952 0 0) 0x7fd318001470 con 0x7fd3200cc3c0 2024-08-17T02:28:14.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 >> v1:172.21.15.31:6789/0 conn(0x7fd3200cc3c0 legacy=0x7fd3200ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd30c003a60 0x7fd30c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd30c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd30c0051c0 0x7fd30c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32015a7f0 con 0x7fd30c004810 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c00c0e0 con 0x7fd30c0051c0 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c00c2a0 con 0x7fd30c003a60 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31effd700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd30c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31ffff700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd30c0051c0 0x7fd30c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31f7fe700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd30c003a60 0x7fd30c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31effd700 1 -- 172.21.15.31:0/367003134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd30c003a60 msgr2=0x7fd30c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31effd700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd30c003a60 0x7fd30c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31effd700 1 -- 172.21.15.31:0/367003134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd30c0051c0 msgr2=0x7fd30c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31effd700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd30c0051c0 0x7fd30c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31effd700 1 -- 172.21.15.31:0/367003134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c003570 con 0x7fd30c004810 2024-08-17T02:28:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31ffff700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd30c0051c0 0x7fd30c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31ffff700 1 -- 172.21.15.31:0/367003134 reap_dead start 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31effd700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd30c004c80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd3080019a0 tx=0x7fd308007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98bc183a66f47ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800c5d0 con 0x7fd30c004810 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30800c730 con 0x7fd30c004810 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd31e7fc700 1 -- 172.21.15.31:0/367003134 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800cad0 con 0x7fd30c004810 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd3248ba700 1 -- 172.21.15.31:0/367003134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 msgr2=0x7fd30c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.886+0000 7fd3248ba700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd30c004c80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd3080019a0 tx=0x7fd308007d10 comp rx=0 tx=0).stop 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 -- 172.21.15.31:0/367003134 shutdown_connections 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 --2- 172.21.15.31:0/367003134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd30c004c80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 -- 172.21.15.31:0/367003134 >> 172.21.15.31:0/367003134 conn(0x7fd320067e90 msgr2=0x7fd3200cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 -- 172.21.15.31:0/367003134 shutdown_connections 2024-08-17T02:28:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 -- 172.21.15.31:0/367003134 wait complete. 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 Processor -- start 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 -- start start 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd3200aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd3200aaee0 0x7fd32012e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd32012ef30 0x7fd32012f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32012d710 con 0x7fd30c004810 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd320145260 con 0x7fd32012ef30 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd3248ba700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32012d950 con 0x7fd3200aaee0 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd3200aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd3200aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60900/0 (socket says 172.21.15.31:60900) 2024-08-17T02:28:14.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31f7fe700 1 -- 172.21.15.31:0/1162860275 learned_addr learned my addr 172.21.15.31:0/1162860275 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31ffff700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd32012ef30 0x7fd32012f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31effd700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd3200aaee0 0x7fd32012e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31f7fe700 1 -- 172.21.15.31:0/1162860275 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd3200aaee0 msgr2=0x7fd32012e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31f7fe700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd3200aaee0 0x7fd32012e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31f7fe700 1 -- 172.21.15.31:0/1162860275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd32012ef30 msgr2=0x7fd32012f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31f7fe700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd32012ef30 0x7fd32012f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31f7fe700 1 -- 172.21.15.31:0/1162860275 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32012dc30 con 0x7fd30c004810 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.890+0000 7fd31f7fe700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd3200aa9a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd310009f60 tx=0x7fd31000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.894+0000 7fd3177fe700 1 -- 172.21.15.31:0/1162860275 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000e040 con 0x7fd30c004810 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.894+0000 7fd3177fe700 1 -- 172.21.15.31:0/1162860275 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000f040 con 0x7fd30c004810 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.894+0000 7fd3248ba700 1 -- 172.21.15.31:0/1162860275 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32012df10 con 0x7fd30c004810 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.894+0000 7fd3177fe700 1 -- 172.21.15.31:0/1162860275 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310015430 con 0x7fd30c004810 2024-08-17T02:28:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.894+0000 7fd3248ba700 1 -- 172.21.15.31:0/1162860275 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32012e4d0 con 0x7fd30c004810 2024-08-17T02:28:14.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.894+0000 7fd3248ba700 1 -- 172.21.15.31:0/1162860275 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3200cbe20 con 0x7fd30c004810 2024-08-17T02:28:14.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.894+0000 7fd3177fe700 1 -- 172.21.15.31:0/1162860275 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fd3100157e0 con 0x7fd30c004810 2024-08-17T02:28:14.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.894+0000 7fd3177fe700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd300060860 0x7fd300062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.894+0000 7fd3177fe700 1 -- 172.21.15.31:0/1162860275 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5448+0+0 (secure 0 0 0) 0x7fd31007d8c0 con 0x7fd30c004810 2024-08-17T02:28:14.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.894+0000 7fd31effd700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd300060860 0x7fd300062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.898+0000 7fd31effd700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd300060860 0x7fd300062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd3201484f0 tx=0x7fd308015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:14.902+0000 7fd3177fe700 1 -- 172.21.15.31:0/1162860275 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fd3200cbe20 con 0x7fd30c004810 2024-08-17T02:28:15.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.078+0000 7fd3248ba700 1 -- 172.21.15.31:0/1162860275 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000037340.data", "pool2": "cephfs.volume_0000000000037340.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd3200ab2b0 con 0x7fd30c004810 2024-08-17T02:28:15.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.754+0000 7fd3177fe700 1 -- 172.21.15.31:0/1162860275 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000037340.data", "pool2": "cephfs.volume_0000000000037340.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000037340.data' removed v49) v1 ==== 241+0+0 (secure 0 0 0) 0x7fd3200ab2b0 con 0x7fd30c004810 2024-08-17T02:28:15.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 -- 172.21.15.31:0/1162860275 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd300060860 msgr2=0x7fd300062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd300060860 0x7fd300062d10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd3201484f0 tx=0x7fd308015000 comp rx=0 tx=0).stop 2024-08-17T02:28:15.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 -- 172.21.15.31:0/1162860275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 msgr2=0x7fd3200aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd3200aa9a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd310009f60 tx=0x7fd31000b040 comp rx=0 tx=0).stop 2024-08-17T02:28:15.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 -- 172.21.15.31:0/1162860275 shutdown_connections 2024-08-17T02:28:15.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fd300060860 0x7fd300062d10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd32012ef30 0x7fd32012f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd3200aaee0 0x7fd32012e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 --2- 172.21.15.31:0/1162860275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd30c004810 0x7fd3200aa9a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 -- 172.21.15.31:0/1162860275 >> 172.21.15.31:0/1162860275 conn(0x7fd320067e90 msgr2=0x7fd320159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 -- 172.21.15.31:0/1162860275 shutdown_connections 2024-08-17T02:28:15.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.762+0000 7fd3248ba700 1 -- 172.21.15.31:0/1162860275 wait complete. 2024-08-17T02:28:15.770 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs.volume_0000000000037340.data' removed 2024-08-17T02:28:15.782 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:28:15.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.886+0000 7f43bdd50700 1 Processor -- start 2024-08-17T02:28:15.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.886+0000 7f43bdd50700 1 -- start start 2024-08-17T02:28:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f43b8068c20 0x7f43b8160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b80cadf0 con 0x7f43b8156440 2024-08-17T02:28:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b80cb0d0 con 0x7f43b81591e0 2024-08-17T02:28:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80cb3b0 con 0x7f43b8068c20 2024-08-17T02:28:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43b7fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f43b8156440 0x7f43b8068510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50544/0 (socket says 172.21.15.31:50544) 2024-08-17T02:28:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43b7fff700 1 -- 172.21.15.31:0/1999530944 learned_addr learned my addr 172.21.15.31:0/1999530944 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bd54f700 1 --2- 172.21.15.31:0/1999530944 >> v2:172.21.15.92:3300/0 conn(0x7f43b8068c20 0x7f43b8160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43b77fe700 1 -- 172.21.15.31:0/1999530944 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539307721 0 0) 0x7f43b80cadf0 con 0x7f43b8156440 2024-08-17T02:28:15.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43b77fe700 1 -- 172.21.15.31:0/1999530944 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a8003570 con 0x7f43b8156440 2024-08-17T02:28:15.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bd54f700 1 -- 172.21.15.31:0/1999530944 >> v1:172.21.15.92:6789/0 conn(0x7f43b81591e0 legacy=0x7f43b806ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bd54f700 1 -- 172.21.15.31:0/1999530944 >> v1:172.21.15.31:6789/0 conn(0x7f43b8156440 legacy=0x7f43b8068510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bd54f700 1 -- 172.21.15.31:0/1999530944 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80cb690 con 0x7f43b8068c20 2024-08-17T02:28:15.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bd54f700 1 --2- 172.21.15.31:0/1999530944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43b8068c20 0x7f43b8160ac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009e60 tx=0x7f43b0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fa912c74b7c385b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43b77fe700 1 -- 172.21.15.31:0/1999530944 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b000e070 con 0x7f43b8068c20 2024-08-17T02:28:15.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43b77fe700 1 -- 172.21.15.31:0/1999530944 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b000bb60 con 0x7f43b8068c20 2024-08-17T02:28:15.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43b77fe700 1 -- 172.21.15.31:0/1999530944 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0012430 con 0x7f43b8068c20 2024-08-17T02:28:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 -- 172.21.15.31:0/1999530944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43b8068c20 msgr2=0x7f43b8160ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 --2- 172.21.15.31:0/1999530944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43b8068c20 0x7f43b8160ac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009e60 tx=0x7f43b0009780 comp rx=0 tx=0).stop 2024-08-17T02:28:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 -- 172.21.15.31:0/1999530944 shutdown_connections 2024-08-17T02:28:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 --2- 172.21.15.31:0/1999530944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43b8068c20 0x7f43b8160ac0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 -- 172.21.15.31:0/1999530944 >> 172.21.15.31:0/1999530944 conn(0x7f43b806a0c0 msgr2=0x7f43b806a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 -- 172.21.15.31:0/1999530944 shutdown_connections 2024-08-17T02:28:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.890+0000 7f43bdd50700 1 -- 172.21.15.31:0/1999530944 wait complete. 2024-08-17T02:28:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bdd50700 1 Processor -- start 2024-08-17T02:28:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bdd50700 1 -- start start 2024-08-17T02:28:15.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bdd50700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43b8068c20 0x7f43b8169cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bdd50700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b8156440 0x7f43b80c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bdd50700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43b81591e0 0x7f43b8067d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bdd50700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b816a1f0 con 0x7f43b8156440 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bdd50700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b8152060 con 0x7f43b8068c20 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bdd50700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80a58e0 con 0x7f43b81591e0 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b8156440 0x7f43b80c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b8156440 0x7f43b80c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60910/0 (socket says 172.21.15.31:60910) 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b7fff700 1 -- 172.21.15.31:0/1776730197 learned_addr learned my addr 172.21.15.31:0/1776730197 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bcd4e700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43b8068c20 0x7f43b8169cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bd54f700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43b81591e0 0x7f43b8067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b7fff700 1 -- 172.21.15.31:0/1776730197 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43b81591e0 msgr2=0x7f43b8067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b7fff700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43b81591e0 0x7f43b8067d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b7fff700 1 -- 172.21.15.31:0/1776730197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43b8068c20 msgr2=0x7f43b8169cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b7fff700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43b8068c20 0x7f43b8169cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b7fff700 1 -- 172.21.15.31:0/1776730197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b0009a20 con 0x7f43b8156440 2024-08-17T02:28:15.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bd54f700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43b81591e0 0x7f43b8067d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:15.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b7fff700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b8156440 0x7f43b80c8770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c7c0 tx=0x7f43a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b4ff9700 1 -- 172.21.15.31:0/1776730197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4005b30 con 0x7f43b8156440 2024-08-17T02:28:15.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b4ff9700 1 -- 172.21.15.31:0/1776730197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a4005cb0 con 0x7f43b8156440 2024-08-17T02:28:15.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bdd50700 1 -- 172.21.15.31:0/1776730197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b806e9c0 con 0x7f43b8156440 2024-08-17T02:28:15.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43b4ff9700 1 -- 172.21.15.31:0/1776730197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4007320 con 0x7f43b8156440 2024-08-17T02:28:15.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.894+0000 7f43bdd50700 1 -- 172.21.15.31:0/1776730197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b806ef80 con 0x7f43b8156440 2024-08-17T02:28:15.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.898+0000 7f43bdd50700 1 -- 172.21.15.31:0/1776730197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b80712b0 con 0x7f43b8156440 2024-08-17T02:28:15.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.898+0000 7f43b4ff9700 1 -- 172.21.15.31:0/1776730197 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f43a401b3b0 con 0x7f43b8156440 2024-08-17T02:28:15.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.898+0000 7f43b4ff9700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f439c060860 0x7f439c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.898+0000 7f43bcd4e700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f439c060860 0x7f439c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.898+0000 7f43b4ff9700 1 -- 172.21.15.31:0/1776730197 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f43a407be40 con 0x7f43b8156440 2024-08-17T02:28:15.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.902+0000 7f43bcd4e700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f439c060860 0x7f439c062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0039e0 tx=0x7f43ac007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:15.906+0000 7f43b4ff9700 1 -- 172.21.15.31:0/1776730197 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f43a404c4d0 con 0x7f43b8156440 2024-08-17T02:28:16.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.074+0000 7f43bdd50700 1 -- 172.21.15.31:0/1776730197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f43b8155e50 con 0x7f43b8156440 2024-08-17T02:28:16.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.082+0000 7f43b4ff9700 1 -- 172.21.15.31:0/1776730197 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43a404faf0 con 0x7f43b8156440 2024-08-17T02:28:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 -- 172.21.15.31:0/1776730197 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f439c060860 msgr2=0x7f439c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f439c060860 0x7f439c062d10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0039e0 tx=0x7f43ac007ec0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 -- 172.21.15.31:0/1776730197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b8156440 msgr2=0x7f43b80c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b8156440 0x7f43b80c8770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c7c0 tx=0x7f43a4007e00 comp rx=0 tx=0).stop 2024-08-17T02:28:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 -- 172.21.15.31:0/1776730197 shutdown_connections 2024-08-17T02:28:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f439c060860 0x7f439c062d10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43b81591e0 0x7f43b8067d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b8156440 0x7f43b80c8770 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 --2- 172.21.15.31:0/1776730197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43b8068c20 0x7f43b8169cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 -- 172.21.15.31:0/1776730197 >> 172.21.15.31:0/1776730197 conn(0x7f43b806a0c0 msgr2=0x7f43b81595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 -- 172.21.15.31:0/1776730197 shutdown_connections 2024-08-17T02:28:16.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.086+0000 7f43bdd50700 1 -- 172.21.15.31:0/1776730197 wait complete. 2024-08-17T02:28:16.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:28:16.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.206+0000 7f673edc5700 1 Processor -- start 2024-08-17T02:28:16.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.206+0000 7f673edc5700 1 -- start start 2024-08-17T02:28:16.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6738140780 0x7f6738140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f67380ca340 0x7f67380b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67380ca7c0 con 0x7f67380b0fe0 2024-08-17T02:28:16.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67380b1970 con 0x7f67380ca340 2024-08-17T02:28:16.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67380ab690 con 0x7f6738140780 2024-08-17T02:28:16.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673e5c4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f67380ca340 0x7f67380b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673e5c4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f67380ca340 0x7f67380b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60920/0 (socket says 172.21.15.31:60920) 2024-08-17T02:28:16.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673e5c4700 1 -- 172.21.15.31:0/1086409911 learned_addr learned my addr 172.21.15.31:0/1086409911 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:16.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673ddc3700 1 --2- 172.21.15.31:0/1086409911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6738140780 0x7f6738140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673e5c4700 1 -- 172.21.15.31:0/1086409911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6738140780 msgr2=0x7f6738140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:16.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673e5c4700 1 --2- 172.21.15.31:0/1086409911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6738140780 0x7f6738140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673e5c4700 1 -- 172.21.15.31:0/1086409911 >> v1:172.21.15.92:6789/0 conn(0x7f67380b0fe0 legacy=0x7f67380c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673e5c4700 1 -- 172.21.15.31:0/1086409911 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67380caa00 con 0x7f67380ca340 2024-08-17T02:28:16.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673e5c4700 1 --2- 172.21.15.31:0/1086409911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 0x7f67380b1430 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6730009f20 tx=0x7f6730009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c19c3c70ed8cca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673cdc1700 1 -- 172.21.15.31:0/1086409911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673000e070 con 0x7f67380ca340 2024-08-17T02:28:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673cdc1700 1 -- 172.21.15.31:0/1086409911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673000b9d0 con 0x7f67380ca340 2024-08-17T02:28:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673cdc1700 1 -- 172.21.15.31:0/1086409911 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300092e0 con 0x7f67380ca340 2024-08-17T02:28:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 -- 172.21.15.31:0/1086409911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 msgr2=0x7f67380b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 --2- 172.21.15.31:0/1086409911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 0x7f67380b1430 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6730009f20 tx=0x7f6730009840 comp rx=0 tx=0).stop 2024-08-17T02:28:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 -- 172.21.15.31:0/1086409911 shutdown_connections 2024-08-17T02:28:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 --2- 172.21.15.31:0/1086409911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 0x7f67380b1430 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 --2- 172.21.15.31:0/1086409911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6738140780 0x7f6738140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 -- 172.21.15.31:0/1086409911 >> 172.21.15.31:0/1086409911 conn(0x7f6738067400 msgr2=0x7f6738067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 -- 172.21.15.31:0/1086409911 shutdown_connections 2024-08-17T02:28:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.210+0000 7f673edc5700 1 -- 172.21.15.31:0/1086409911 wait complete. 2024-08-17T02:28:16.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673edc5700 1 Processor -- start 2024-08-17T02:28:16.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673edc5700 1 -- start start 2024-08-17T02:28:16.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673edc5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67380b0fe0 0x7f6738135e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673edc5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 0x7f673814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673edc5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6738140780 0x7f67380abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673edc5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67381400f0 con 0x7f67380ca340 2024-08-17T02:28:16.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673edc5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6738135980 con 0x7f67380b0fe0 2024-08-17T02:28:16.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673edc5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673813fe10 con 0x7f6738140780 2024-08-17T02:28:16.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673d5c2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 0x7f673814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673d5c2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 0x7f673814d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60930/0 (socket says 172.21.15.31:60930) 2024-08-17T02:28:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673d5c2700 1 -- 172.21.15.31:0/3275715356 learned_addr learned my addr 172.21.15.31:0/3275715356 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673ddc3700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67380b0fe0 0x7f6738135e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673e5c4700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6738140780 0x7f67380abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673d5c2700 1 -- 172.21.15.31:0/3275715356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6738140780 msgr2=0x7f67380abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673d5c2700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6738140780 0x7f67380abb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673d5c2700 1 -- 172.21.15.31:0/3275715356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67380b0fe0 msgr2=0x7f6738135e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673d5c2700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67380b0fe0 0x7f6738135e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673d5c2700 1 -- 172.21.15.31:0/3275715356 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6730009ae0 con 0x7f67380ca340 2024-08-17T02:28:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673d5c2700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 0x7f673814d1b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f672c00c590 tx=0x7f672c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f6729ffb700 1 -- 172.21.15.31:0/3275715356 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c011590 con 0x7f67380ca340 2024-08-17T02:28:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f6729ffb700 1 -- 172.21.15.31:0/3275715356 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c011710 con 0x7f67380ca340 2024-08-17T02:28:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f6729ffb700 1 -- 172.21.15.31:0/3275715356 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c011ad0 con 0x7f67380ca340 2024-08-17T02:28:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673edc5700 1 -- 172.21.15.31:0/3275715356 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6738135330 con 0x7f67380ca340 2024-08-17T02:28:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.214+0000 7f673edc5700 1 -- 172.21.15.31:0/3275715356 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6738136350 con 0x7f67380ca340 2024-08-17T02:28:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.218+0000 7f673edc5700 1 -- 172.21.15.31:0/3275715356 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6738135170 con 0x7f67380ca340 2024-08-17T02:28:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.218+0000 7f6729ffb700 1 -- 172.21.15.31:0/3275715356 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f672c01b3b0 con 0x7f67380ca340 2024-08-17T02:28:16.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.218+0000 7f6729ffb700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f671c060860 0x7f671c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.218+0000 7f6729ffb700 1 -- 172.21.15.31:0/3275715356 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f672c07bba0 con 0x7f67380ca340 2024-08-17T02:28:16.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.218+0000 7f673ddc3700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f671c060860 0x7f671c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.218+0000 7f673ddc3700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f671c060860 0x7f671c062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6734009d10 tx=0x7f67340091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.226+0000 7f6729ffb700 1 -- 172.21.15.31:0/3275715356 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f672c04c290 con 0x7f67380ca340 2024-08-17T02:28:16.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.454+0000 7f673edc5700 1 -- 172.21.15.31:0/3275715356 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f67380ca7c0 con 0x7f67380ca340 2024-08-17T02:28:16.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.754+0000 7f6729ffb700 1 -- 172.21.15.31:0/3275715356 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v164) v1 ==== 135+0+0 (secure 0 0 0) 0x7f67380ca7c0 con 0x7f67380ca340 2024-08-17T02:28:16.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 -- 172.21.15.31:0/3275715356 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f671c060860 msgr2=0x7f671c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f671c060860 0x7f671c062d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6734009d10 tx=0x7f67340091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 -- 172.21.15.31:0/3275715356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 msgr2=0x7f673814d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 0x7f673814d1b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f672c00c590 tx=0x7f672c00c8a0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 -- 172.21.15.31:0/3275715356 shutdown_connections 2024-08-17T02:28:16.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f671c060860 0x7f671c062d10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6738140780 0x7f67380abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67380ca340 0x7f673814d1b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 --2- 172.21.15.31:0/3275715356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67380b0fe0 0x7f6738135e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 -- 172.21.15.31:0/3275715356 >> 172.21.15.31:0/3275715356 conn(0x7f6738067400 msgr2=0x7f67380aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 -- 172.21.15.31:0/3275715356 shutdown_connections 2024-08-17T02:28:16.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:16.758+0000 7f673edc5700 1 -- 172.21.15.31:0/3275715356 wait complete. 2024-08-17T02:28:16.784 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:28:16.784 INFO:tasks.cephfs_test_runner: 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:28:16.785 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi031 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000037340 --yes-i-really-mean-it' 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner: 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner:Ran 1 test in 178.118s 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner: 2024-08-17T02:28:16.786 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:28:16.787 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:28:16.788 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:28:16.788 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:28:16.788 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:28:16.788 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:28:16.788 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:28:16.788 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:28:16.788 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:28:16.788 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi031 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000037340 --yes-i-really-mean-it' 2024-08-17T02:28:16.788 INFO:tasks.cephfs_test_runner: 2024-08-17T02:28:16.788 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:28:16.954 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b151d7cdc7fc4dd4a293273aadf51cd0 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:28:16.956 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:28:16.964 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-17T02:28:16.973 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-17T02:28:16.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:16.974 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-08-17T02:28:16.988 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:28:16.988 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:28:16.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:16.989 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:28:17.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:28:17.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.061 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-08-17T02:28:17.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.237 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-08-17T02:28:17.245 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:28:17.246 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:28:17.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.246 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:28:17.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.305 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:28:17.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:17.319 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-08-17T02:28:17.454 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:28:17.463 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:28:17.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:17.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.574+0000 7fb978a41700 1 Processor -- start 2024-08-17T02:28:17.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.574+0000 7fb978a41700 1 -- start start 2024-08-17T02:28:17.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb978a41700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb9740ac840 0x7fb974068a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb978a41700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb974068580 con 0x7fb97415d650 2024-08-17T02:28:17.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb978a41700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb974067970 con 0x7fb97415da20 2024-08-17T02:28:17.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb978a41700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb974067c50 con 0x7fb9740ac840 2024-08-17T02:28:17.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb972d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb97415d650 0x7fb9740ac130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50554/0 (socket says 172.21.15.31:50554) 2024-08-17T02:28:17.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb972d9d700 1 -- 172.21.15.31:0/1089236834 learned_addr learned my addr 172.21.15.31:0/1089236834 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb97359e700 1 --2- 172.21.15.31:0/1089236834 >> v2:172.21.15.92:3300/0 conn(0x7fb9740ac840 0x7fb974068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb971d9b700 1 -- 172.21.15.31:0/1089236834 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074109931 0 0) 0x7fb974068580 con 0x7fb97415d650 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb971d9b700 1 -- 172.21.15.31:0/1089236834 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb960003570 con 0x7fb97415d650 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb971d9b700 1 -- 172.21.15.31:0/1089236834 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640555388 0 0) 0x7fb960003570 con 0x7fb97415d650 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb97359e700 1 -- 172.21.15.31:0/1089236834 >> v1:172.21.15.92:6789/0 conn(0x7fb97415da20 legacy=0x7fb9740b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb97359e700 1 -- 172.21.15.31:0/1089236834 >> v1:172.21.15.31:6789/0 conn(0x7fb97415d650 legacy=0x7fb9740ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb97359e700 1 -- 172.21.15.31:0/1089236834 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb974067f30 con 0x7fb9740ac840 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb97359e700 1 --2- 172.21.15.31:0/1089236834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9740ac840 0x7fb974068a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0098e0 tx=0x7fb96c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4bae1da3f9b93c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb971d9b700 1 -- 172.21.15.31:0/1089236834 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c001470 con 0x7fb9740ac840 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb971d9b700 1 -- 172.21.15.31:0/1089236834 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c011420 con 0x7fb9740ac840 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb971d9b700 1 -- 172.21.15.31:0/1089236834 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0117a0 con 0x7fb9740ac840 2024-08-17T02:28:17.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.578+0000 7fb978a41700 1 -- 172.21.15.31:0/1089236834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9740ac840 msgr2=0x7fb974068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.582+0000 7fb978a41700 1 --2- 172.21.15.31:0/1089236834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9740ac840 0x7fb974068a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0098e0 tx=0x7fb96c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.582+0000 7fb978a41700 1 -- 172.21.15.31:0/1089236834 shutdown_connections 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.582+0000 7fb978a41700 1 --2- 172.21.15.31:0/1089236834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9740ac840 0x7fb974068a10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.582+0000 7fb978a41700 1 -- 172.21.15.31:0/1089236834 >> 172.21.15.31:0/1089236834 conn(0x7fb9740cc5d0 msgr2=0x7fb9740cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.582+0000 7fb978a41700 1 -- 172.21.15.31:0/1089236834 shutdown_connections 2024-08-17T02:28:17.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.582+0000 7fb978a41700 1 -- 172.21.15.31:0/1089236834 wait complete. 2024-08-17T02:28:17.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.582+0000 7fb978a41700 1 Processor -- start 2024-08-17T02:28:17.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.582+0000 7fb978a41700 1 -- start start 2024-08-17T02:28:17.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb978a41700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9740ac840 0x7fb974163b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb978a41700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97415d650 0x7fb974158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb978a41700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97415da20 0x7fb974148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb978a41700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974158a50 con 0x7fb97415da20 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb978a41700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97415eea0 con 0x7fb97415d650 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb978a41700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb974163700 con 0x7fb9740ac840 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb97359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97415da20 0x7fb974148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb97359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97415da20 0x7fb974148820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60932/0 (socket says 172.21.15.31:60932) 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb97359e700 1 -- 172.21.15.31:0/216509364 learned_addr learned my addr 172.21.15.31:0/216509364 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:17.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb97259c700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97415d650 0x7fb974158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb972d9d700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9740ac840 0x7fb974163b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb97359e700 1 -- 172.21.15.31:0/216509364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9740ac840 msgr2=0x7fb974163b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb97359e700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9740ac840 0x7fb974163b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb97359e700 1 -- 172.21.15.31:0/216509364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97415d650 msgr2=0x7fb974158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb97359e700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97415d650 0x7fb974158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb97359e700 1 -- 172.21.15.31:0/216509364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c009420 con 0x7fb97415da20 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb972d9d700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9740ac840 0x7fb974163b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:17.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb97359e700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97415da20 0x7fb974148820 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb9740cd0e0 tx=0x7fb96c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb96affd700 1 -- 172.21.15.31:0/216509364 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c010d50 con 0x7fb97415da20 2024-08-17T02:28:17.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb96affd700 1 -- 172.21.15.31:0/216509364 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c01d430 con 0x7fb97415da20 2024-08-17T02:28:17.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb96affd700 1 -- 172.21.15.31:0/216509364 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c01d7b0 con 0x7fb97415da20 2024-08-17T02:28:17.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb978a41700 1 -- 172.21.15.31:0/216509364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb974148d60 con 0x7fb97415da20 2024-08-17T02:28:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.586+0000 7fb978a41700 1 -- 172.21.15.31:0/216509364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9741630b0 con 0x7fb97415da20 2024-08-17T02:28:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.590+0000 7fb978a41700 1 -- 172.21.15.31:0/216509364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9740712b0 con 0x7fb97415da20 2024-08-17T02:28:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.590+0000 7fb96affd700 1 -- 172.21.15.31:0/216509364 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb96c01dba0 con 0x7fb97415da20 2024-08-17T02:28:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.590+0000 7fb96affd700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb954060860 0x7fb954062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.590+0000 7fb972d9d700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb954060860 0x7fb954062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.590+0000 7fb96affd700 1 -- 172.21.15.31:0/216509364 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb96c07e880 con 0x7fb97415da20 2024-08-17T02:28:17.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.590+0000 7fb972d9d700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb954060860 0x7fb954062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0015a0 tx=0x7fb95c000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.598+0000 7fb96affd700 1 -- 172.21.15.31:0/216509364 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fb96c04eed0 con 0x7fb97415da20 2024-08-17T02:28:17.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.766+0000 7fb978a41700 1 -- 172.21.15.31:0/216509364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9740afb00 con 0x7fb97415da20 2024-08-17T02:28:17.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.766+0000 7fb96affd700 1 -- 172.21.15.31:0/216509364 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+12343 (secure 0 0 0) 0x7fb96c0524f0 con 0x7fb97415da20 2024-08-17T02:28:17.774 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:17.774 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":49,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:28:15.745629+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6836/548139464":"2024-08-18T02:28:12.737076+0000","172.21.15.31:6834/548139464":"2024-08-18T02:28:12.737076+0000","172.21.15.31:6837/1886584780":"2024-08-18T02:28:06.459399+0000","172.21.15.31:6835/1886584780":"2024-08-18T02:28:06.459399+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:17.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 -- 172.21.15.31:0/216509364 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb954060860 msgr2=0x7fb954062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb954060860 0x7fb954062d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0015a0 tx=0x7fb95c000bc0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 -- 172.21.15.31:0/216509364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97415da20 msgr2=0x7fb974148820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97415da20 0x7fb974148820 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb9740cd0e0 tx=0x7fb96c017000 comp rx=0 tx=0).stop 2024-08-17T02:28:17.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 -- 172.21.15.31:0/216509364 shutdown_connections 2024-08-17T02:28:17.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb954060860 0x7fb954062d10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb97415da20 0x7fb974148820 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97415d650 0x7fb974158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 --2- 172.21.15.31:0/216509364 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9740ac840 0x7fb974163b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 -- 172.21.15.31:0/216509364 >> 172.21.15.31:0/216509364 conn(0x7fb9740cc5d0 msgr2=0x7fb9740ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 -- 172.21.15.31:0/216509364 shutdown_connections 2024-08-17T02:28:17.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.770+0000 7fb978a41700 1 -- 172.21.15.31:0/216509364 wait complete. 2024-08-17T02:28:17.789 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:28:17.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:17.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.886+0000 7f0c1eccc700 1 Processor -- start 2024-08-17T02:28:17.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.886+0000 7f0c1eccc700 1 -- start start 2024-08-17T02:28:17.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1eccc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c1815c750 0x7f0c181641c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1eccc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1815b2b0 con 0x7f0c180ad6f0 2024-08-17T02:28:17.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1eccc700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c180ae410 con 0x7f0c1815ce20 2024-08-17T02:28:17.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1eccc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c180ae220 con 0x7f0c1815c750 2024-08-17T02:28:17.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1d4c9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0c180ad6f0 0x7f0c180adb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50560/0 (socket says 172.21.15.31:50560) 2024-08-17T02:28:17.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1d4c9700 1 -- 172.21.15.31:0/1578318123 learned_addr learned my addr 172.21.15.31:0/1578318123 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:17.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1e4cb700 1 --2- 172.21.15.31:0/1578318123 >> v2:172.21.15.92:3300/0 conn(0x7f0c1815c750 0x7f0c181641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1ccc8700 1 -- 172.21.15.31:0/1578318123 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423762746 0 0) 0x7f0c1815b2b0 con 0x7f0c180ad6f0 2024-08-17T02:28:17.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1ccc8700 1 -- 172.21.15.31:0/1578318123 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c04003570 con 0x7f0c180ad6f0 2024-08-17T02:28:17.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1e4cb700 1 -- 172.21.15.31:0/1578318123 >> v1:172.21.15.92:6789/0 conn(0x7f0c1815ce20 legacy=0x7f0c1815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1e4cb700 1 -- 172.21.15.31:0/1578318123 >> v1:172.21.15.31:6789/0 conn(0x7f0c180ad6f0 legacy=0x7f0c180adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1e4cb700 1 -- 172.21.15.31:0/1578318123 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1815aca0 con 0x7f0c1815c750 2024-08-17T02:28:17.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1e4cb700 1 --2- 172.21.15.31:0/1578318123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1815c750 0x7f0c181641c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009e60 tx=0x7f0c10009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec58528e83ca8d42 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1ccc8700 1 -- 172.21.15.31:0/1578318123 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000e070 con 0x7f0c1815c750 2024-08-17T02:28:17.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1ccc8700 1 -- 172.21.15.31:0/1578318123 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000bb60 con 0x7f0c1815c750 2024-08-17T02:28:17.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.890+0000 7f0c1ccc8700 1 -- 172.21.15.31:0/1578318123 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c10012430 con 0x7f0c1815c750 2024-08-17T02:28:17.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.894+0000 7f0c1eccc700 1 -- 172.21.15.31:0/1578318123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1815c750 msgr2=0x7f0c181641c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.894+0000 7f0c1eccc700 1 --2- 172.21.15.31:0/1578318123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1815c750 0x7f0c181641c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c10009e60 tx=0x7f0c10009780 comp rx=0 tx=0).stop 2024-08-17T02:28:17.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.894+0000 7f0c1eccc700 1 -- 172.21.15.31:0/1578318123 shutdown_connections 2024-08-17T02:28:17.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.894+0000 7f0c1eccc700 1 --2- 172.21.15.31:0/1578318123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1815c750 0x7f0c181641c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.894+0000 7f0c1eccc700 1 -- 172.21.15.31:0/1578318123 >> 172.21.15.31:0/1578318123 conn(0x7f0c18089cb0 msgr2=0x7f0c180995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.894+0000 7f0c1eccc700 1 -- 172.21.15.31:0/1578318123 shutdown_connections 2024-08-17T02:28:17.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.894+0000 7f0c1eccc700 1 -- 172.21.15.31:0/1578318123 wait complete. 2024-08-17T02:28:17.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.894+0000 7f0c1eccc700 1 Processor -- start 2024-08-17T02:28:17.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.894+0000 7f0c1eccc700 1 -- start start 2024-08-17T02:28:17.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1eccc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c180ad6f0 0x7f0c180cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1eccc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1815c750 0x7f0c180b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1eccc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c1815ce20 0x7f0c180b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1eccc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180cd870 con 0x7f0c180ad6f0 2024-08-17T02:28:17.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1eccc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1816a070 con 0x7f0c1815c750 2024-08-17T02:28:17.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1eccc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1816a350 con 0x7f0c1815ce20 2024-08-17T02:28:17.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1dcca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c180ad6f0 0x7f0c180cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1dcca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c180ad6f0 0x7f0c180cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60944/0 (socket says 172.21.15.31:60944) 2024-08-17T02:28:17.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1dcca700 1 -- 172.21.15.31:0/739731752 learned_addr learned my addr 172.21.15.31:0/739731752 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:17.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1d4c9700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1815c750 0x7f0c180b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1e4cb700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c1815ce20 0x7f0c180b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1dcca700 1 -- 172.21.15.31:0/739731752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c1815ce20 msgr2=0x7f0c180b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1dcca700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c1815ce20 0x7f0c180b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1dcca700 1 -- 172.21.15.31:0/739731752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1815c750 msgr2=0x7f0c180b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1dcca700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1815c750 0x7f0c180b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1dcca700 1 -- 172.21.15.31:0/739731752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c10009a20 con 0x7f0c180ad6f0 2024-08-17T02:28:17.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1dcca700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c180ad6f0 0x7f0c180cd330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800c790 tx=0x7f0c08007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c0dffb700 1 -- 172.21.15.31:0/739731752 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08011590 con 0x7f0c180ad6f0 2024-08-17T02:28:17.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c0dffb700 1 -- 172.21.15.31:0/739731752 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c08011710 con 0x7f0c180ad6f0 2024-08-17T02:28:17.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1eccc700 1 -- 172.21.15.31:0/739731752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1816a630 con 0x7f0c180ad6f0 2024-08-17T02:28:17.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c0dffb700 1 -- 172.21.15.31:0/739731752 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08011ad0 con 0x7f0c180ad6f0 2024-08-17T02:28:17.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1eccc700 1 -- 172.21.15.31:0/739731752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c18159cf0 con 0x7f0c180ad6f0 2024-08-17T02:28:17.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.898+0000 7f0c1eccc700 1 -- 172.21.15.31:0/739731752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c180712b0 con 0x7f0c180ad6f0 2024-08-17T02:28:17.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.902+0000 7f0c0dffb700 1 -- 172.21.15.31:0/739731752 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0c0801b3b0 con 0x7f0c180ad6f0 2024-08-17T02:28:17.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.902+0000 7f0c0dffb700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0bfc060860 0x7f0bfc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.902+0000 7f0c0dffb700 1 -- 172.21.15.31:0/739731752 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0c0807be20 con 0x7f0c180ad6f0 2024-08-17T02:28:17.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.902+0000 7f0c1d4c9700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0bfc060860 0x7f0bfc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.902+0000 7f0c1d4c9700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0bfc060860 0x7f0bfc062d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c18159990 tx=0x7f0c14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:17.910+0000 7f0c0dffb700 1 -- 172.21.15.31:0/739731752 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0c0804c510 con 0x7f0c180ad6f0 2024-08-17T02:28:18.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.070+0000 7f0c1eccc700 1 -- 172.21.15.31:0/739731752 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c1816aab0 con 0x7f0bfc060860 2024-08-17T02:28:18.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.074+0000 7f0c0dffb700 1 -- 172.21.15.31:0/739731752 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48831 (secure 0 0 0) 0x7f0c1816aab0 con 0x7f0bfc060860 2024-08-17T02:28:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 -- 172.21.15.31:0/739731752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0bfc060860 msgr2=0x7f0bfc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0bfc060860 0x7f0bfc062d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0c18159990 tx=0x7f0c14009040 comp rx=0 tx=0).stop 2024-08-17T02:28:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 -- 172.21.15.31:0/739731752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c180ad6f0 msgr2=0x7f0c180cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c180ad6f0 0x7f0c180cd330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800c790 tx=0x7f0c08007f40 comp rx=0 tx=0).stop 2024-08-17T02:28:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 -- 172.21.15.31:0/739731752 shutdown_connections 2024-08-17T02:28:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0bfc060860 0x7f0bfc062d10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c1815ce20 0x7f0c180b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c1815c750 0x7f0c180b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 --2- 172.21.15.31:0/739731752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c180ad6f0 0x7f0c180cd330 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 -- 172.21.15.31:0/739731752 >> 172.21.15.31:0/739731752 conn(0x7f0c18089cb0 msgr2=0x7f0c1806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 -- 172.21.15.31:0/739731752 shutdown_connections 2024-08-17T02:28:18.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.078+0000 7f0c1eccc700 1 -- 172.21.15.31:0/739731752 wait complete. 2024-08-17T02:28:18.087 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:28:18.097 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-08-17T02:28:17.662197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388688,"kb_used_data":5656,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586032,"statfs":{"total":773094113280,"available":770648096768,"internally_reserved":0,"allocated":5791744,"data_stored":3124584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001698"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":186,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-17T02:28:14.983840+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:28:14.983840+0000","last_peered":"2024-08-17T02:28:14.983840+0000","last_clean":"2024-08-17T02:28:14.983840+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:28:14.983840+0000","last_undegraded":"2024-08-17T02:28:14.983840+0000","last_fullsized":"2024-08-17T02:28:14.983840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91300000000000003,"15min":0.91700000000000004},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.129,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.67700000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2949999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.077}]},{"osd":1,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.67300000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2310000000000001,"5min":1.804,"15min":1.804},"last":1.052},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.72599999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1299999999999999,"5min":1.236,"15min":1.236},"last":1.179}]},{"osd":2,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.89600000000000002},"min":{"1min":0.71099999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1830000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.91100000000000003,"15min":0.90900000000000003},"min":{"1min":0.65000000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1739999999999999,"5min":1.403,"15min":1.403},"last":0.73699999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.298,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.238},{"interface":"front","average":{"1min":1.01,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.75800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3120000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.80700000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.96199999999999997,"15min":0.98099999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.234,"5min":1.502,"15min":1.502},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.115,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2210000000000001,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.1499999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.056,"15min":1.089},"min":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2470000000000001,"5min":1.401,"15min":1.401},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1890000000000001,"15min":1.216},"min":{"1min":0.89600000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.3500000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.286}]},{"osd":6,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1359999999999999,"15min":1.1599999999999999},"min":{"1min":0.82799999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.3049999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.202},{"interface":"front","average":{"1min":1.167,"5min":1.214,"15min":1.2370000000000001},"min":{"1min":0.97999999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.357,"5min":2.073,"15min":2.073},"last":1.3200000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97199999999999998,"15min":0.98099999999999998},"min":{"1min":0.77000000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2529999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.093},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.01,"15min":1.026},"min":{"1min":0.81100000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.1459999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0229999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1279999999999999,"5min":1.47,"15min":1.47},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.996,"15min":1},"min":{"1min":0.66800000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.202,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.244}]},{"osd":2,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89100000000000001,"15min":0.877},"min":{"1min":0.64200000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.2649999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.92900000000000005,"15min":0.95499999999999996},"min":{"1min":0.66200000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.133,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.94599999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93500000000000005,"15min":0.96499999999999997},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1679999999999999,"5min":1.593,"15min":1.593},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.089,"15min":1.087},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.292,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91200000000000003,"15min":0.93600000000000005},"min":{"1min":0.59799999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1799999999999999,"5min":1.357,"15min":1.357},"last":1.325},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.016,"15min":1.048},"min":{"1min":0.67100000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.26,"5min":1.762,"15min":1.762},"last":1.278}]},{"osd":5,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":1.014,"15min":1.02},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1879999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.169,"15min":1.198},"min":{"1min":0.95599999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.3859999999999999,"5min":1.548,"15min":1.548},"last":1.3919999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.80500000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.25,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.21},{"interface":"front","average":{"1min":1.121,"5min":1.1879999999999999,"15min":1.208},"min":{"1min":0.88,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.48,"5min":1.796,"15min":1.796},"last":1.0629999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83599999999999997},"min":{"1min":0.621,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1930000000000001,"5min":1.371,"15min":1.371},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.86599999999999999,"15min":0.88200000000000001},"min":{"1min":0.61299999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.105,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.98899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.67100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.93300000000000005,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2509999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.099}]},{"osd":2,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.93899999999999995,"15min":0.94999999999999996},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.198,"5min":1.47,"15min":1.47},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.306,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.95099999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.96599999999999997},"min":{"1min":0.74099999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1379999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.04,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.86399999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3380000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0409999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.99199999999999999,"15min":1.0129999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.242,"5min":1.613,"15min":1.613},"last":1.268},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0900000000000001,"15min":1.1060000000000001},"min":{"1min":0.66500000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.276,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.3460000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.052,"15min":1.0660000000000001},"min":{"1min":0.71999999999999997,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3899999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.127,"5min":1.107,"15min":1.103},"min":{"1min":0.86299999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.377,"5min":1.589,"15min":1.589},"last":1.1990000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3580000000000001,"5min":2.016,"15min":2.016},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1759999999999999,"15min":1.1819999999999999},"min":{"1min":0.997,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.3999999999999999,"5min":1.625,"15min":1.625},"last":1.4019999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297924,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.52600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.73399999999999999,"15min":0.70399999999999996},"min":{"1min":0.59599999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.80000000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.55900000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1259999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.69999999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.73,"15min":1.73},"last":0.89800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.79800000000000004},"min":{"1min":0.63400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0569999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.876,"15min":0.871},"min":{"1min":0.67100000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.139,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.044}]},{"osd":4,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0600000000000001,"15min":1.056},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.099},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.089,"15min":1.0800000000000001},"min":{"1min":0.84999999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.613,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.214}]},{"osd":5,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1659999999999999,"15min":1.171},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.3640000000000001,"5min":1.599,"15min":1.599},"last":1.546},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1819999999999999,"15min":1.1879999999999999},"min":{"1min":0.89100000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.502,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.98299999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.236,"15min":1.2629999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.716,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.234,"15min":1.244},"min":{"1min":1,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.458,"5min":2.427,"15min":2.427},"last":1.4059999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":1.0640000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5760000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.25},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2749999999999999,"15min":1.2709999999999999},"min":{"1min":1.127,"5min":0.878,"15min":0.878},"max":{"1min":1.629,"5min":2.278,"15min":2.278},"last":1.504}]}]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297924,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.52800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2709999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79800000000000004,"15min":0.78400000000000003},"min":{"1min":0.60999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0760000000000001,"5min":1.974,"15min":1.974},"last":0.65000000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.60099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":1.016,"5min":1.423,"15min":1.423},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84499999999999997,"15min":0.84099999999999997},"min":{"1min":0.58699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1479999999999999,"5min":1.641,"15min":1.641},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.621,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.284,"5min":1.347,"15min":1.347},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95899999999999996,"15min":0.97099999999999997},"min":{"1min":0.74399999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1779999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.73099999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.087,"15min":1.091},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2569999999999999,"5min":2.113,"15min":2.113},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.056,"5min":1.0329999999999999,"15min":1.0409999999999999},"min":{"1min":0.84399999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3779999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.83999999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.163,"15min":1.1779999999999999},"min":{"1min":0.80800000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4279999999999999,"5min":2.613,"15min":2.613},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.206,"15min":1.216},"min":{"1min":0.92400000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.3320000000000001,"5min":2.298,"15min":2.298},"last":1.0760000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1319999999999999,"15min":1.141},"min":{"1min":0.84099999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4870000000000001,"5min":1.986,"15min":1.986},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.226,"15min":1.2390000000000001},"min":{"1min":0.89800000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.738,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2509999999999999,"15min":1.2549999999999999},"min":{"1min":0.91000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.46,"5min":2.516,"15min":2.516},"last":1.179},{"interface":"front","average":{"1min":1.27,"5min":1.2090000000000001,"15min":1.1990000000000001},"min":{"1min":1.046,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5669999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2090000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298504,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073336,"statfs":{"total":96636764160,"available":96331096064,"internally_reserved":0,"allocated":1171456,"data_stored":834055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.502,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0900000000000001,"5min":1.925,"15min":1.925},"last":0.436},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.78000000000000003},"min":{"1min":0.56699999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84699999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3440000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81499999999999995,"15min":0.81000000000000005},"min":{"1min":0.63900000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1160000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.68200000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0289999999999999,"5min":1.093,"15min":1.093},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2130000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.093,"15min":1.127},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4119999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.012,"15min":0.996},"min":{"1min":0.76400000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.872}]},{"osd":5,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.083,"15min":1.093},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4450000000000001,"5min":1.546,"15min":1.546},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.1779999999999999,"15min":1.2},"min":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.429,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.85099999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1539999999999999,"15min":1.1719999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.4470000000000001,"5min":1.869,"15min":1.869},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.238,"5min":1.2310000000000001,"15min":1.248},"min":{"1min":1.087,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.512,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.91600000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1379999999999999,"15min":1.1200000000000001},"min":{"1min":1.0169999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.403,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.242,"5min":1.252,"15min":1.258},"min":{"1min":0.96799999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.542,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.82399999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297928,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.621},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.76100000000000001},"min":{"1min":0.59499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.46300000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1279999999999999,"5min":1.304,"15min":1.304},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79400000000000004,"15min":0.77400000000000002},"min":{"1min":0.59899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.1479999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.53600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.002,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91900000000000004,"15min":0.90700000000000003},"min":{"1min":0.68799999999999994,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.242,"5min":1.617,"15min":1.617},"last":1.077}]},{"osd":4,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0569999999999999,"15min":1.0580000000000001},"min":{"1min":0.80100000000000005,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0860000000000001,"15min":1.103},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.357,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0600000000000001,"15min":1.0620000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.2969999999999999,"5min":1.53,"15min":1.53},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.115,"5min":1.177,"15min":1.1830000000000001},"min":{"1min":0.81499999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5029999999999999,"5min":2.226,"15min":2.226},"last":1.2410000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.92800000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4139999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.321},{"interface":"front","average":{"1min":1.228,"5min":1.1919999999999999,"15min":1.1719999999999999},"min":{"1min":0.98499999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.452,"5min":1.752,"15min":1.752},"last":1.212}]},{"osd":7,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.266,"15min":1.2569999999999999},"min":{"1min":1.0269999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.518,"5min":2.419,"15min":2.419},"last":1.278},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.222,"15min":1.2170000000000001},"min":{"1min":0.91600000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.478,"5min":2.274,"15min":2.274},"last":1.1699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302648,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1155072,"data_stored":828407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.72599999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.90800000000000003,"15min":0.91100000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1519999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.88100000000000001,"15min":0.877},"min":{"1min":0.626,"5min":0.505,"15min":0.505},"max":{"1min":1.0649999999999999,"5min":1.268,"15min":1.268},"last":0.755},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.165,"5min":1.2,"15min":1.2},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89700000000000002,"15min":0.873},"min":{"1min":0.63200000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.2070000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95699999999999996,"15min":0.97899999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2070000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0369999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.94599999999999995,"15min":0.95199999999999996},"min":{"1min":0.74099999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.98699999999999999},"min":{"1min":0.81000000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.242,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.0649999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.64100000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.153,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0680000000000001,"15min":1.0720000000000001},"min":{"1min":0.76900000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.67200000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.173,"5min":2.141,"15min":2.141},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.1479999999999999,"15min":1.147},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.2989999999999999,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.141}]},{"osd":7,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.137,"15min":1.1539999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.3029999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.161,"15min":1.157},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.274,"5min":2.226,"15min":2.226},"last":1.2270000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:18.099 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:18.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 Processor -- start 2024-08-17T02:28:18.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 -- start start 2024-08-17T02:28:18.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e80159250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1e800cd880 0x7f1e800afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8006e7a0 con 0x7f1e800ab870 2024-08-17T02:28:18.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e800ac1c0 con 0x7f1e800cd880 2024-08-17T02:28:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800ac4a0 con 0x7f1e80158e80 2024-08-17T02:28:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e80159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e80159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:53740/0 (socket says 172.21.15.31:53740) 2024-08-17T02:28:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7e7fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1e800cd880 0x7f1e800afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7effd700 1 -- 172.21.15.31:0/368605898 learned_addr learned my addr 172.21.15.31:0/368605898 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7effd700 1 -- 172.21.15.31:0/368605898 >> v2:172.21.15.92:3300/0 conn(0x7f1e800cd880 msgr2=0x7f1e800afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7effd700 1 --2- 172.21.15.31:0/368605898 >> v2:172.21.15.92:3300/0 conn(0x7f1e800cd880 0x7f1e800afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7effd700 1 -- 172.21.15.31:0/368605898 >> v1:172.21.15.92:6789/0 conn(0x7f1e800ab870 legacy=0x7f1e800aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7dffb700 1 -- 172.21.15.31:0/368605898 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308407350 0 0) 0x7f1e8006e7a0 con 0x7f1e800ab870 2024-08-17T02:28:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7effd700 1 -- 172.21.15.31:0/368605898 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800ac780 con 0x7f1e80158e80 2024-08-17T02:28:18.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7effd700 1 --2- 172.21.15.31:0/368605898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e80159250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1e700099b0 tx=0x7f1e70009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f865d8e5eb72356a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7dffb700 1 -- 172.21.15.31:0/368605898 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70009ea0 con 0x7f1e80158e80 2024-08-17T02:28:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7dffb700 1 -- 172.21.15.31:0/368605898 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7000b860 con 0x7f1e80158e80 2024-08-17T02:28:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7dffb700 1 -- 172.21.15.31:0/368605898 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000bc00 con 0x7f1e80158e80 2024-08-17T02:28:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 -- 172.21.15.31:0/368605898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 msgr2=0x7f1e80159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 --2- 172.21.15.31:0/368605898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e80159250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1e700099b0 tx=0x7f1e70009250 comp rx=0 tx=0).stop 2024-08-17T02:28:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 -- 172.21.15.31:0/368605898 shutdown_connections 2024-08-17T02:28:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 --2- 172.21.15.31:0/368605898 >> v2:172.21.15.92:3300/0 conn(0x7f1e800cd880 0x7f1e800afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 --2- 172.21.15.31:0/368605898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e80159250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.206+0000 7f1e7ffff700 1 -- 172.21.15.31:0/368605898 >> 172.21.15.31:0/368605898 conn(0x7f1e80063b20 msgr2=0x7f1e8006b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7ffff700 1 -- 172.21.15.31:0/368605898 shutdown_connections 2024-08-17T02:28:18.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7ffff700 1 -- 172.21.15.31:0/368605898 wait complete. 2024-08-17T02:28:18.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7ffff700 1 Processor -- start 2024-08-17T02:28:18.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7ffff700 1 -- start start 2024-08-17T02:28:18.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e800ab870 0x7f1e80144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e800cd880 0x7f1e800b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e800b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8014ee90 con 0x7f1e800cd880 2024-08-17T02:28:18.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7ffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8015abb0 con 0x7f1e800ab870 2024-08-17T02:28:18.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7ffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8015a5a0 con 0x7f1e80158e80 2024-08-17T02:28:18.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e800cd880 0x7f1e800b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e800cd880 0x7f1e800b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60958/0 (socket says 172.21.15.31:60958) 2024-08-17T02:28:18.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e800ab870 0x7f1e80144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7e7fc700 1 -- 172.21.15.31:0/3217811758 learned_addr learned my addr 172.21.15.31:0/3217811758 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:18.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.210+0000 7f1e7f7fe700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e800b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7e7fc700 1 -- 172.21.15.31:0/3217811758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 msgr2=0x7f1e800b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7e7fc700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e800b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7e7fc700 1 -- 172.21.15.31:0/3217811758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e800ab870 msgr2=0x7f1e80144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7e7fc700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e800ab870 0x7f1e80144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7e7fc700 1 -- 172.21.15.31:0/3217811758 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e700094f0 con 0x7f1e800cd880 2024-08-17T02:28:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7f7fe700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e800b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7effd700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e800ab870 0x7f1e80144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7e7fc700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e800cd880 0x7f1e800b0e80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400ec80 tx=0x7f1e740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e66ffd700 1 -- 172.21.15.31:0/3217811758 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400c850 con 0x7f1e800cd880 2024-08-17T02:28:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7ffff700 1 -- 172.21.15.31:0/3217811758 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e800b1ab0 con 0x7f1e800cd880 2024-08-17T02:28:18.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7ffff700 1 -- 172.21.15.31:0/3217811758 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e800b1d90 con 0x7f1e800cd880 2024-08-17T02:28:18.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e66ffd700 1 -- 172.21.15.31:0/3217811758 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7400c9b0 con 0x7f1e800cd880 2024-08-17T02:28:18.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e66ffd700 1 -- 172.21.15.31:0/3217811758 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400cd50 con 0x7f1e800cd880 2024-08-17T02:28:18.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e7ffff700 1 -- 172.21.15.31:0/3217811758 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e600052b0 con 0x7f1e800cd880 2024-08-17T02:28:18.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e66ffd700 1 -- 172.21.15.31:0/3217811758 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f1e74013680 con 0x7f1e800cd880 2024-08-17T02:28:18.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.214+0000 7f1e66ffd700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1e6c060860 0x7f1e6c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.218+0000 7f1e66ffd700 1 -- 172.21.15.31:0/3217811758 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1e7407ce60 con 0x7f1e800cd880 2024-08-17T02:28:18.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.218+0000 7f1e7effd700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1e6c060860 0x7f1e6c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.218+0000 7f1e7effd700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1e6c060860 0x7f1e6c062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e700099b0 tx=0x7f1e70017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.222+0000 7f1e66ffd700 1 -- 172.21.15.31:0/3217811758 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f1e7404d550 con 0x7f1e800cd880 2024-08-17T02:28:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.382+0000 7f1e7ffff700 1 -- 172.21.15.31:0/3217811758 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e60000bc0 con 0x7f1e6c060860 2024-08-17T02:28:18.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.386+0000 7f1e66ffd700 1 -- 172.21.15.31:0/3217811758 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48831 (secure 0 0 0) 0x7f1e60000bc0 con 0x7f1e6c060860 2024-08-17T02:28:18.393 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:18.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 -- 172.21.15.31:0/3217811758 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1e6c060860 msgr2=0x7f1e6c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1e6c060860 0x7f1e6c062d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e700099b0 tx=0x7f1e70017000 comp rx=0 tx=0).stop 2024-08-17T02:28:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 -- 172.21.15.31:0/3217811758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e800cd880 msgr2=0x7f1e800b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e800cd880 0x7f1e800b0e80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400ec80 tx=0x7f1e740091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 -- 172.21.15.31:0/3217811758 shutdown_connections 2024-08-17T02:28:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f1e6c060860 0x7f1e6c062d10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1e80158e80 0x7f1e800b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e800cd880 0x7f1e800b0e80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 --2- 172.21.15.31:0/3217811758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e800ab870 0x7f1e80144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 -- 172.21.15.31:0/3217811758 >> 172.21.15.31:0/3217811758 conn(0x7f1e80063b20 msgr2=0x7f1e80157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 -- 172.21.15.31:0/3217811758 shutdown_connections 2024-08-17T02:28:18.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.390+0000 7f1e7ffff700 1 -- 172.21.15.31:0/3217811758 wait complete. 2024-08-17T02:28:18.399 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:28:18.411 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-08-17T02:28:17.662197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388688,"kb_used_data":5656,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586032,"statfs":{"total":773094113280,"available":770648096768,"internally_reserved":0,"allocated":5791744,"data_stored":3124584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001698"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":186,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-17T02:28:14.983840+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:28:14.983840+0000","last_peered":"2024-08-17T02:28:14.983840+0000","last_clean":"2024-08-17T02:28:14.983840+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:28:14.983840+0000","last_undegraded":"2024-08-17T02:28:14.983840+0000","last_fullsized":"2024-08-17T02:28:14.983840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91300000000000003,"15min":0.91700000000000004},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.129,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.67700000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2949999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.077}]},{"osd":1,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.67300000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2310000000000001,"5min":1.804,"15min":1.804},"last":1.052},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.72599999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1299999999999999,"5min":1.236,"15min":1.236},"last":1.179}]},{"osd":2,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.89600000000000002},"min":{"1min":0.71099999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1830000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.91100000000000003,"15min":0.90900000000000003},"min":{"1min":0.65000000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1739999999999999,"5min":1.403,"15min":1.403},"last":0.73699999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.298,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.238},{"interface":"front","average":{"1min":1.01,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.75800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3120000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.80700000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.96199999999999997,"15min":0.98099999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.234,"5min":1.502,"15min":1.502},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.115,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2210000000000001,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.1499999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.056,"15min":1.089},"min":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2470000000000001,"5min":1.401,"15min":1.401},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1890000000000001,"15min":1.216},"min":{"1min":0.89600000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.3500000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.286}]},{"osd":6,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1359999999999999,"15min":1.1599999999999999},"min":{"1min":0.82799999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.3049999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.202},{"interface":"front","average":{"1min":1.167,"5min":1.214,"15min":1.2370000000000001},"min":{"1min":0.97999999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.357,"5min":2.073,"15min":2.073},"last":1.3200000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97199999999999998,"15min":0.98099999999999998},"min":{"1min":0.77000000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2529999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.093},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.01,"15min":1.026},"min":{"1min":0.81100000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.1459999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0229999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1279999999999999,"5min":1.47,"15min":1.47},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.996,"15min":1},"min":{"1min":0.66800000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.202,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.244}]},{"osd":2,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89100000000000001,"15min":0.877},"min":{"1min":0.64200000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.2649999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.92900000000000005,"15min":0.95499999999999996},"min":{"1min":0.66200000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.133,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.94599999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93500000000000005,"15min":0.96499999999999997},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1679999999999999,"5min":1.593,"15min":1.593},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.089,"15min":1.087},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.292,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91200000000000003,"15min":0.93600000000000005},"min":{"1min":0.59799999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1799999999999999,"5min":1.357,"15min":1.357},"last":1.325},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.016,"15min":1.048},"min":{"1min":0.67100000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.26,"5min":1.762,"15min":1.762},"last":1.278}]},{"osd":5,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":1.014,"15min":1.02},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1879999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.169,"15min":1.198},"min":{"1min":0.95599999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.3859999999999999,"5min":1.548,"15min":1.548},"last":1.3919999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.80500000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.25,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.21},{"interface":"front","average":{"1min":1.121,"5min":1.1879999999999999,"15min":1.208},"min":{"1min":0.88,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.48,"5min":1.796,"15min":1.796},"last":1.0629999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83599999999999997},"min":{"1min":0.621,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1930000000000001,"5min":1.371,"15min":1.371},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.86599999999999999,"15min":0.88200000000000001},"min":{"1min":0.61299999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.105,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.98899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.67100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.93300000000000005,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2509999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.099}]},{"osd":2,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.93899999999999995,"15min":0.94999999999999996},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.198,"5min":1.47,"15min":1.47},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.306,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.95099999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.96599999999999997},"min":{"1min":0.74099999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1379999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.04,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.86399999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3380000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0409999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.99199999999999999,"15min":1.0129999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.242,"5min":1.613,"15min":1.613},"last":1.268},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0900000000000001,"15min":1.1060000000000001},"min":{"1min":0.66500000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.276,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.3460000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.052,"15min":1.0660000000000001},"min":{"1min":0.71999999999999997,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3899999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.127,"5min":1.107,"15min":1.103},"min":{"1min":0.86299999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.377,"5min":1.589,"15min":1.589},"last":1.1990000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3580000000000001,"5min":2.016,"15min":2.016},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1759999999999999,"15min":1.1819999999999999},"min":{"1min":0.997,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.3999999999999999,"5min":1.625,"15min":1.625},"last":1.4019999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297924,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.52600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.73399999999999999,"15min":0.70399999999999996},"min":{"1min":0.59599999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.80000000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.55900000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1259999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.69999999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.73,"15min":1.73},"last":0.89800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.79800000000000004},"min":{"1min":0.63400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0569999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.876,"15min":0.871},"min":{"1min":0.67100000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.139,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.044}]},{"osd":4,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0600000000000001,"15min":1.056},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.099},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.089,"15min":1.0800000000000001},"min":{"1min":0.84999999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.613,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.214}]},{"osd":5,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1659999999999999,"15min":1.171},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.3640000000000001,"5min":1.599,"15min":1.599},"last":1.546},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1819999999999999,"15min":1.1879999999999999},"min":{"1min":0.89100000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.502,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.98299999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.236,"15min":1.2629999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.716,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.234,"15min":1.244},"min":{"1min":1,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.458,"5min":2.427,"15min":2.427},"last":1.4059999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":1.0640000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5760000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.25},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2749999999999999,"15min":1.2709999999999999},"min":{"1min":1.127,"5min":0.878,"15min":0.878},"max":{"1min":1.629,"5min":2.278,"15min":2.278},"last":1.504}]}]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297924,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.52800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2709999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79800000000000004,"15min":0.78400000000000003},"min":{"1min":0.60999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0760000000000001,"5min":1.974,"15min":1.974},"last":0.65000000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.60099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":1.016,"5min":1.423,"15min":1.423},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84499999999999997,"15min":0.84099999999999997},"min":{"1min":0.58699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1479999999999999,"5min":1.641,"15min":1.641},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.621,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.284,"5min":1.347,"15min":1.347},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95899999999999996,"15min":0.97099999999999997},"min":{"1min":0.74399999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1779999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.73099999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.087,"15min":1.091},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2569999999999999,"5min":2.113,"15min":2.113},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.056,"5min":1.0329999999999999,"15min":1.0409999999999999},"min":{"1min":0.84399999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3779999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.83999999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.163,"15min":1.1779999999999999},"min":{"1min":0.80800000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4279999999999999,"5min":2.613,"15min":2.613},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.206,"15min":1.216},"min":{"1min":0.92400000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.3320000000000001,"5min":2.298,"15min":2.298},"last":1.0760000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1319999999999999,"15min":1.141},"min":{"1min":0.84099999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4870000000000001,"5min":1.986,"15min":1.986},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.226,"15min":1.2390000000000001},"min":{"1min":0.89800000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.738,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2509999999999999,"15min":1.2549999999999999},"min":{"1min":0.91000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.46,"5min":2.516,"15min":2.516},"last":1.179},{"interface":"front","average":{"1min":1.27,"5min":1.2090000000000001,"15min":1.1990000000000001},"min":{"1min":1.046,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5669999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2090000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298504,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073336,"statfs":{"total":96636764160,"available":96331096064,"internally_reserved":0,"allocated":1171456,"data_stored":834055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.502,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0900000000000001,"5min":1.925,"15min":1.925},"last":0.436},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.78000000000000003},"min":{"1min":0.56699999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84699999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3440000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81499999999999995,"15min":0.81000000000000005},"min":{"1min":0.63900000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1160000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.68200000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0289999999999999,"5min":1.093,"15min":1.093},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2130000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.093,"15min":1.127},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4119999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.012,"15min":0.996},"min":{"1min":0.76400000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.872}]},{"osd":5,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.083,"15min":1.093},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4450000000000001,"5min":1.546,"15min":1.546},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.1779999999999999,"15min":1.2},"min":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.429,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.85099999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1539999999999999,"15min":1.1719999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.4470000000000001,"5min":1.869,"15min":1.869},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.238,"5min":1.2310000000000001,"15min":1.248},"min":{"1min":1.087,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.512,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.91600000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1379999999999999,"15min":1.1200000000000001},"min":{"1min":1.0169999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.403,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.242,"5min":1.252,"15min":1.258},"min":{"1min":0.96799999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.542,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.82399999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297928,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.621},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.76100000000000001},"min":{"1min":0.59499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.46300000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1279999999999999,"5min":1.304,"15min":1.304},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79400000000000004,"15min":0.77400000000000002},"min":{"1min":0.59899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.1479999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.53600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.002,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91900000000000004,"15min":0.90700000000000003},"min":{"1min":0.68799999999999994,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.242,"5min":1.617,"15min":1.617},"last":1.077}]},{"osd":4,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0569999999999999,"15min":1.0580000000000001},"min":{"1min":0.80100000000000005,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0860000000000001,"15min":1.103},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.357,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0600000000000001,"15min":1.0620000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.2969999999999999,"5min":1.53,"15min":1.53},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.115,"5min":1.177,"15min":1.1830000000000001},"min":{"1min":0.81499999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5029999999999999,"5min":2.226,"15min":2.226},"last":1.2410000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.92800000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4139999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.321},{"interface":"front","average":{"1min":1.228,"5min":1.1919999999999999,"15min":1.1719999999999999},"min":{"1min":0.98499999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.452,"5min":1.752,"15min":1.752},"last":1.212}]},{"osd":7,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.266,"15min":1.2569999999999999},"min":{"1min":1.0269999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.518,"5min":2.419,"15min":2.419},"last":1.278},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.222,"15min":1.2170000000000001},"min":{"1min":0.91600000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.478,"5min":2.274,"15min":2.274},"last":1.1699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302648,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1155072,"data_stored":828407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.72599999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.90800000000000003,"15min":0.91100000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1519999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.88100000000000001,"15min":0.877},"min":{"1min":0.626,"5min":0.505,"15min":0.505},"max":{"1min":1.0649999999999999,"5min":1.268,"15min":1.268},"last":0.755},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.165,"5min":1.2,"15min":1.2},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89700000000000002,"15min":0.873},"min":{"1min":0.63200000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.2070000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95699999999999996,"15min":0.97899999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2070000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0369999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.94599999999999995,"15min":0.95199999999999996},"min":{"1min":0.74099999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.98699999999999999},"min":{"1min":0.81000000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.242,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.0649999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.64100000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.153,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0680000000000001,"15min":1.0720000000000001},"min":{"1min":0.76900000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.67200000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.173,"5min":2.141,"15min":2.141},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.1479999999999999,"15min":1.147},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.2989999999999999,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.141}]},{"osd":7,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.137,"15min":1.1539999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.3029999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.161,"15min":1.157},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.274,"5min":2.226,"15min":2.226},"last":1.2270000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:18.414 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:28:18.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e23fff700 1 Processor -- start 2024-08-17T02:28:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e23fff700 1 -- start start 2024-08-17T02:28:18.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e23fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e24140780 0x7f2e24140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e23fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 0x7f2e240b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e23fff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e240ca7c0 con 0x7f2e240c9c30 2024-08-17T02:28:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e23fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e240b1970 con 0x7f2e24140780 2024-08-17T02:28:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e23fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e240ab690 con 0x7f2e240b0fe0 2024-08-17T02:28:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e22ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e24140780 0x7f2e24140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e22ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e24140780 0x7f2e24140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60970/0 (socket says 172.21.15.31:60970) 2024-08-17T02:28:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e22ffd700 1 -- 172.21.15.31:0/2453956440 learned_addr learned my addr 172.21.15.31:0/2453956440 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e227fc700 1 --2- 172.21.15.31:0/2453956440 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 0x7f2e240b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e22ffd700 1 -- 172.21.15.31:0/2453956440 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 msgr2=0x7f2e240b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:18.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e22ffd700 1 --2- 172.21.15.31:0/2453956440 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 0x7f2e240b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e21ffb700 1 -- 172.21.15.31:0/2453956440 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770662053 0 0) 0x7f2e1c001490 con 0x7f2e240c9c30 2024-08-17T02:28:18.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e22ffd700 1 -- 172.21.15.31:0/2453956440 >> v1:172.21.15.92:6789/0 conn(0x7f2e240c9c30 legacy=0x7f2e240ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.518+0000 7f2e22ffd700 1 -- 172.21.15.31:0/2453956440 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e240caa00 con 0x7f2e24140780 2024-08-17T02:28:18.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e22ffd700 1 --2- 172.21.15.31:0/2453956440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e24140780 0x7f2e24140b50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2e140099b0 tx=0x7f2e14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93e530fb088a1f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e21ffb700 1 -- 172.21.15.31:0/2453956440 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14009ea0 con 0x7f2e24140780 2024-08-17T02:28:18.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e21ffb700 1 -- 172.21.15.31:0/2453956440 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1400b860 con 0x7f2e24140780 2024-08-17T02:28:18.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e21ffb700 1 -- 172.21.15.31:0/2453956440 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1400bc00 con 0x7f2e24140780 2024-08-17T02:28:18.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e23fff700 1 -- 172.21.15.31:0/2453956440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e24140780 msgr2=0x7f2e24140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e23fff700 1 --2- 172.21.15.31:0/2453956440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e24140780 0x7f2e24140b50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2e140099b0 tx=0x7f2e14009250 comp rx=0 tx=0).stop 2024-08-17T02:28:18.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e23fff700 1 -- 172.21.15.31:0/2453956440 shutdown_connections 2024-08-17T02:28:18.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e23fff700 1 --2- 172.21.15.31:0/2453956440 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 0x7f2e240b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e23fff700 1 --2- 172.21.15.31:0/2453956440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e24140780 0x7f2e24140b50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e23fff700 1 -- 172.21.15.31:0/2453956440 >> 172.21.15.31:0/2453956440 conn(0x7f2e24067400 msgr2=0x7f2e24067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e23fff700 1 -- 172.21.15.31:0/2453956440 shutdown_connections 2024-08-17T02:28:18.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e23fff700 1 -- 172.21.15.31:0/2453956440 wait complete. 2024-08-17T02:28:18.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e23fff700 1 Processor -- start 2024-08-17T02:28:18.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.522+0000 7f2e23fff700 1 -- start start 2024-08-17T02:28:18.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e23fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 0x7f2e2416b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e23fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e240c9c30 0x7f2e24136990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e23fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e24140780 0x7f2e240a8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e23fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2415aa90 con 0x7f2e240c9c30 2024-08-17T02:28:18.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e23fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2416bb00 con 0x7f2e24140780 2024-08-17T02:28:18.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e23fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24159e80 con 0x7f2e240b0fe0 2024-08-17T02:28:18.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e227fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e240c9c30 0x7f2e24136990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e227fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e240c9c30 0x7f2e24136990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60974/0 (socket says 172.21.15.31:60974) 2024-08-17T02:28:18.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e227fc700 1 -- 172.21.15.31:0/449982584 learned_addr learned my addr 172.21.15.31:0/449982584 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:18.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e22ffd700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 0x7f2e2416b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e237fe700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e24140780 0x7f2e240a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e227fc700 1 -- 172.21.15.31:0/449982584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 msgr2=0x7f2e2416b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e227fc700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 0x7f2e2416b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e227fc700 1 -- 172.21.15.31:0/449982584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e24140780 msgr2=0x7f2e240a8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e227fc700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e24140780 0x7f2e240a8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e227fc700 1 -- 172.21.15.31:0/449982584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140094f0 con 0x7f2e240c9c30 2024-08-17T02:28:18.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e22ffd700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 0x7f2e2416b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:18.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e237fe700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e24140780 0x7f2e240a8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:18.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e227fc700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e240c9c30 0x7f2e24136990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00ecb0 tx=0x7f2e0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e1affd700 1 -- 172.21.15.31:0/449982584 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00c9d0 con 0x7f2e240c9c30 2024-08-17T02:28:18.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e1affd700 1 -- 172.21.15.31:0/449982584 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c00cb30 con 0x7f2e240c9c30 2024-08-17T02:28:18.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e23fff700 1 -- 172.21.15.31:0/449982584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2415a160 con 0x7f2e240c9c30 2024-08-17T02:28:18.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e1affd700 1 -- 172.21.15.31:0/449982584 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00ced0 con 0x7f2e240c9c30 2024-08-17T02:28:18.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e23fff700 1 -- 172.21.15.31:0/449982584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2415a720 con 0x7f2e240c9c30 2024-08-17T02:28:18.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.526+0000 7f2e1affd700 1 -- 172.21.15.31:0/449982584 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2e0c013680 con 0x7f2e240c9c30 2024-08-17T02:28:18.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.530+0000 7f2e23fff700 1 -- 172.21.15.31:0/449982584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2415ac40 con 0x7f2e240c9c30 2024-08-17T02:28:18.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.530+0000 7f2e1affd700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2e08060860 0x7f2e08062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.530+0000 7f2e1affd700 1 -- 172.21.15.31:0/449982584 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2e0c07cc70 con 0x7f2e240c9c30 2024-08-17T02:28:18.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.530+0000 7f2e22ffd700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2e08060860 0x7f2e08062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.530+0000 7f2e22ffd700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2e08060860 0x7f2e08062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2e140099b0 tx=0x7f2e14017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.534+0000 7f2e1affd700 1 -- 172.21.15.31:0/449982584 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f2e2415ac40 con 0x7f2e240c9c30 2024-08-17T02:28:18.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.698+0000 7f2e23fff700 1 -- 172.21.15.31:0/449982584 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e2415ac40 con 0x7f2e08060860 2024-08-17T02:28:18.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.702+0000 7f2e1affd700 1 -- 172.21.15.31:0/449982584 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48831 (secure 0 0 0) 0x7f2e2415ac40 con 0x7f2e08060860 2024-08-17T02:28:18.709 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:18.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.702+0000 7f2e23fff700 1 -- 172.21.15.31:0/449982584 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2e08060860 msgr2=0x7f2e08062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.702+0000 7f2e23fff700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2e08060860 0x7f2e08062d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2e140099b0 tx=0x7f2e14017000 comp rx=0 tx=0).stop 2024-08-17T02:28:18.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.702+0000 7f2e23fff700 1 -- 172.21.15.31:0/449982584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e240c9c30 msgr2=0x7f2e24136990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.702+0000 7f2e23fff700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e240c9c30 0x7f2e24136990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00ecb0 tx=0x7f2e0c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.702+0000 7f2e23fff700 1 -- 172.21.15.31:0/449982584 shutdown_connections 2024-08-17T02:28:18.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.702+0000 7f2e23fff700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2e08060860 0x7f2e08062d10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.702+0000 7f2e23fff700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e24140780 0x7f2e240a8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.702+0000 7f2e23fff700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e240c9c30 0x7f2e24136990 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.702+0000 7f2e23fff700 1 --2- 172.21.15.31:0/449982584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e240b0fe0 0x7f2e2416b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.706+0000 7f2e23fff700 1 -- 172.21.15.31:0/449982584 >> 172.21.15.31:0/449982584 conn(0x7f2e24067400 msgr2=0x7f2e24155ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.706+0000 7f2e23fff700 1 -- 172.21.15.31:0/449982584 shutdown_connections 2024-08-17T02:28:18.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.706+0000 7f2e23fff700 1 -- 172.21.15.31:0/449982584 wait complete. 2024-08-17T02:28:18.712 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:28:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-08-17T02:28:17.662197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388688,"kb_used_data":5656,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586032,"statfs":{"total":773094113280,"available":770648096768,"internally_reserved":0,"allocated":5791744,"data_stored":3124584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001698"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":186,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-08-17T02:28:14.983840+0000","last_change":"2024-08-17T02:24:35.596687+0000","last_active":"2024-08-17T02:28:14.983840+0000","last_peered":"2024-08-17T02:28:14.983840+0000","last_clean":"2024-08-17T02:28:14.983840+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:28:14.983840+0000","last_undegraded":"2024-08-17T02:28:14.983840+0000","last_fullsized":"2024-08-17T02:28:14.983840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:24:34.458008+0000","last_clean_scrub_stamp":"2024-08-17T02:24:34.458008+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:42.611213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91300000000000003,"15min":0.91700000000000004},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.129,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.67700000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2949999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.077}]},{"osd":1,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.67300000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2310000000000001,"5min":1.804,"15min":1.804},"last":1.052},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.72599999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1299999999999999,"5min":1.236,"15min":1.236},"last":1.179}]},{"osd":2,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.89600000000000002},"min":{"1min":0.71099999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1830000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.91100000000000003,"15min":0.90900000000000003},"min":{"1min":0.65000000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1739999999999999,"5min":1.403,"15min":1.403},"last":0.73699999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.298,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.238},{"interface":"front","average":{"1min":1.01,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.75800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3120000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.80700000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.96199999999999997,"15min":0.98099999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.234,"5min":1.502,"15min":1.502},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.115,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2210000000000001,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.1499999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.056,"15min":1.089},"min":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2470000000000001,"5min":1.401,"15min":1.401},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1890000000000001,"15min":1.216},"min":{"1min":0.89600000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.3500000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.286}]},{"osd":6,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1359999999999999,"15min":1.1599999999999999},"min":{"1min":0.82799999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.3049999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.202},{"interface":"front","average":{"1min":1.167,"5min":1.214,"15min":1.2370000000000001},"min":{"1min":0.97999999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.357,"5min":2.073,"15min":2.073},"last":1.3200000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97199999999999998,"15min":0.98099999999999998},"min":{"1min":0.77000000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2529999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.093},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.01,"15min":1.026},"min":{"1min":0.81100000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.1459999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.0229999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1279999999999999,"5min":1.47,"15min":1.47},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.996,"15min":1},"min":{"1min":0.66800000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.202,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.244}]},{"osd":2,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89100000000000001,"15min":0.877},"min":{"1min":0.64200000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.2649999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.92900000000000005,"15min":0.95499999999999996},"min":{"1min":0.66200000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.133,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.94599999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93500000000000005,"15min":0.96499999999999997},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1679999999999999,"5min":1.593,"15min":1.593},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.089,"15min":1.087},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.292,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91200000000000003,"15min":0.93600000000000005},"min":{"1min":0.59799999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1799999999999999,"5min":1.357,"15min":1.357},"last":1.325},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.016,"15min":1.048},"min":{"1min":0.67100000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.26,"5min":1.762,"15min":1.762},"last":1.278}]},{"osd":5,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":1.014,"15min":1.02},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1879999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.169,"15min":1.198},"min":{"1min":0.95599999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.3859999999999999,"5min":1.548,"15min":1.548},"last":1.3919999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.80500000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.25,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.21},{"interface":"front","average":{"1min":1.121,"5min":1.1879999999999999,"15min":1.208},"min":{"1min":0.88,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.48,"5min":1.796,"15min":1.796},"last":1.0629999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83599999999999997},"min":{"1min":0.621,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1930000000000001,"5min":1.371,"15min":1.371},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.86599999999999999,"15min":0.88200000000000001},"min":{"1min":0.61299999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.105,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.98899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.67100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.93300000000000005,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2509999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.099}]},{"osd":2,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.93899999999999995,"15min":0.94999999999999996},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.198,"5min":1.47,"15min":1.47},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.306,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.95099999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.96599999999999997},"min":{"1min":0.74099999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1379999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.04,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.86399999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3380000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0409999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.99199999999999999,"15min":1.0129999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.242,"5min":1.613,"15min":1.613},"last":1.268},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0900000000000001,"15min":1.1060000000000001},"min":{"1min":0.66500000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.276,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.3460000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.052,"15min":1.0660000000000001},"min":{"1min":0.71999999999999997,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3899999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.127,"5min":1.107,"15min":1.103},"min":{"1min":0.86299999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.377,"5min":1.589,"15min":1.589},"last":1.1990000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3580000000000001,"5min":2.016,"15min":2.016},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1759999999999999,"15min":1.1819999999999999},"min":{"1min":0.997,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.3999999999999999,"5min":1.625,"15min":1.625},"last":1.4019999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297924,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.52600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.73399999999999999,"15min":0.70399999999999996},"min":{"1min":0.59599999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.80000000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.55900000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1259999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.69999999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.73,"15min":1.73},"last":0.89800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.79800000000000004},"min":{"1min":0.63400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0569999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.876,"15min":0.871},"min":{"1min":0.67100000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.139,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.044}]},{"osd":4,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0600000000000001,"15min":1.056},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.099},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.089,"15min":1.0800000000000001},"min":{"1min":0.84999999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.613,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.214}]},{"osd":5,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1659999999999999,"15min":1.171},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.3640000000000001,"5min":1.599,"15min":1.599},"last":1.546},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1819999999999999,"15min":1.1879999999999999},"min":{"1min":0.89100000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.502,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.98299999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.236,"15min":1.2629999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.716,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.234,"15min":1.244},"min":{"1min":1,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.458,"5min":2.427,"15min":2.427},"last":1.4059999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":1.0640000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5760000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.25},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2749999999999999,"15min":1.2709999999999999},"min":{"1min":1.127,"5min":0.878,"15min":0.878},"max":{"1min":1.629,"5min":2.278,"15min":2.278},"last":1.504}]}]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297924,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.52800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2709999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79800000000000004,"15min":0.78400000000000003},"min":{"1min":0.60999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0760000000000001,"5min":1.974,"15min":1.974},"last":0.65000000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.60099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":1.016,"5min":1.423,"15min":1.423},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84499999999999997,"15min":0.84099999999999997},"min":{"1min":0.58699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1479999999999999,"5min":1.641,"15min":1.641},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.621,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.284,"5min":1.347,"15min":1.347},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95899999999999996,"15min":0.97099999999999997},"min":{"1min":0.74399999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1779999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.73099999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.087,"15min":1.091},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2569999999999999,"5min":2.113,"15min":2.113},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.056,"5min":1.0329999999999999,"15min":1.0409999999999999},"min":{"1min":0.84399999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3779999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.83999999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.163,"15min":1.1779999999999999},"min":{"1min":0.80800000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4279999999999999,"5min":2.613,"15min":2.613},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.157,"5min":1.206,"15min":1.216},"min":{"1min":0.92400000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.3320000000000001,"5min":2.298,"15min":2.298},"last":1.0760000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1319999999999999,"15min":1.141},"min":{"1min":0.84099999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4870000000000001,"5min":1.986,"15min":1.986},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.226,"15min":1.2390000000000001},"min":{"1min":0.89800000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.738,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2509999999999999,"15min":1.2549999999999999},"min":{"1min":0.91000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.46,"5min":2.516,"15min":2.516},"last":1.179},{"interface":"front","average":{"1min":1.27,"5min":1.2090000000000001,"15min":1.1990000000000001},"min":{"1min":1.046,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5669999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.2090000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298504,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073336,"statfs":{"total":96636764160,"available":96331096064,"internally_reserved":0,"allocated":1171456,"data_stored":834055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.502,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0900000000000001,"5min":1.925,"15min":1.925},"last":0.436},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.78000000000000003},"min":{"1min":0.56699999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.53800000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84699999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3440000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81499999999999995,"15min":0.81000000000000005},"min":{"1min":0.63900000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1160000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.68200000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0289999999999999,"5min":1.093,"15min":1.093},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2130000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.093,"15min":1.127},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4119999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.012,"15min":0.996},"min":{"1min":0.76400000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.872}]},{"osd":5,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.083,"15min":1.093},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4450000000000001,"5min":1.546,"15min":1.546},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.1779999999999999,"15min":1.2},"min":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.429,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.85099999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1539999999999999,"15min":1.1719999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.4470000000000001,"5min":1.869,"15min":1.869},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.238,"5min":1.2310000000000001,"15min":1.248},"min":{"1min":1.087,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.512,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.91600000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1379999999999999,"15min":1.1200000000000001},"min":{"1min":1.0169999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.403,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.242,"5min":1.252,"15min":1.258},"min":{"1min":0.96799999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.542,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.82399999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297928,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.621},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.76100000000000001},"min":{"1min":0.59499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.46300000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1279999999999999,"5min":1.304,"15min":1.304},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79400000000000004,"15min":0.77400000000000002},"min":{"1min":0.59899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.1479999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.53600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.002,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91900000000000004,"15min":0.90700000000000003},"min":{"1min":0.68799999999999994,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.242,"5min":1.617,"15min":1.617},"last":1.077}]},{"osd":4,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0569999999999999,"15min":1.0580000000000001},"min":{"1min":0.80100000000000005,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0860000000000001,"15min":1.103},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.357,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0600000000000001,"15min":1.0620000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.2969999999999999,"5min":1.53,"15min":1.53},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.115,"5min":1.177,"15min":1.1830000000000001},"min":{"1min":0.81499999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5029999999999999,"5min":2.226,"15min":2.226},"last":1.2410000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.92800000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4139999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.321},{"interface":"front","average":{"1min":1.228,"5min":1.1919999999999999,"15min":1.1719999999999999},"min":{"1min":0.98499999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.452,"5min":1.752,"15min":1.752},"last":1.212}]},{"osd":7,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.266,"15min":1.2569999999999999},"min":{"1min":1.0269999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.518,"5min":2.419,"15min":2.419},"last":1.278},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.222,"15min":1.2170000000000001},"min":{"1min":0.91600000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.478,"5min":2.274,"15min":2.274},"last":1.1699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302648,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069192,"statfs":{"total":96636764160,"available":96326852608,"internally_reserved":0,"allocated":1155072,"data_stored":828407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.72599999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.90800000000000003,"15min":0.91100000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1519999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.81599999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.88100000000000001,"15min":0.877},"min":{"1min":0.626,"5min":0.505,"15min":0.505},"max":{"1min":1.0649999999999999,"5min":1.268,"15min":1.268},"last":0.755},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.165,"5min":1.2,"15min":1.2},"last":0.71499999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89700000000000002,"15min":0.873},"min":{"1min":0.63200000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.2070000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95699999999999996,"15min":0.97899999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2070000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0369999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.94599999999999995,"15min":0.95199999999999996},"min":{"1min":0.74099999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.01},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.98699999999999999},"min":{"1min":0.81000000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.242,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.0649999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.64100000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.153,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0680000000000001,"15min":1.0720000000000001},"min":{"1min":0.76900000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.67200000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.173,"5min":2.141,"15min":2.141},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.1479999999999999,"15min":1.147},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.2989999999999999,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.141}]},{"osd":7,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.137,"15min":1.1539999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.3029999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.089},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.161,"15min":1.157},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.274,"5min":2.226,"15min":2.226},"last":1.2270000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:18.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.826+0000 7f0c68f86700 1 Processor -- start 2024-08-17T02:28:18.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c68f86700 1 -- start start 2024-08-17T02:28:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c68f86700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c64067dc0 0x7f0c641557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c68f86700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c64155d10 0x7f0c64156170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c68f86700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c64068390 con 0x7f0c64155400 2024-08-17T02:28:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c68f86700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c64156df0 con 0x7f0c64067dc0 2024-08-17T02:28:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c68f86700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c64068670 con 0x7f0c64155d10 2024-08-17T02:28:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c637fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0c64155400 0x7f0c640b22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50562/0 (socket says 172.21.15.31:50562) 2024-08-17T02:28:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c62ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c64067dc0 0x7f0c641557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c637fe700 1 -- 172.21.15.31:0/3264855422 learned_addr learned my addr 172.21.15.31:0/3264855422 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:18.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c63fff700 1 --2- 172.21.15.31:0/3264855422 >> v2:172.21.15.92:3300/0 conn(0x7f0c64155d10 0x7f0c64156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c627fc700 1 -- 172.21.15.31:0/3264855422 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113640403 0 0) 0x7f0c64068390 con 0x7f0c64155400 2024-08-17T02:28:18.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c627fc700 1 -- 172.21.15.31:0/3264855422 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c4c003570 con 0x7f0c64155400 2024-08-17T02:28:18.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c62ffd700 1 -- 172.21.15.31:0/3264855422 >> v2:172.21.15.92:3300/0 conn(0x7f0c64155d10 msgr2=0x7f0c64156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:18.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c62ffd700 1 --2- 172.21.15.31:0/3264855422 >> v2:172.21.15.92:3300/0 conn(0x7f0c64155d10 0x7f0c64156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c62ffd700 1 -- 172.21.15.31:0/3264855422 >> v1:172.21.15.31:6789/0 conn(0x7f0c64155400 legacy=0x7f0c640b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c62ffd700 1 -- 172.21.15.31:0/3264855422 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c64068950 con 0x7f0c64067dc0 2024-08-17T02:28:18.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.830+0000 7f0c62ffd700 1 --2- 172.21.15.31:0/3264855422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64067dc0 0x7f0c641557d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0c580098e0 tx=0x7f0c580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8445156015eaa0f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c627fc700 1 -- 172.21.15.31:0/3264855422 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58011630 con 0x7f0c64067dc0 2024-08-17T02:28:18.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c627fc700 1 -- 172.21.15.31:0/3264855422 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58011790 con 0x7f0c64067dc0 2024-08-17T02:28:18.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c627fc700 1 -- 172.21.15.31:0/3264855422 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58011b30 con 0x7f0c64067dc0 2024-08-17T02:28:18.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c68f86700 1 -- 172.21.15.31:0/3264855422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64067dc0 msgr2=0x7f0c641557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c68f86700 1 --2- 172.21.15.31:0/3264855422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64067dc0 0x7f0c641557d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0c580098e0 tx=0x7f0c580091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c68f86700 1 -- 172.21.15.31:0/3264855422 shutdown_connections 2024-08-17T02:28:18.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c68f86700 1 --2- 172.21.15.31:0/3264855422 >> v2:172.21.15.92:3300/0 conn(0x7f0c64155d10 0x7f0c64156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c68f86700 1 --2- 172.21.15.31:0/3264855422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64067dc0 0x7f0c641557d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c68f86700 1 -- 172.21.15.31:0/3264855422 >> 172.21.15.31:0/3264855422 conn(0x7f0c6406bbf0 msgr2=0x7f0c640b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c68f86700 1 -- 172.21.15.31:0/3264855422 shutdown_connections 2024-08-17T02:28:18.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.834+0000 7f0c68f86700 1 -- 172.21.15.31:0/3264855422 wait complete. 2024-08-17T02:28:18.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c68f86700 1 Processor -- start 2024-08-17T02:28:18.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c68f86700 1 -- start start 2024-08-17T02:28:18.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c68f86700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c64067dc0 0x7f0c64154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c68f86700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c64155400 0x7f0c64143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c68f86700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64155d10 0x7f0c64157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c68f86700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c640a9920 con 0x7f0c64155d10 2024-08-17T02:28:18.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c68f86700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c640a9c00 con 0x7f0c64155400 2024-08-17T02:28:18.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c68f86700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c640a9ee0 con 0x7f0c64067dc0 2024-08-17T02:28:18.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c63fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64155d10 0x7f0c64157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c63fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64155d10 0x7f0c64157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60984/0 (socket says 172.21.15.31:60984) 2024-08-17T02:28:18.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c63fff700 1 -- 172.21.15.31:0/81797410 learned_addr learned my addr 172.21.15.31:0/81797410 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:18.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c62ffd700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c64155400 0x7f0c64143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c637fe700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c64067dc0 0x7f0c64154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c63fff700 1 -- 172.21.15.31:0/81797410 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c64067dc0 msgr2=0x7f0c64154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c63fff700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c64067dc0 0x7f0c64154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c63fff700 1 -- 172.21.15.31:0/81797410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c64155400 msgr2=0x7f0c64143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c63fff700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c64155400 0x7f0c64143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c63fff700 1 -- 172.21.15.31:0/81797410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58009420 con 0x7f0c64155d10 2024-08-17T02:28:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c62ffd700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c64155400 0x7f0c64143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c637fe700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c64067dc0 0x7f0c64154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:18.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c63fff700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64155d10 0x7f0c64157240 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009df0 tx=0x7f0c5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c4b7fe700 1 -- 172.21.15.31:0/81797410 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00cb50 con 0x7f0c64155d10 2024-08-17T02:28:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c4b7fe700 1 -- 172.21.15.31:0/81797410 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c00f040 con 0x7f0c64155d10 2024-08-17T02:28:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c4b7fe700 1 -- 172.21.15.31:0/81797410 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c014480 con 0x7f0c64155d10 2024-08-17T02:28:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c68f86700 1 -- 172.21.15.31:0/81797410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c640aa1c0 con 0x7f0c64155d10 2024-08-17T02:28:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.838+0000 7f0c68f86700 1 -- 172.21.15.31:0/81797410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c64154770 con 0x7f0c64155d10 2024-08-17T02:28:18.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.842+0000 7f0c68f86700 1 -- 172.21.15.31:0/81797410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c640712b0 con 0x7f0c64155d10 2024-08-17T02:28:18.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.842+0000 7f0c4b7fe700 1 -- 172.21.15.31:0/81797410 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0c5c014830 con 0x7f0c64155d10 2024-08-17T02:28:18.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.842+0000 7f0c4b7fe700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0c50060860 0x7f0c50062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.842+0000 7f0c4b7fe700 1 -- 172.21.15.31:0/81797410 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0c5c07d2d0 con 0x7f0c64155d10 2024-08-17T02:28:18.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.842+0000 7f0c637fe700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0c50060860 0x7f0c50062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.842+0000 7f0c637fe700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0c50060860 0x7f0c50062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0c540058d0 tx=0x7f0c54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:18.850+0000 7f0c4b7fe700 1 -- 172.21.15.31:0/81797410 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0c5c04d9c0 con 0x7f0c64155d10 2024-08-17T02:28:19.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.018+0000 7f0c68f86700 1 -- 172.21.15.31:0/81797410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c6406f020 con 0x7f0c64155d10 2024-08-17T02:28:19.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c4b7fe700 1 -- 172.21.15.31:0/81797410 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+12343 (secure 0 0 0) 0x7f0c5c050fe0 con 0x7f0c64155d10 2024-08-17T02:28:19.028 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:19.028 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":49,"fsid":"bf850b64-aabe-4059-850b-2b80766a6162","created":"2024-08-17T02:24:21.323452+0000","modified":"2024-08-17T02:28:15.745629+0000","last_up_change":"2024-08-17T02:24:32.452092+0000","last_in_change":"2024-08-17T02:24:23.496675+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:24:33.649413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"42911858-f622-4393-a38f-5b041577bfe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":24160},{"type":"v1","addr":"172.21.15.31:6809","nonce":24160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":24160},{"type":"v1","addr":"172.21.15.31:6811","nonce":24160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":24160},{"type":"v1","addr":"172.21.15.31:6815","nonce":24160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":24160},{"type":"v1","addr":"172.21.15.31:6813","nonce":24160}]},"public_addr":"172.21.15.31:6809/24160","cluster_addr":"172.21.15.31:6811/24160","heartbeat_back_addr":"172.21.15.31:6815/24160","heartbeat_front_addr":"172.21.15.31:6813/24160","state":["exists","up"]},{"osd":1,"uuid":"18b45aee-644a-4087-bbe1-65f3c30dd3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":24158},{"type":"v1","addr":"172.21.15.31:6801","nonce":24158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":24158},{"type":"v1","addr":"172.21.15.31:6803","nonce":24158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":24158},{"type":"v1","addr":"172.21.15.31:6807","nonce":24158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":24158},{"type":"v1","addr":"172.21.15.31:6805","nonce":24158}]},"public_addr":"172.21.15.31:6801/24158","cluster_addr":"172.21.15.31:6803/24158","heartbeat_back_addr":"172.21.15.31:6807/24158","heartbeat_front_addr":"172.21.15.31:6805/24158","state":["exists","up"]},{"osd":2,"uuid":"72a14298-dab1-41c5-89da-8263cf8313ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":24169},{"type":"v1","addr":"172.21.15.31:6819","nonce":24169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":24169},{"type":"v1","addr":"172.21.15.31:6823","nonce":24169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6829","nonce":24169},{"type":"v1","addr":"172.21.15.31:6831","nonce":24169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6825","nonce":24169},{"type":"v1","addr":"172.21.15.31:6827","nonce":24169}]},"public_addr":"172.21.15.31:6819/24169","cluster_addr":"172.21.15.31:6823/24169","heartbeat_back_addr":"172.21.15.31:6831/24169","heartbeat_front_addr":"172.21.15.31:6827/24169","state":["exists","up"]},{"osd":3,"uuid":"be360a02-0abc-4a5f-8b78-6c1265e7558b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":24159},{"type":"v1","addr":"172.21.15.31:6818","nonce":24159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":24159},{"type":"v1","addr":"172.21.15.31:6822","nonce":24159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":24159},{"type":"v1","addr":"172.21.15.31:6830","nonce":24159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":24159},{"type":"v1","addr":"172.21.15.31:6826","nonce":24159}]},"public_addr":"172.21.15.31:6818/24159","cluster_addr":"172.21.15.31:6822/24159","heartbeat_back_addr":"172.21.15.31:6830/24159","heartbeat_front_addr":"172.21.15.31:6826/24159","state":["exists","up"]},{"osd":4,"uuid":"508e3194-87c9-4dab-9465-204d578375db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6809","nonce":24418},{"type":"v1","addr":"172.21.15.92:6811","nonce":24418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6813","nonce":24418},{"type":"v1","addr":"172.21.15.92:6815","nonce":24418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":24418},{"type":"v1","addr":"172.21.15.92:6823","nonce":24418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":24418},{"type":"v1","addr":"172.21.15.92:6819","nonce":24418}]},"public_addr":"172.21.15.92:6811/24418","cluster_addr":"172.21.15.92:6815/24418","heartbeat_back_addr":"172.21.15.92:6823/24418","heartbeat_front_addr":"172.21.15.92:6819/24418","state":["exists","up"]},{"osd":5,"uuid":"1196dde5-5b26-4c55-a5af-289e282ac05c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":24420},{"type":"v1","addr":"172.21.15.92:6801","nonce":24420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":24420},{"type":"v1","addr":"172.21.15.92:6803","nonce":24420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":24420},{"type":"v1","addr":"172.21.15.92:6807","nonce":24420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":24420},{"type":"v1","addr":"172.21.15.92:6805","nonce":24420}]},"public_addr":"172.21.15.92:6801/24420","cluster_addr":"172.21.15.92:6803/24420","heartbeat_back_addr":"172.21.15.92:6807/24420","heartbeat_front_addr":"172.21.15.92:6805/24420","state":["exists","up"]},{"osd":6,"uuid":"52a319f8-c77f-41aa-b301-e65cbf07e921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":24419},{"type":"v1","addr":"172.21.15.92:6810","nonce":24419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":24419},{"type":"v1","addr":"172.21.15.92:6814","nonce":24419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":24419},{"type":"v1","addr":"172.21.15.92:6822","nonce":24419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":24419},{"type":"v1","addr":"172.21.15.92:6818","nonce":24419}]},"public_addr":"172.21.15.92:6810/24419","cluster_addr":"172.21.15.92:6814/24419","heartbeat_back_addr":"172.21.15.92:6822/24419","heartbeat_front_addr":"172.21.15.92:6818/24419","state":["exists","up"]},{"osd":7,"uuid":"d68a56c4-97c2-43aa-9e56-6b71784a8266","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":24431},{"type":"v1","addr":"172.21.15.92:6825","nonce":24431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":24431},{"type":"v1","addr":"172.21.15.92:6827","nonce":24431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":24431},{"type":"v1","addr":"172.21.15.92:6831","nonce":24431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":24431},{"type":"v1","addr":"172.21.15.92:6829","nonce":24431}]},"public_addr":"172.21.15.92:6825/24431","cluster_addr":"172.21.15.92:6827/24431","heartbeat_back_addr":"172.21.15.92:6831/24431","heartbeat_front_addr":"172.21.15.92:6829/24431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.024518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.767769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.998800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.956204+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.953426+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.493656+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:28.945314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:29.104281+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6836/548139464":"2024-08-18T02:28:12.737076+0000","172.21.15.31:6834/548139464":"2024-08-18T02:28:12.737076+0000","172.21.15.31:6837/1886584780":"2024-08-18T02:28:06.459399+0000","172.21.15.31:6835/1886584780":"2024-08-18T02:28:06.459399+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c68f86700 1 -- 172.21.15.31:0/81797410 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0c50060860 msgr2=0x7f0c50062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c68f86700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0c50060860 0x7f0c50062d10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0c540058d0 tx=0x7f0c54009040 comp rx=0 tx=0).stop 2024-08-17T02:28:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c68f86700 1 -- 172.21.15.31:0/81797410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64155d10 msgr2=0x7f0c64157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c68f86700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64155d10 0x7f0c64157240 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009df0 tx=0x7f0c5c00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c68f86700 1 -- 172.21.15.31:0/81797410 shutdown_connections 2024-08-17T02:28:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c68f86700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0c50060860 0x7f0c50062d10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c68f86700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c64155d10 0x7f0c64157240 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c68f86700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c64155400 0x7f0c64143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c68f86700 1 --2- 172.21.15.31:0/81797410 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c64067dc0 0x7f0c64154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.022+0000 7f0c68f86700 1 -- 172.21.15.31:0/81797410 >> 172.21.15.31:0/81797410 conn(0x7f0c6406bbf0 msgr2=0x7f0c640b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.026+0000 7f0c68f86700 1 -- 172.21.15.31:0/81797410 shutdown_connections 2024-08-17T02:28:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:19.026+0000 7f0c68f86700 1 -- 172.21.15.31:0/81797410 wait complete. 2024-08-17T02:28:20.043 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:28:20.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:20.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.162+0000 7fb187fff700 1 Processor -- start 2024-08-17T02:28:20.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.162+0000 7fb187fff700 1 -- start start 2024-08-17T02:28:20.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb188068aa0 0x7fb188068e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb188159fd0 0x7fb1880af290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18815cc00 con 0x7fb1880cb010 2024-08-17T02:28:20.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb188150510 con 0x7fb188159fd0 2024-08-17T02:28:20.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1880cb430 con 0x7fb188068aa0 2024-08-17T02:28:20.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb1877fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb188159fd0 0x7fb1880af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb1877fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb188159fd0 0x7fb1880af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60986/0 (socket says 172.21.15.31:60986) 2024-08-17T02:28:20.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb1877fe700 1 -- 172.21.15.31:0/772620359 learned_addr learned my addr 172.21.15.31:0/772620359 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:20.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb186ffd700 1 --2- 172.21.15.31:0/772620359 >> v2:172.21.15.92:3300/0 conn(0x7fb188068aa0 0x7fb188068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb1877fe700 1 -- 172.21.15.31:0/772620359 >> v2:172.21.15.92:3300/0 conn(0x7fb188068aa0 msgr2=0x7fb188068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb1877fe700 1 --2- 172.21.15.31:0/772620359 >> v2:172.21.15.92:3300/0 conn(0x7fb188068aa0 0x7fb188068e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb1877fe700 1 -- 172.21.15.31:0/772620359 >> v1:172.21.15.92:6789/0 conn(0x7fb1880cb010 legacy=0x7fb1880aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb1877fe700 1 -- 172.21.15.31:0/772620359 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18815ce50 con 0x7fb188159fd0 2024-08-17T02:28:20.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb186ffd700 1 --2- 172.21.15.31:0/772620359 >> v2:172.21.15.92:3300/0 conn(0x7fb188068aa0 0x7fb188068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb1877fe700 1 --2- 172.21.15.31:0/772620359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb188159fd0 0x7fb1880af290 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb18806ae60 tx=0x7fb180009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0c5be8449e0c4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb185ffb700 1 -- 172.21.15.31:0/772620359 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18000e070 con 0x7fb188159fd0 2024-08-17T02:28:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb185ffb700 1 -- 172.21.15.31:0/772620359 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18000ba10 con 0x7fb188159fd0 2024-08-17T02:28:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb185ffb700 1 -- 172.21.15.31:0/772620359 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1800092e0 con 0x7fb188159fd0 2024-08-17T02:28:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 -- 172.21.15.31:0/772620359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb188159fd0 msgr2=0x7fb1880af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 --2- 172.21.15.31:0/772620359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb188159fd0 0x7fb1880af290 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb18806ae60 tx=0x7fb180009840 comp rx=0 tx=0).stop 2024-08-17T02:28:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 -- 172.21.15.31:0/772620359 shutdown_connections 2024-08-17T02:28:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 --2- 172.21.15.31:0/772620359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb188159fd0 0x7fb1880af290 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 --2- 172.21.15.31:0/772620359 >> v2:172.21.15.92:3300/0 conn(0x7fb188068aa0 0x7fb188068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 -- 172.21.15.31:0/772620359 >> 172.21.15.31:0/772620359 conn(0x7fb1880d0090 msgr2=0x7fb1880d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 -- 172.21.15.31:0/772620359 shutdown_connections 2024-08-17T02:28:20.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.166+0000 7fb187fff700 1 -- 172.21.15.31:0/772620359 wait complete. 2024-08-17T02:28:20.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb187fff700 1 Processor -- start 2024-08-17T02:28:20.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb187fff700 1 -- start start 2024-08-17T02:28:20.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb187fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb188068aa0 0x7fb188151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb187fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1880cb010 0x7fb188151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb187fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb188159fd0 0x7fb188150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb187fff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1880c9050 con 0x7fb1880cb010 2024-08-17T02:28:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb187fff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1880c9eb0 con 0x7fb188159fd0 2024-08-17T02:28:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb187fff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1880c92a0 con 0x7fb188068aa0 2024-08-17T02:28:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1867fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1880cb010 0x7fb188151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1867fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1880cb010 0x7fb188151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32770/0 (socket says 172.21.15.31:32770) 2024-08-17T02:28:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1867fc700 1 -- 172.21.15.31:0/3087916727 learned_addr learned my addr 172.21.15.31:0/3087916727 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1877fe700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb188159fd0 0x7fb188150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb186ffd700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb188068aa0 0x7fb188151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1867fc700 1 -- 172.21.15.31:0/3087916727 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb188068aa0 msgr2=0x7fb188151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1867fc700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb188068aa0 0x7fb188151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1867fc700 1 -- 172.21.15.31:0/3087916727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb188159fd0 msgr2=0x7fb188150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1867fc700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb188159fd0 0x7fb188150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1867fc700 1 -- 172.21.15.31:0/3087916727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb180009ae0 con 0x7fb1880cb010 2024-08-17T02:28:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1877fe700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb188159fd0 0x7fb188150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb1867fc700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1880cb010 0x7fb188151c60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb17800b610 tx=0x7fb178009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb17effd700 1 -- 172.21.15.31:0/3087916727 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17800f510 con 0x7fb1880cb010 2024-08-17T02:28:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1880c9580 con 0x7fb1880cb010 2024-08-17T02:28:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb17effd700 1 -- 172.21.15.31:0/3087916727 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17800f670 con 0x7fb1880cb010 2024-08-17T02:28:20.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb17effd700 1 -- 172.21.15.31:0/3087916727 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17800fa30 con 0x7fb1880cb010 2024-08-17T02:28:20.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.170+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1880c9b40 con 0x7fb1880cb010 2024-08-17T02:28:20.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb16c000fd0 con 0x7fb1880cb010 2024-08-17T02:28:20.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb17effd700 1 -- 172.21.15.31:0/3087916727 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fb17801a400 con 0x7fb1880cb010 2024-08-17T02:28:20.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb17effd700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb168060860 0x7fb168062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb17effd700 1 -- 172.21.15.31:0/3087916727 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb17807c590 con 0x7fb1880cb010 2024-08-17T02:28:20.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb17effd700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] conn(0x7fb168066750 0x7fb168068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb17effd700 1 -- 172.21.15.31:0/3087916727 --> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb168069210 con 0x7fb168066750 2024-08-17T02:28:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb186ffd700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb168060860 0x7fb168062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb17effd700 1 -- 172.21.15.31:0/3087916727 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb17807eaf0 con 0x7fb1880cb010 2024-08-17T02:28:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb1877fe700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] conn(0x7fb168066750 0x7fb168068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb1877fe700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] conn(0x7fb168066750 0x7fb168068b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.174+0000 7fb186ffd700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb168060860 0x7fb168062d10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb170006fd0 tx=0x7fb170008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.178+0000 7fb17effd700 1 -- 172.21.15.31:0/3087916727 <== osd.0 v2:172.21.15.31:6808/24160 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb168069210 con 0x7fb168066750 2024-08-17T02:28:20.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.194+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 --> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb16c002d50 con 0x7fb168066750 2024-08-17T02:28:20.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.194+0000 7fb17effd700 1 -- 172.21.15.31:0/3087916727 <== osd.0 v2:172.21.15.31:6808/24160 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb16c002d50 con 0x7fb168066750 2024-08-17T02:28:20.202 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:28:20.202 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:20.203 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:28:20.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] conn(0x7fb168066750 msgr2=0x7fb168068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb187fff700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:6808/24160,v1:172.21.15.31:6809/24160] conn(0x7fb168066750 0x7fb168068b60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb168060860 msgr2=0x7fb168062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb187fff700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fb168060860 0x7fb168062d10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb170006fd0 tx=0x7fb170008040 comp rx=0 tx=0).stop 2024-08-17T02:28:20.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1880cb010 msgr2=0x7fb188151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb187fff700 1 --2- 172.21.15.31:0/3087916727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1880cb010 0x7fb188151c60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb17800b610 tx=0x7fb178009120 comp rx=0 tx=0).stop 2024-08-17T02:28:20.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb1877fe700 1 -- 172.21.15.31:0/3087916727 reap_dead start 2024-08-17T02:28:20.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 shutdown_connections 2024-08-17T02:28:20.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 >> 172.21.15.31:0/3087916727 conn(0x7fb1880d0090 msgr2=0x7fb18815a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 shutdown_connections 2024-08-17T02:28:20.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.198+0000 7fb187fff700 1 -- 172.21.15.31:0/3087916727 wait complete. 2024-08-17T02:28:20.217 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:28:20.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73dffff700 1 Processor -- start 2024-08-17T02:28:20.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73dffff700 1 -- start start 2024-08-17T02:28:20.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73dffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0140370 0x7f73e00af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73dffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f73e0069690 0x7f73e015efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73dffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e00b1b20 con 0x7f73e0140740 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73dffff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00b0c70 con 0x7f73e0069690 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73dffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e00b0f10 con 0x7f73e0140370 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73d67fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f73e0140740 0x7f73e0068f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50574/0 (socket says 172.21.15.31:50574) 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73d67fc700 1 -- 172.21.15.31:0/2894316579 learned_addr learned my addr 172.21.15.31:0/2894316579 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73deffd700 1 --2- 172.21.15.31:0/2894316579 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0140370 0x7f73e00af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73df7fe700 1 --2- 172.21.15.31:0/2894316579 >> v2:172.21.15.92:3300/0 conn(0x7f73e0069690 0x7f73e015efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73de7fc700 1 -- 172.21.15.31:0/2894316579 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763361564 0 0) 0x7f73e00b1b20 con 0x7f73e0140740 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73de7fc700 1 -- 172.21.15.31:0/2894316579 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73cc003570 con 0x7f73e0140740 2024-08-17T02:28:20.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73de7fc700 1 -- 172.21.15.31:0/2894316579 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2784134444 0 0) 0x7f73cc003570 con 0x7f73e0140740 2024-08-17T02:28:20.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73deffd700 1 -- 172.21.15.31:0/2894316579 >> v2:172.21.15.92:3300/0 conn(0x7f73e0069690 msgr2=0x7f73e015efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73deffd700 1 --2- 172.21.15.31:0/2894316579 >> v2:172.21.15.92:3300/0 conn(0x7f73e0069690 0x7f73e015efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73deffd700 1 -- 172.21.15.31:0/2894316579 >> v1:172.21.15.31:6789/0 conn(0x7f73e0140740 legacy=0x7f73e0068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73deffd700 1 -- 172.21.15.31:0/2894316579 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00b11f0 con 0x7f73e0140370 2024-08-17T02:28:20.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73deffd700 1 --2- 172.21.15.31:0/2894316579 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0140370 0x7f73e00af100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f73d00098e0 tx=0x7f73d00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f73ee402a6df419e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73de7fc700 1 -- 172.21.15.31:0/2894316579 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8001470 con 0x7f73e0140370 2024-08-17T02:28:20.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73de7fc700 1 -- 172.21.15.31:0/2894316579 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d0011420 con 0x7f73e0140370 2024-08-17T02:28:20.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.330+0000 7f73de7fc700 1 -- 172.21.15.31:0/2894316579 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d00117a0 con 0x7f73e0140370 2024-08-17T02:28:20.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 -- 172.21.15.31:0/2894316579 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0140370 msgr2=0x7f73e00af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 --2- 172.21.15.31:0/2894316579 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0140370 0x7f73e00af100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f73d00098e0 tx=0x7f73d00091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 -- 172.21.15.31:0/2894316579 shutdown_connections 2024-08-17T02:28:20.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 --2- 172.21.15.31:0/2894316579 >> v2:172.21.15.92:3300/0 conn(0x7f73e0069690 0x7f73e015efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 --2- 172.21.15.31:0/2894316579 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0140370 0x7f73e00af100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 -- 172.21.15.31:0/2894316579 >> 172.21.15.31:0/2894316579 conn(0x7f73e0067400 msgr2=0x7f73e00677d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 -- 172.21.15.31:0/2894316579 shutdown_connections 2024-08-17T02:28:20.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 -- 172.21.15.31:0/2894316579 wait complete. 2024-08-17T02:28:20.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 Processor -- start 2024-08-17T02:28:20.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 -- start start 2024-08-17T02:28:20.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0069690 0x7f73e013d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73e0140370 0x7f73e0157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0140740 0x7f73e0158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0158430 con 0x7f73e0140740 2024-08-17T02:28:20.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e013d6e0 con 0x7f73e0140370 2024-08-17T02:28:20.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.334+0000 7f73dffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e015ce00 con 0x7f73e0069690 2024-08-17T02:28:20.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73df7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0140740 0x7f73e0158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73df7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0140740 0x7f73e0158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32772/0 (socket says 172.21.15.31:32772) 2024-08-17T02:28:20.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73df7fe700 1 -- 172.21.15.31:0/278380079 learned_addr learned my addr 172.21.15.31:0/278380079 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:20.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73deffd700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0069690 0x7f73e013d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73d67fc700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73e0140370 0x7f73e0157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73df7fe700 1 -- 172.21.15.31:0/278380079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0069690 msgr2=0x7f73e013d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73df7fe700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0069690 0x7f73e013d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73df7fe700 1 -- 172.21.15.31:0/278380079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73e0140370 msgr2=0x7f73e0157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73df7fe700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73e0140370 0x7f73e0157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73df7fe700 1 -- 172.21.15.31:0/278380079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0009420 con 0x7f73e0140740 2024-08-17T02:28:20.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73df7fe700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0140740 0x7f73e0158e80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009ec0 tx=0x7f73d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73d77fe700 1 -- 172.21.15.31:0/278380079 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800cb70 con 0x7f73e0140740 2024-08-17T02:28:20.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73d77fe700 1 -- 172.21.15.31:0/278380079 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d800f040 con 0x7f73e0140740 2024-08-17T02:28:20.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73dffff700 1 -- 172.21.15.31:0/278380079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e015d0e0 con 0x7f73e0140740 2024-08-17T02:28:20.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73d77fe700 1 -- 172.21.15.31:0/278380079 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d8014480 con 0x7f73e0140740 2024-08-17T02:28:20.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73dffff700 1 -- 172.21.15.31:0/278380079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e0158960 con 0x7f73e0140740 2024-08-17T02:28:20.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.338+0000 7f73dffff700 1 -- 172.21.15.31:0/278380079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e00712b0 con 0x7f73e0140740 2024-08-17T02:28:20.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.342+0000 7f73d77fe700 1 -- 172.21.15.31:0/278380079 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f73d80147f0 con 0x7f73e0140740 2024-08-17T02:28:20.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.342+0000 7f73d77fe700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73c0060860 0x7f73c0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.342+0000 7f73deffd700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73c0060860 0x7f73c0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.342+0000 7f73d77fe700 1 -- 172.21.15.31:0/278380079 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f73d807d580 con 0x7f73e0140740 2024-08-17T02:28:20.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.342+0000 7f73deffd700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73c0060860 0x7f73c0062d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f73d00091e0 tx=0x7f73d0016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.350+0000 7f73d77fe700 1 -- 172.21.15.31:0/278380079 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f73d804dbd0 con 0x7f73e0140740 2024-08-17T02:28:20.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.514+0000 7f73dffff700 1 -- 172.21.15.31:0/278380079 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f73e013e8a0 con 0x7f73c0060860 2024-08-17T02:28:20.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.514+0000 7f73d77fe700 1 -- 172.21.15.31:0/278380079 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f73e013e8a0 con 0x7f73c0060860 2024-08-17T02:28:20.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 -- 172.21.15.31:0/278380079 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73c0060860 msgr2=0x7f73c0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73c0060860 0x7f73c0062d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f73d00091e0 tx=0x7f73d0016000 comp rx=0 tx=0).stop 2024-08-17T02:28:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 -- 172.21.15.31:0/278380079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0140740 msgr2=0x7f73e0158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0140740 0x7f73e0158e80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f73d8009ec0 tx=0x7f73d800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 -- 172.21.15.31:0/278380079 shutdown_connections 2024-08-17T02:28:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f73c0060860 0x7f73c0062d10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0140740 0x7f73e0158e80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73e0140370 0x7f73e0157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 --2- 172.21.15.31:0/278380079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f73e0069690 0x7f73e013d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 -- 172.21.15.31:0/278380079 >> 172.21.15.31:0/278380079 conn(0x7f73e0067400 msgr2=0x7f73e0154250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 -- 172.21.15.31:0/278380079 shutdown_connections 2024-08-17T02:28:20.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.518+0000 7f73dffff700 1 -- 172.21.15.31:0/278380079 wait complete. 2024-08-17T02:28:20.528 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:28:20.538 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:28:20.538 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:20.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.642+0000 7f9930f27700 1 Processor -- start 2024-08-17T02:28:20.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.642+0000 7f9930f27700 1 -- start start 2024-08-17T02:28:20.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f992c0b4340 0x7f992c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f992c159700 0x7f992c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992c0b2a60 con 0x7f992c159330 2024-08-17T02:28:20.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992c0b0fb0 con 0x7f992c159700 2024-08-17T02:28:20.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0b11b0 con 0x7f992c0b4340 2024-08-17T02:28:20.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f992c159700 0x7f992c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f992c159700 0x7f992c0b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32776/0 (socket says 172.21.15.31:32776) 2024-08-17T02:28:20.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992ad9d700 1 -- 172.21.15.31:0/3605647018 learned_addr learned my addr 172.21.15.31:0/3605647018 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:20.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9929d9b700 1 --2- 172.21.15.31:0/3605647018 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f992c0b4340 0x7f992c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992ad9d700 1 -- 172.21.15.31:0/3605647018 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f992c0b4340 msgr2=0x7f992c0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992ad9d700 1 --2- 172.21.15.31:0/3605647018 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f992c0b4340 0x7f992c0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992ad9d700 1 -- 172.21.15.31:0/3605647018 >> v1:172.21.15.92:6789/0 conn(0x7f992c159330 legacy=0x7f992c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992ad9d700 1 -- 172.21.15.31:0/3605647018 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c0b1490 con 0x7f992c159700 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9929d9b700 1 --2- 172.21.15.31:0/3605647018 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f992c0b4340 0x7f992c0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:20.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992ad9d700 1 --2- 172.21.15.31:0/3605647018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f992c159700 0x7f992c0b0a70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9924009f20 tx=0x7f9924009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ad77116612ba86 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992959a700 1 -- 172.21.15.31:0/3605647018 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400e070 con 0x7f992c159700 2024-08-17T02:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992959a700 1 -- 172.21.15.31:0/3605647018 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992400ba80 con 0x7f992c159700 2024-08-17T02:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f992959a700 1 -- 172.21.15.31:0/3605647018 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99240092e0 con 0x7f992c159700 2024-08-17T02:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 -- 172.21.15.31:0/3605647018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f992c159700 msgr2=0x7f992c0b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 --2- 172.21.15.31:0/3605647018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f992c159700 0x7f992c0b0a70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9924009f20 tx=0x7f9924009840 comp rx=0 tx=0).stop 2024-08-17T02:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 -- 172.21.15.31:0/3605647018 shutdown_connections 2024-08-17T02:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 --2- 172.21.15.31:0/3605647018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f992c159700 0x7f992c0b0a70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 --2- 172.21.15.31:0/3605647018 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f992c0b4340 0x7f992c0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 -- 172.21.15.31:0/3605647018 >> 172.21.15.31:0/3605647018 conn(0x7f992c099610 msgr2=0x7f992c067be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.646+0000 7f9930f27700 1 -- 172.21.15.31:0/3605647018 shutdown_connections 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.650+0000 7f9930f27700 1 -- 172.21.15.31:0/3605647018 wait complete. 2024-08-17T02:28:20.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.650+0000 7f9930f27700 1 Processor -- start 2024-08-17T02:28:20.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.650+0000 7f9930f27700 1 -- start start 2024-08-17T02:28:20.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.650+0000 7f9930f27700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c0b4340 0x7f992c09cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.650+0000 7f9930f27700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f992c159330 0x7f992c154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.650+0000 7f9930f27700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f992c159700 0x7f992c1464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.650+0000 7f9930f27700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c155120 con 0x7f992c159700 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.650+0000 7f9930f27700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c09c890 con 0x7f992c0b4340 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.650+0000 7f9930f27700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c15cc30 con 0x7f992c159330 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f992ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f992c159700 0x7f992c1464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f992ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f992c159700 0x7f992c1464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32788/0 (socket says 172.21.15.31:32788) 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f992ad9d700 1 -- 172.21.15.31:0/2153596195 learned_addr learned my addr 172.21.15.31:0/2153596195 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f9929d9b700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f992c159330 0x7f992c154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f992a59c700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c0b4340 0x7f992c09cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f992ad9d700 1 -- 172.21.15.31:0/2153596195 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f992c159330 msgr2=0x7f992c154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f992ad9d700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f992c159330 0x7f992c154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f992ad9d700 1 -- 172.21.15.31:0/2153596195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c0b4340 msgr2=0x7f992c09cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f992ad9d700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f992c0b4340 0x7f992c09cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f992ad9d700 1 -- 172.21.15.31:0/2153596195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924009ae0 con 0x7f992c159700 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f992ad9d700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f992c159700 0x7f992c1464a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f992400b6c0 tx=0x7f9924018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f991a7fc700 1 -- 172.21.15.31:0/2153596195 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99240032f0 con 0x7f992c159700 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f991a7fc700 1 -- 172.21.15.31:0/2153596195 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9924008e00 con 0x7f992c159700 2024-08-17T02:28:20.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c09c240 con 0x7f992c159700 2024-08-17T02:28:20.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f991a7fc700 1 -- 172.21.15.31:0/2153596195 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924026690 con 0x7f992c159700 2024-08-17T02:28:20.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c150c60 con 0x7f992c159700 2024-08-17T02:28:20.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.654+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f992c0712b0 con 0x7f992c159700 2024-08-17T02:28:20.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f991a7fc700 1 -- 172.21.15.31:0/2153596195 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f9924003040 con 0x7f992c159700 2024-08-17T02:28:20.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f991a7fc700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f990c060860 0x7f990c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f991a7fc700 1 -- 172.21.15.31:0/2153596195 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f992407ea40 con 0x7f992c159700 2024-08-17T02:28:20.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f992a59c700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f990c060860 0x7f990c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f991a7fc700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] conn(0x7f990c066750 0x7f990c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f991a7fc700 1 -- 172.21.15.31:0/2153596195 --> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f990c069210 con 0x7f990c066750 2024-08-17T02:28:20.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f991a7fc700 1 -- 172.21.15.31:0/2153596195 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f992407ee10 con 0x7f992c159700 2024-08-17T02:28:20.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f9929d9b700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] conn(0x7f990c066750 0x7f990c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f9929d9b700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] conn(0x7f990c066750 0x7f990c068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f992a59c700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f990c060860 0x7f990c062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f99200037c0 tx=0x7f9920009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.658+0000 7f991a7fc700 1 -- 172.21.15.31:0/2153596195 <== osd.1 v2:172.21.15.31:6800/24158 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f990c069210 con 0x7f990c066750 2024-08-17T02:28:20.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.678+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 --> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f992c0aae90 con 0x7f990c066750 2024-08-17T02:28:20.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.678+0000 7f991a7fc700 1 -- 172.21.15.31:0/2153596195 <== osd.1 v2:172.21.15.31:6800/24158 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f992c0aae90 con 0x7f990c066750 2024-08-17T02:28:20.686 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:28:20.687 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:20.687 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:28:20.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.678+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] conn(0x7f990c066750 msgr2=0x7f990c068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.678+0000 7f9930f27700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:6800/24158,v1:172.21.15.31:6801/24158] conn(0x7f990c066750 0x7f990c068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.678+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f990c060860 msgr2=0x7f990c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.678+0000 7f9930f27700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f990c060860 0x7f990c062d10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f99200037c0 tx=0x7f9920009040 comp rx=0 tx=0).stop 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.678+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f992c159700 msgr2=0x7f992c1464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.678+0000 7f9930f27700 1 --2- 172.21.15.31:0/2153596195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f992c159700 0x7f992c1464a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f992400b6c0 tx=0x7f9924018000 comp rx=0 tx=0).stop 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.682+0000 7f992ad9d700 1 -- 172.21.15.31:0/2153596195 reap_dead start 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.682+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 shutdown_connections 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.682+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 >> 172.21.15.31:0/2153596195 conn(0x7f992c099610 msgr2=0x7f992c15ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.682+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 shutdown_connections 2024-08-17T02:28:20.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.682+0000 7f9930f27700 1 -- 172.21.15.31:0/2153596195 wait complete. 2024-08-17T02:28:20.698 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:28:20.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ada43700 1 Processor -- start 2024-08-17T02:28:20.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ada43700 1 -- start start 2024-08-17T02:28:20.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ada43700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f21a80ca140 0x7f21a80cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ada43700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f21a8067e00 0x7f21a80b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ada43700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a8157d80 con 0x7f21a80ca510 2024-08-17T02:28:20.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ada43700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a80cbd80 con 0x7f21a8067e00 2024-08-17T02:28:20.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ada43700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a8157fe0 con 0x7f21a80ca140 2024-08-17T02:28:20.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ad242700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f21a8067e00 0x7f21a80b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ad242700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f21a8067e00 0x7f21a80b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32790/0 (socket says 172.21.15.31:32790) 2024-08-17T02:28:20.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ad242700 1 -- 172.21.15.31:0/3269899201 learned_addr learned my addr 172.21.15.31:0/3269899201 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:20.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21aca41700 1 --2- 172.21.15.31:0/3269899201 >> v2:172.21.15.92:3300/0 conn(0x7f21a80ca140 0x7f21a80cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ad242700 1 -- 172.21.15.31:0/3269899201 >> v2:172.21.15.92:3300/0 conn(0x7f21a80ca140 msgr2=0x7f21a80cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ad242700 1 --2- 172.21.15.31:0/3269899201 >> v2:172.21.15.92:3300/0 conn(0x7f21a80ca140 0x7f21a80cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ad242700 1 -- 172.21.15.31:0/3269899201 >> v1:172.21.15.92:6789/0 conn(0x7f21a80ca510 legacy=0x7f21a8157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ad242700 1 -- 172.21.15.31:0/3269899201 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a81582c0 con 0x7f21a8067e00 2024-08-17T02:28:20.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.806+0000 7f21ad242700 1 --2- 172.21.15.31:0/3269899201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 0x7f21a80b2250 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f21a8067d60 tx=0x7f21a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137b891a58de86cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21a77fe700 1 -- 172.21.15.31:0/3269899201 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0009e70 con 0x7f21a8067e00 2024-08-17T02:28:20.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21a77fe700 1 -- 172.21.15.31:0/3269899201 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a000b860 con 0x7f21a8067e00 2024-08-17T02:28:20.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21a77fe700 1 -- 172.21.15.31:0/3269899201 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a000bc00 con 0x7f21a8067e00 2024-08-17T02:28:20.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21ada43700 1 -- 172.21.15.31:0/3269899201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 msgr2=0x7f21a80b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21ada43700 1 --2- 172.21.15.31:0/3269899201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 0x7f21a80b2250 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f21a8067d60 tx=0x7f21a0009250 comp rx=0 tx=0).stop 2024-08-17T02:28:20.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21ada43700 1 -- 172.21.15.31:0/3269899201 shutdown_connections 2024-08-17T02:28:20.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21ada43700 1 --2- 172.21.15.31:0/3269899201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 0x7f21a80b2250 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21ada43700 1 --2- 172.21.15.31:0/3269899201 >> v2:172.21.15.92:3300/0 conn(0x7f21a80ca140 0x7f21a80cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21ada43700 1 -- 172.21.15.31:0/3269899201 >> 172.21.15.31:0/3269899201 conn(0x7f21a8063b30 msgr2=0x7f21a806b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21ada43700 1 -- 172.21.15.31:0/3269899201 shutdown_connections 2024-08-17T02:28:20.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.810+0000 7f21ada43700 1 -- 172.21.15.31:0/3269899201 wait complete. 2024-08-17T02:28:20.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ada43700 1 Processor -- start 2024-08-17T02:28:20.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ada43700 1 -- start start 2024-08-17T02:28:20.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ada43700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 0x7f21a813f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ada43700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21a80ca140 0x7f21a8151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ada43700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21a80ca510 0x7f21a8152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ada43700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a813fe10 con 0x7f21a8067e00 2024-08-17T02:28:20.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ada43700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a81534a0 con 0x7f21a80ca510 2024-08-17T02:28:20.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ada43700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a8152890 con 0x7f21a80ca140 2024-08-17T02:28:20.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21aca41700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 0x7f21a813f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21aca41700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 0x7f21a813f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50872/0 (socket says 172.21.15.31:50872) 2024-08-17T02:28:20.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21aca41700 1 -- 172.21.15.31:0/1682026839 learned_addr learned my addr 172.21.15.31:0/1682026839 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:20.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ad242700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21a80ca510 0x7f21a8152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21a7fff700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21a80ca140 0x7f21a8151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21aca41700 1 -- 172.21.15.31:0/1682026839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21a80ca140 msgr2=0x7f21a8151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21aca41700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21a80ca140 0x7f21a8151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21aca41700 1 -- 172.21.15.31:0/1682026839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21a80ca510 msgr2=0x7f21a8152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21aca41700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21a80ca510 0x7f21a8152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21aca41700 1 -- 172.21.15.31:0/1682026839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a00094f0 con 0x7f21a8067e00 2024-08-17T02:28:20.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21a7fff700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21a80ca140 0x7f21a8151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:20.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21aca41700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 0x7f21a813f8d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f219800ec80 tx=0x7f21980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21a4ff9700 1 -- 172.21.15.31:0/1682026839 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219800c9d0 con 0x7f21a8067e00 2024-08-17T02:28:20.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21a4ff9700 1 -- 172.21.15.31:0/1682026839 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219800cb30 con 0x7f21a8067e00 2024-08-17T02:28:20.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ada43700 1 -- 172.21.15.31:0/1682026839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a8152b70 con 0x7f21a8067e00 2024-08-17T02:28:20.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21a4ff9700 1 -- 172.21.15.31:0/1682026839 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198013470 con 0x7f21a8067e00 2024-08-17T02:28:20.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.814+0000 7f21ada43700 1 -- 172.21.15.31:0/1682026839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a8153130 con 0x7f21a8067e00 2024-08-17T02:28:20.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.818+0000 7f21ada43700 1 -- 172.21.15.31:0/1682026839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a80712b0 con 0x7f21a8067e00 2024-08-17T02:28:20.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.818+0000 7f21a4ff9700 1 -- 172.21.15.31:0/1682026839 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f21980137e0 con 0x7f21a8067e00 2024-08-17T02:28:20.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.818+0000 7f21a4ff9700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2188060860 0x7f2188062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.818+0000 7f21a4ff9700 1 -- 172.21.15.31:0/1682026839 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f219807cc40 con 0x7f21a8067e00 2024-08-17T02:28:20.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.818+0000 7f21a7fff700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2188060860 0x7f2188062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.818+0000 7f21a7fff700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2188060860 0x7f2188062d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2190007fd0 tx=0x7f2190009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.826+0000 7f21a4ff9700 1 -- 172.21.15.31:0/1682026839 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f219804d330 con 0x7f21a8067e00 2024-08-17T02:28:20.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.990+0000 7f21ada43700 1 -- 172.21.15.31:0/1682026839 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f21a806b810 con 0x7f2188060860 2024-08-17T02:28:20.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.990+0000 7f21a4ff9700 1 -- 172.21.15.31:0/1682026839 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f21a806b810 con 0x7f2188060860 2024-08-17T02:28:21.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 -- 172.21.15.31:0/1682026839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2188060860 msgr2=0x7f2188062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2188060860 0x7f2188062d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2190007fd0 tx=0x7f2190009040 comp rx=0 tx=0).stop 2024-08-17T02:28:21.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 -- 172.21.15.31:0/1682026839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 msgr2=0x7f21a813f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 0x7f21a813f8d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f219800ec80 tx=0x7f21980091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 -- 172.21.15.31:0/1682026839 shutdown_connections 2024-08-17T02:28:21.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2188060860 0x7f2188062d10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f21a80ca510 0x7f21a8152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f21a80ca140 0x7f21a8151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 --2- 172.21.15.31:0/1682026839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21a8067e00 0x7f21a813f8d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 -- 172.21.15.31:0/1682026839 >> 172.21.15.31:0/1682026839 conn(0x7f21a8063b30 msgr2=0x7f21a806e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 -- 172.21.15.31:0/1682026839 shutdown_connections 2024-08-17T02:28:21.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:20.994+0000 7f21ada43700 1 -- 172.21.15.31:0/1682026839 wait complete. 2024-08-17T02:28:21.004 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:28:21.016 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:28:21.017 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:21.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.122+0000 7ff30359e700 1 Processor -- start 2024-08-17T02:28:21.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.122+0000 7ff30359e700 1 -- start start 2024-08-17T02:28:21.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff304068aa0 0x7ff304068e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3040cb010 0x7ff304159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30415a510 con 0x7ff3040aeb80 2024-08-17T02:28:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff304150510 con 0x7ff3040cb010 2024-08-17T02:28:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30415cc00 con 0x7ff304068aa0 2024-08-17T02:28:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff301d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3040cb010 0x7ff304159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff301d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff3040cb010 0x7ff304159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50882/0 (socket says 172.21.15.31:50882) 2024-08-17T02:28:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff301d9b700 1 -- 172.21.15.31:0/3967779138 learned_addr learned my addr 172.21.15.31:0/3967779138 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30259c700 1 --2- 172.21.15.31:0/3967779138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff304068aa0 0x7ff304068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff301d9b700 1 -- 172.21.15.31:0/3967779138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff304068aa0 msgr2=0x7ff304068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff301d9b700 1 --2- 172.21.15.31:0/3967779138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff304068aa0 0x7ff304068e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff301d9b700 1 -- 172.21.15.31:0/3967779138 >> v1:172.21.15.92:6789/0 conn(0x7ff3040aeb80 legacy=0x7ff3040aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff301d9b700 1 -- 172.21.15.31:0/3967779138 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040cb400 con 0x7ff3040cb010 2024-08-17T02:28:21.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30259c700 1 --2- 172.21.15.31:0/3967779138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff304068aa0 0x7ff304068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:21.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff301d9b700 1 --2- 172.21.15.31:0/3967779138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040cb010 0x7ff304159fd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0099b0 tx=0x7ff2ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42d873f41610ace server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30159a700 1 -- 172.21.15.31:0/3967779138 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00b860 con 0x7ff3040cb010 2024-08-17T02:28:21.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30159a700 1 -- 172.21.15.31:0/3967779138 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec00b9c0 con 0x7ff3040cb010 2024-08-17T02:28:21.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30159a700 1 -- 172.21.15.31:0/3967779138 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00bd60 con 0x7ff3040cb010 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 -- 172.21.15.31:0/3967779138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040cb010 msgr2=0x7ff304159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 --2- 172.21.15.31:0/3967779138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040cb010 0x7ff304159fd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0099b0 tx=0x7ff2ec009250 comp rx=0 tx=0).stop 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 -- 172.21.15.31:0/3967779138 shutdown_connections 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 --2- 172.21.15.31:0/3967779138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040cb010 0x7ff304159fd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 --2- 172.21.15.31:0/3967779138 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff304068aa0 0x7ff304068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.126+0000 7ff30359e700 1 -- 172.21.15.31:0/3967779138 >> 172.21.15.31:0/3967779138 conn(0x7ff3040d0090 msgr2=0x7ff3040d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.130+0000 7ff30359e700 1 -- 172.21.15.31:0/3967779138 shutdown_connections 2024-08-17T02:28:21.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.130+0000 7ff30359e700 1 -- 172.21.15.31:0/3967779138 wait complete. 2024-08-17T02:28:21.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.130+0000 7ff30359e700 1 Processor -- start 2024-08-17T02:28:21.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.130+0000 7ff30359e700 1 -- start start 2024-08-17T02:28:21.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.130+0000 7ff30359e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff304068aa0 0x7ff304169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.130+0000 7ff30359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040aeb80 0x7ff30416a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.130+0000 7ff30359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3040cb010 0x7ff3040aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.130+0000 7ff30359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040b12b0 con 0x7ff3040aeb80 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.130+0000 7ff30359e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040b0980 con 0x7ff304068aa0 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.130+0000 7ff30359e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040b0c60 con 0x7ff3040cb010 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff301d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040aeb80 0x7ff30416a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff30259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff304068aa0 0x7ff304169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff301d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040aeb80 0x7ff30416a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50890/0 (socket says 172.21.15.31:50890) 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff301d9b700 1 -- 172.21.15.31:0/4031977982 learned_addr learned my addr 172.21.15.31:0/4031977982 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff302d9d700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3040cb010 0x7ff3040aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff301d9b700 1 -- 172.21.15.31:0/4031977982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3040cb010 msgr2=0x7ff3040aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff301d9b700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3040cb010 0x7ff3040aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff301d9b700 1 -- 172.21.15.31:0/4031977982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff304068aa0 msgr2=0x7ff304169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff301d9b700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff304068aa0 0x7ff304169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff301d9b700 1 -- 172.21.15.31:0/4031977982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec0094f0 con 0x7ff3040aeb80 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff302d9d700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3040cb010 0x7ff3040aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff301d9b700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040aeb80 0x7ff30416a290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009290 tx=0x7ff2ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff2fa7fc700 1 -- 172.21.15.31:0/4031977982 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec026480 con 0x7ff3040aeb80 2024-08-17T02:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff2fa7fc700 1 -- 172.21.15.31:0/4031977982 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec01f070 con 0x7ff3040aeb80 2024-08-17T02:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3040b0f40 con 0x7ff3040aeb80 2024-08-17T02:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff2fa7fc700 1 -- 172.21.15.31:0/4031977982 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec026830 con 0x7ff3040aeb80 2024-08-17T02:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3040ca350 con 0x7ff3040aeb80 2024-08-17T02:28:21.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.134+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3040712b0 con 0x7ff3040aeb80 2024-08-17T02:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff2fa7fc700 1 -- 172.21.15.31:0/4031977982 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff2ec026ba0 con 0x7ff3040aeb80 2024-08-17T02:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff2fa7fc700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff2e4060860 0x7ff2e4062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff2fa7fc700 1 -- 172.21.15.31:0/4031977982 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff2ec021070 con 0x7ff3040aeb80 2024-08-17T02:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff30259c700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff2e4060860 0x7ff2e4062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff2fa7fc700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] conn(0x7ff2e4066750 0x7ff2e4068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff2fa7fc700 1 -- 172.21.15.31:0/4031977982 --> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2e4069210 con 0x7ff2e4066750 2024-08-17T02:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff2fa7fc700 1 -- 172.21.15.31:0/4031977982 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2ec080a50 con 0x7ff3040aeb80 2024-08-17T02:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff302d9d700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] conn(0x7ff2e4066750 0x7ff2e4068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff30259c700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff2e4060860 0x7ff2e4062d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff30415b6e0 tx=0x7ff2f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff302d9d700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] conn(0x7ff2e4066750 0x7ff2e4068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.138+0000 7ff2fa7fc700 1 -- 172.21.15.31:0/4031977982 <== osd.2 v2:172.21.15.31:6816/24169 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff2e4069210 con 0x7ff2e4066750 2024-08-17T02:28:21.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 --> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff304066e50 con 0x7ff2e4066750 2024-08-17T02:28:21.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff2fa7fc700 1 -- 172.21.15.31:0/4031977982 <== osd.2 v2:172.21.15.31:6816/24169 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff304066e50 con 0x7ff2e4066750 2024-08-17T02:28:21.159 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:28:21.159 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:21.159 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:28:21.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] conn(0x7ff2e4066750 msgr2=0x7ff2e4068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:6816/24169,v1:172.21.15.31:6819/24169] conn(0x7ff2e4066750 0x7ff2e4068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff2e4060860 msgr2=0x7ff2e4062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff2e4060860 0x7ff2e4062d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff30415b6e0 tx=0x7ff2f4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:21.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040aeb80 msgr2=0x7ff30416a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 --2- 172.21.15.31:0/4031977982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3040aeb80 0x7ff30416a290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009290 tx=0x7ff2ec017000 comp rx=0 tx=0).stop 2024-08-17T02:28:21.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff302d9d700 1 -- 172.21.15.31:0/4031977982 reap_dead start 2024-08-17T02:28:21.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 shutdown_connections 2024-08-17T02:28:21.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 >> 172.21.15.31:0/4031977982 conn(0x7ff3040d0090 msgr2=0x7ff30414fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 shutdown_connections 2024-08-17T02:28:21.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.154+0000 7ff30359e700 1 -- 172.21.15.31:0/4031977982 wait complete. 2024-08-17T02:28:21.171 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:28:21.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 Processor -- start 2024-08-17T02:28:21.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 -- start start 2024-08-17T02:28:21.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff46415d530 0x7ff46406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff46406a6e0 0x7ff4640af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4640ad9f0 con 0x7ff4640ade80 2024-08-17T02:28:21.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640afc60 con 0x7ff46406a6e0 2024-08-17T02:28:21.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46406ab20 con 0x7ff46415d530 2024-08-17T02:28:21.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff469c52700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff4640ade80 0x7ff4640af010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49900/0 (socket says 172.21.15.31:49900) 2024-08-17T02:28:21.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff469c52700 1 -- 172.21.15.31:0/2959280989 learned_addr learned my addr 172.21.15.31:0/2959280989 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:21.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46ac54700 1 --2- 172.21.15.31:0/2959280989 >> v2:172.21.15.31:3300/0 conn(0x7ff46406a6e0 0x7ff4640af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46a453700 1 --2- 172.21.15.31:0/2959280989 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff46415d530 0x7ff46406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff469451700 1 -- 172.21.15.31:0/2959280989 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816489103 0 0) 0x7ff4640ad9f0 con 0x7ff4640ade80 2024-08-17T02:28:21.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff469451700 1 -- 172.21.15.31:0/2959280989 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff44c003570 con 0x7ff4640ade80 2024-08-17T02:28:21.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46ac54700 1 -- 172.21.15.31:0/2959280989 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff46415d530 msgr2=0x7ff46406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46ac54700 1 --2- 172.21.15.31:0/2959280989 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff46415d530 0x7ff46406a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46ac54700 1 -- 172.21.15.31:0/2959280989 >> v1:172.21.15.31:6789/0 conn(0x7ff4640ade80 legacy=0x7ff4640af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46ac54700 1 -- 172.21.15.31:0/2959280989 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640acde0 con 0x7ff46406a6e0 2024-08-17T02:28:21.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46ac54700 1 --2- 172.21.15.31:0/2959280989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 0x7ff4640af720 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0098e0 tx=0x7ff45c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f1740d943126ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff469451700 1 -- 172.21.15.31:0/2959280989 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c011630 con 0x7ff46406a6e0 2024-08-17T02:28:21.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff469451700 1 -- 172.21.15.31:0/2959280989 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c011790 con 0x7ff46406a6e0 2024-08-17T02:28:21.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff469451700 1 -- 172.21.15.31:0/2959280989 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c011b30 con 0x7ff46406a6e0 2024-08-17T02:28:21.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 -- 172.21.15.31:0/2959280989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 msgr2=0x7ff4640af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 --2- 172.21.15.31:0/2959280989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 0x7ff4640af720 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0098e0 tx=0x7ff45c0091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 -- 172.21.15.31:0/2959280989 shutdown_connections 2024-08-17T02:28:21.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 --2- 172.21.15.31:0/2959280989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 0x7ff4640af720 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 --2- 172.21.15.31:0/2959280989 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff46415d530 0x7ff46406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 -- 172.21.15.31:0/2959280989 >> 172.21.15.31:0/2959280989 conn(0x7ff4640cbe50 msgr2=0x7ff4640cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 -- 172.21.15.31:0/2959280989 shutdown_connections 2024-08-17T02:28:21.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.274+0000 7ff46c6b7700 1 -- 172.21.15.31:0/2959280989 wait complete. 2024-08-17T02:28:21.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46c6b7700 1 Processor -- start 2024-08-17T02:28:21.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46c6b7700 1 -- start start 2024-08-17T02:28:21.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46c6b7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 0x7ff464157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46c6b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4640ade80 0x7ff464145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46c6b7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff46415d530 0x7ff464153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46c6b7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4641620f0 con 0x7ff46406a6e0 2024-08-17T02:28:21.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46c6b7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4641583e0 con 0x7ff4640ade80 2024-08-17T02:28:21.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46c6b7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff464158920 con 0x7ff46415d530 2024-08-17T02:28:21.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46a453700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 0x7ff464157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46a453700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 0x7ff464157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50916/0 (socket says 172.21.15.31:50916) 2024-08-17T02:28:21.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46a453700 1 -- 172.21.15.31:0/3538561148 learned_addr learned my addr 172.21.15.31:0/3538561148 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:21.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff469c52700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4640ade80 0x7ff464145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46ac54700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff46415d530 0x7ff464153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46a453700 1 -- 172.21.15.31:0/3538561148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff46415d530 msgr2=0x7ff464153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46a453700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff46415d530 0x7ff464153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46a453700 1 -- 172.21.15.31:0/3538561148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4640ade80 msgr2=0x7ff464145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46a453700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4640ade80 0x7ff464145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46a453700 1 -- 172.21.15.31:0/3538561148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c009420 con 0x7ff46406a6e0 2024-08-17T02:28:21.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46a453700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 0x7ff464157ea0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff45800e930 tx=0x7ff4580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff4627fc700 1 -- 172.21.15.31:0/3538561148 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458013680 con 0x7ff46406a6e0 2024-08-17T02:28:21.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff4627fc700 1 -- 172.21.15.31:0/3538561148 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4580137e0 con 0x7ff46406a6e0 2024-08-17T02:28:21.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46c6b7700 1 -- 172.21.15.31:0/3538561148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff464158640 con 0x7ff46406a6e0 2024-08-17T02:28:21.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff4627fc700 1 -- 172.21.15.31:0/3538561148 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458013b80 con 0x7ff46406a6e0 2024-08-17T02:28:21.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.278+0000 7ff46c6b7700 1 -- 172.21.15.31:0/3538561148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff464161d80 con 0x7ff46406a6e0 2024-08-17T02:28:21.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.282+0000 7ff46c6b7700 1 -- 172.21.15.31:0/3538561148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4640712b0 con 0x7ff46406a6e0 2024-08-17T02:28:21.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.282+0000 7ff4627fc700 1 -- 172.21.15.31:0/3538561148 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7ff45800c460 con 0x7ff46406a6e0 2024-08-17T02:28:21.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.282+0000 7ff4627fc700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff450060860 0x7ff450062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.282+0000 7ff4627fc700 1 -- 172.21.15.31:0/3538561148 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff45807ca60 con 0x7ff46406a6e0 2024-08-17T02:28:21.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.282+0000 7ff469c52700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff450060860 0x7ff450062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.282+0000 7ff469c52700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff450060860 0x7ff450062d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff464163850 tx=0x7ff454009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.294+0000 7ff4627fc700 1 -- 172.21.15.31:0/3538561148 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7ff45804d150 con 0x7ff46406a6e0 2024-08-17T02:28:21.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.458+0000 7ff46c6b7700 1 -- 172.21.15.31:0/3538561148 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff464162230 con 0x7ff450060860 2024-08-17T02:28:21.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.458+0000 7ff4627fc700 1 -- 172.21.15.31:0/3538561148 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff45400fcd0 con 0x7ff450060860 2024-08-17T02:28:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 -- 172.21.15.31:0/3538561148 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff450060860 msgr2=0x7ff450062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff450060860 0x7ff450062d10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff464163850 tx=0x7ff454009040 comp rx=0 tx=0).stop 2024-08-17T02:28:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 -- 172.21.15.31:0/3538561148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 msgr2=0x7ff464157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 0x7ff464157ea0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff45800e930 tx=0x7ff4580091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 -- 172.21.15.31:0/3538561148 shutdown_connections 2024-08-17T02:28:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7ff450060860 0x7ff450062d10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff46415d530 0x7ff464153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4640ade80 0x7ff464145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 --2- 172.21.15.31:0/3538561148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46406a6e0 0x7ff464157ea0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 -- 172.21.15.31:0/3538561148 >> 172.21.15.31:0/3538561148 conn(0x7ff4640cbe50 msgr2=0x7ff46415a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 -- 172.21.15.31:0/3538561148 shutdown_connections 2024-08-17T02:28:21.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.462+0000 7ff46c6b7700 1 -- 172.21.15.31:0/3538561148 wait complete. 2024-08-17T02:28:21.471 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:28:21.481 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:28:21.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:21.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.590+0000 7f60dcbd4700 1 Processor -- start 2024-08-17T02:28:21.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.590+0000 7f60dcbd4700 1 -- start start 2024-08-17T02:28:21.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60d806a0f0 0x7f60d806a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f60d80b0f80 0x7f60d81557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f60d80cc3c0 0x7f60d8155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d80ab6e0 con 0x7f60d80b0f80 2024-08-17T02:28:21.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60d80abf80 con 0x7f60d80cc3c0 2024-08-17T02:28:21.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d8156250 con 0x7f60d806a0f0 2024-08-17T02:28:21.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d6ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f60d80b0f80 0x7f60d81557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d6ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f60d80b0f80 0x7f60d81557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50922/0 (socket says 172.21.15.31:50922) 2024-08-17T02:28:21.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d6ffd700 1 -- 172.21.15.31:0/881343233 learned_addr learned my addr 172.21.15.31:0/881343233 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:21.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d7fff700 1 --2- 172.21.15.31:0/881343233 >> v2:172.21.15.92:3300/0 conn(0x7f60d80cc3c0 0x7f60d8155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d77fe700 1 --2- 172.21.15.31:0/881343233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60d806a0f0 0x7f60d806a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d6ffd700 1 -- 172.21.15.31:0/881343233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60d806a0f0 msgr2=0x7f60d806a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d6ffd700 1 --2- 172.21.15.31:0/881343233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60d806a0f0 0x7f60d806a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d6ffd700 1 -- 172.21.15.31:0/881343233 >> v2:172.21.15.92:3300/0 conn(0x7f60d80cc3c0 msgr2=0x7f60d8155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d6ffd700 1 --2- 172.21.15.31:0/881343233 >> v2:172.21.15.92:3300/0 conn(0x7f60d80cc3c0 0x7f60d8155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d6ffd700 1 -- 172.21.15.31:0/881343233 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d815a7f0 con 0x7f60d80b0f80 2024-08-17T02:28:21.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d7fff700 1 --2- 172.21.15.31:0/881343233 >> v2:172.21.15.92:3300/0 conn(0x7f60d80cc3c0 0x7f60d8155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:21.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d6ffd700 1 --2- 172.21.15.31:0/881343233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d80b0f80 0x7f60d81557d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f60d80b17f0 tx=0x7f60c800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9121f4dc5669c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d67fc700 1 -- 172.21.15.31:0/881343233 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c800db40 con 0x7f60d80b0f80 2024-08-17T02:28:21.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d67fc700 1 -- 172.21.15.31:0/881343233 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c800dca0 con 0x7f60d80b0f80 2024-08-17T02:28:21.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60d67fc700 1 -- 172.21.15.31:0/881343233 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c80196b0 con 0x7f60d80b0f80 2024-08-17T02:28:21.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 -- 172.21.15.31:0/881343233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d80b0f80 msgr2=0x7f60d81557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 --2- 172.21.15.31:0/881343233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d80b0f80 0x7f60d81557d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f60d80b17f0 tx=0x7f60c800b4f0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 -- 172.21.15.31:0/881343233 shutdown_connections 2024-08-17T02:28:21.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 --2- 172.21.15.31:0/881343233 >> v2:172.21.15.92:3300/0 conn(0x7f60d80cc3c0 0x7f60d8155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 --2- 172.21.15.31:0/881343233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d80b0f80 0x7f60d81557d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 --2- 172.21.15.31:0/881343233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60d806a0f0 0x7f60d806a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 -- 172.21.15.31:0/881343233 >> 172.21.15.31:0/881343233 conn(0x7f60d8067e90 msgr2=0x7f60d80cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 -- 172.21.15.31:0/881343233 shutdown_connections 2024-08-17T02:28:21.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.594+0000 7f60dcbd4700 1 -- 172.21.15.31:0/881343233 wait complete. 2024-08-17T02:28:21.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 Processor -- start 2024-08-17T02:28:21.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 -- start start 2024-08-17T02:28:21.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d806a0f0 0x7f60d8150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d80b0f80 0x7f60d8169150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60d80cc3c0 0x7f60d8152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80c8840 con 0x7f60d806a0f0 2024-08-17T02:28:21.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80c8ae0 con 0x7f60d80b0f80 2024-08-17T02:28:21.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d80c8dc0 con 0x7f60d80cc3c0 2024-08-17T02:28:21.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d806a0f0 0x7f60d8150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d77fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d806a0f0 0x7f60d8150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50926/0 (socket says 172.21.15.31:50926) 2024-08-17T02:28:21.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d77fe700 1 -- 172.21.15.31:0/2103082323 learned_addr learned my addr 172.21.15.31:0/2103082323 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:21.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d6ffd700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d80b0f80 0x7f60d8169150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d7fff700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60d80cc3c0 0x7f60d8152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d77fe700 1 -- 172.21.15.31:0/2103082323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60d80cc3c0 msgr2=0x7f60d8152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d77fe700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60d80cc3c0 0x7f60d8152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d77fe700 1 -- 172.21.15.31:0/2103082323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d80b0f80 msgr2=0x7f60d8169150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d77fe700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d80b0f80 0x7f60d8169150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d77fe700 1 -- 172.21.15.31:0/2103082323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d0009a20 con 0x7f60d806a0f0 2024-08-17T02:28:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60d77fe700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d806a0f0 0x7f60d8150ad0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f60c000ec80 tx=0x7f60c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60cf7fe700 1 -- 172.21.15.31:0/2103082323 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c000c8e0 con 0x7f60d806a0f0 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60cf7fe700 1 -- 172.21.15.31:0/2103082323 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c000ca40 con 0x7f60d806a0f0 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c800b790 con 0x7f60d806a0f0 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60cf7fe700 1 -- 172.21.15.31:0/2103082323 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c000cde0 con 0x7f60d806a0f0 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60d816d650 con 0x7f60d806a0f0 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.598+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60d80712b0 con 0x7f60d806a0f0 2024-08-17T02:28:21.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.602+0000 7f60cf7fe700 1 -- 172.21.15.31:0/2103082323 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f60c0013680 con 0x7f60d806a0f0 2024-08-17T02:28:21.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.602+0000 7f60cf7fe700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f60b8060890 0x7f60b8062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.602+0000 7f60cf7fe700 1 -- 172.21.15.31:0/2103082323 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f60c007cf40 con 0x7f60d806a0f0 2024-08-17T02:28:21.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.602+0000 7f60d6ffd700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f60b8060890 0x7f60b8062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.602+0000 7f60cf7fe700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] conn(0x7f60b8066780 0x7f60b8068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.602+0000 7f60cf7fe700 1 -- 172.21.15.31:0/2103082323 --> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60b8069240 con 0x7f60b8066780 2024-08-17T02:28:21.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.602+0000 7f60cf7fe700 1 -- 172.21.15.31:0/2103082323 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60c007d310 con 0x7f60d806a0f0 2024-08-17T02:28:21.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.602+0000 7f60d7fff700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] conn(0x7f60b8066780 0x7f60b8068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.602+0000 7f60d6ffd700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f60b8060890 0x7f60b8062d40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f60d80b13d0 tx=0x7f60c801b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.602+0000 7f60d7fff700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] conn(0x7f60b8066780 0x7f60b8068b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.606+0000 7f60cf7fe700 1 -- 172.21.15.31:0/2103082323 <== osd.3 v2:172.21.15.31:6817/24159 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f60b8069240 con 0x7f60b8066780 2024-08-17T02:28:21.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 --> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60d806f3c0 con 0x7f60b8066780 2024-08-17T02:28:21.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60cf7fe700 1 -- 172.21.15.31:0/2103082323 <== osd.3 v2:172.21.15.31:6817/24159 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f60d806f3c0 con 0x7f60b8066780 2024-08-17T02:28:21.628 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:28:21.628 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:21.628 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:28:21.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] conn(0x7f60b8066780 msgr2=0x7f60b8068b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:6817/24159,v1:172.21.15.31:6818/24159] conn(0x7f60b8066780 0x7f60b8068b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f60b8060890 msgr2=0x7f60b8062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f60b8060890 0x7f60b8062d40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f60d80b13d0 tx=0x7f60c801b000 comp rx=0 tx=0).stop 2024-08-17T02:28:21.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d806a0f0 msgr2=0x7f60d8150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 --2- 172.21.15.31:0/2103082323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d806a0f0 0x7f60d8150ad0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f60c000ec80 tx=0x7f60c00091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60d7fff700 1 -- 172.21.15.31:0/2103082323 reap_dead start 2024-08-17T02:28:21.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 shutdown_connections 2024-08-17T02:28:21.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 >> 172.21.15.31:0/2103082323 conn(0x7f60d8067e90 msgr2=0x7f60d80aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 shutdown_connections 2024-08-17T02:28:21.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.622+0000 7f60dcbd4700 1 -- 172.21.15.31:0/2103082323 wait complete. 2024-08-17T02:28:21.641 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:28:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.742+0000 7fe182942700 1 Processor -- start 2024-08-17T02:28:21.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.742+0000 7fe182942700 1 -- start start 2024-08-17T02:28:21.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe17c157990 0x7fe17c0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c0af410 0x7fe17c0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c06e5d0 con 0x7fe17c1561d0 2024-08-17T02:28:21.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c06f250 con 0x7fe17c157990 2024-08-17T02:28:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c06e8b0 con 0x7fe17c0af410 2024-08-17T02:28:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe1737fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe17c157990 0x7fe17c0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe1737fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe17c157990 0x7fe17c0b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50932/0 (socket says 172.21.15.31:50932) 2024-08-17T02:28:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe1737fe700 1 -- 172.21.15.31:0/2201091027 learned_addr learned my addr 172.21.15.31:0/2201091027 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe180edf700 1 --2- 172.21.15.31:0/2201091027 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c0af410 0x7fe17c0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe1737fe700 1 -- 172.21.15.31:0/2201091027 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c0af410 msgr2=0x7fe17c0b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe1737fe700 1 --2- 172.21.15.31:0/2201091027 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c0af410 0x7fe17c0b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe1737fe700 1 -- 172.21.15.31:0/2201091027 >> v1:172.21.15.92:6789/0 conn(0x7fe17c1561d0 legacy=0x7fe17c1571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe1737fe700 1 -- 172.21.15.31:0/2201091027 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c06eb90 con 0x7fe17c157990 2024-08-17T02:28:21.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe1737fe700 1 --2- 172.21.15.31:0/2201091027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c157990 0x7fe17c0b1570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe1640099b0 tx=0x7fe164009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86cfba6f449ed3a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe17b7fe700 1 -- 172.21.15.31:0/2201091027 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400b860 con 0x7fe17c157990 2024-08-17T02:28:21.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe17b7fe700 1 -- 172.21.15.31:0/2201091027 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16400b9c0 con 0x7fe17c157990 2024-08-17T02:28:21.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe17b7fe700 1 -- 172.21.15.31:0/2201091027 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400bd60 con 0x7fe17c157990 2024-08-17T02:28:21.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 -- 172.21.15.31:0/2201091027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c157990 msgr2=0x7fe17c0b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 --2- 172.21.15.31:0/2201091027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c157990 0x7fe17c0b1570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe1640099b0 tx=0x7fe164009250 comp rx=0 tx=0).stop 2024-08-17T02:28:21.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 -- 172.21.15.31:0/2201091027 shutdown_connections 2024-08-17T02:28:21.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 --2- 172.21.15.31:0/2201091027 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c0af410 0x7fe17c0b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 --2- 172.21.15.31:0/2201091027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c157990 0x7fe17c0b1570 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 -- 172.21.15.31:0/2201091027 >> 172.21.15.31:0/2201091027 conn(0x7fe17c06bbb0 msgr2=0x7fe17c0aec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 -- 172.21.15.31:0/2201091027 shutdown_connections 2024-08-17T02:28:21.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.746+0000 7fe182942700 1 -- 172.21.15.31:0/2201091027 wait complete. 2024-08-17T02:28:21.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe182942700 1 Processor -- start 2024-08-17T02:28:21.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe182942700 1 -- start start 2024-08-17T02:28:21.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe182942700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c0af410 0x7fe17c0c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe182942700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17c1561d0 0x7fe17c0cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe182942700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c157990 0x7fe17c0ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe182942700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1405e0 con 0x7fe17c0af410 2024-08-17T02:28:21.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe182942700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0c2ef0 con 0x7fe17c1561d0 2024-08-17T02:28:21.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe182942700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0c87e0 con 0x7fe17c157990 2024-08-17T02:28:21.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe17bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c0af410 0x7fe17c0c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe17bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c0af410 0x7fe17c0c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50948/0 (socket says 172.21.15.31:50948) 2024-08-17T02:28:21.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe17bfff700 1 -- 172.21.15.31:0/3770972298 learned_addr learned my addr 172.21.15.31:0/3770972298 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:21.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe1737fe700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17c1561d0 0x7fe17c0cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.750+0000 7fe180edf700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c157990 0x7fe17c0ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe17bfff700 1 -- 172.21.15.31:0/3770972298 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c157990 msgr2=0x7fe17c0ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe17bfff700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c157990 0x7fe17c0ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe17bfff700 1 -- 172.21.15.31:0/3770972298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17c1561d0 msgr2=0x7fe17c0cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe17bfff700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17c1561d0 0x7fe17c0cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe17bfff700 1 -- 172.21.15.31:0/3770972298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1640094f0 con 0x7fe17c0af410 2024-08-17T02:28:21.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe1737fe700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17c1561d0 0x7fe17c0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:21.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe180edf700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c157990 0x7fe17c0ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:21.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe17bfff700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c0af410 0x7fe17c0c29b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00c4e0 tx=0x7fe16c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe178ff9700 1 -- 172.21.15.31:0/3770972298 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c011590 con 0x7fe17c0af410 2024-08-17T02:28:21.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe178ff9700 1 -- 172.21.15.31:0/3770972298 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c011710 con 0x7fe17c0af410 2024-08-17T02:28:21.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe182942700 1 -- 172.21.15.31:0/3770972298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c140be0 con 0x7fe17c0af410 2024-08-17T02:28:21.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe178ff9700 1 -- 172.21.15.31:0/3770972298 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c011ad0 con 0x7fe17c0af410 2024-08-17T02:28:21.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe182942700 1 -- 172.21.15.31:0/3770972298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c1411a0 con 0x7fe17c0af410 2024-08-17T02:28:21.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe182942700 1 -- 172.21.15.31:0/3770972298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c0712b0 con 0x7fe17c0af410 2024-08-17T02:28:21.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe178ff9700 1 -- 172.21.15.31:0/3770972298 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe16c01b3b0 con 0x7fe17c0af410 2024-08-17T02:28:21.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe178ff9700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe15c060860 0x7fe15c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe178ff9700 1 -- 172.21.15.31:0/3770972298 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe16c07be60 con 0x7fe17c0af410 2024-08-17T02:28:21.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.754+0000 7fe1737fe700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe15c060860 0x7fe15c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.758+0000 7fe1737fe700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe15c060860 0x7fe15c062d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe1640099b0 tx=0x7fe164017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.766+0000 7fe178ff9700 1 -- 172.21.15.31:0/3770972298 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe16c04c550 con 0x7fe17c0af410 2024-08-17T02:28:21.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 -- 172.21.15.31:0/3770972298 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe17c069d00 con 0x7fe15c060860 2024-08-17T02:28:21.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe178ff9700 1 -- 172.21.15.31:0/3770972298 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe17c069d00 con 0x7fe15c060860 2024-08-17T02:28:21.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 -- 172.21.15.31:0/3770972298 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe15c060860 msgr2=0x7fe15c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe15c060860 0x7fe15c062d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe1640099b0 tx=0x7fe164017000 comp rx=0 tx=0).stop 2024-08-17T02:28:21.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 -- 172.21.15.31:0/3770972298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c0af410 msgr2=0x7fe17c0c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c0af410 0x7fe17c0c29b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00c4e0 tx=0x7fe16c00c8a0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 -- 172.21.15.31:0/3770972298 shutdown_connections 2024-08-17T02:28:21.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe15c060860 0x7fe15c062d10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe17c157990 0x7fe17c0ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe17c1561d0 0x7fe17c0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 --2- 172.21.15.31:0/3770972298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe17c0af410 0x7fe17c0c29b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 -- 172.21.15.31:0/3770972298 >> 172.21.15.31:0/3770972298 conn(0x7fe17c06bbb0 msgr2=0x7fe17c150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 -- 172.21.15.31:0/3770972298 shutdown_connections 2024-08-17T02:28:21.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:21.934+0000 7fe182942700 1 -- 172.21.15.31:0/3770972298 wait complete. 2024-08-17T02:28:21.943 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:28:21.953 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:28:21.954 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:22.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.058+0000 7f0e51c31700 1 Processor -- start 2024-08-17T02:28:22.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.058+0000 7f0e51c31700 1 -- start start 2024-08-17T02:28:22.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e4c1592f0 0x7f0e4c0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0e4c0cb6a0 0x7f0e4c0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c15a780 con 0x7f0e4c1596c0 2024-08-17T02:28:22.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c15ac10 con 0x7f0e4c1592f0 2024-08-17T02:28:22.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c159b70 con 0x7f0e4c0cb6a0 2024-08-17T02:28:22.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e50c2f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e4c1592f0 0x7f0e4c0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e50c2f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e4c1592f0 0x7f0e4c0cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50958/0 (socket says 172.21.15.31:50958) 2024-08-17T02:28:22.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e50c2f700 1 -- 172.21.15.31:0/3676854867 learned_addr learned my addr 172.21.15.31:0/3676854867 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:22.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e4bfff700 1 --2- 172.21.15.31:0/3676854867 >> v2:172.21.15.92:3300/0 conn(0x7f0e4c0cb6a0 0x7f0e4c0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e50c2f700 1 -- 172.21.15.31:0/3676854867 >> v2:172.21.15.92:3300/0 conn(0x7f0e4c0cb6a0 msgr2=0x7f0e4c0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e50c2f700 1 --2- 172.21.15.31:0/3676854867 >> v2:172.21.15.92:3300/0 conn(0x7f0e4c0cb6a0 0x7f0e4c0cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e50c2f700 1 -- 172.21.15.31:0/3676854867 >> v1:172.21.15.31:6789/0 conn(0x7f0e4c1596c0 legacy=0x7f0e4c068870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e50c2f700 1 -- 172.21.15.31:0/3676854867 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c159e50 con 0x7f0e4c1592f0 2024-08-17T02:28:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e4b7fe700 1 -- 172.21.15.31:0/3676854867 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839796849 0 0) 0x7f0e4c15a780 con 0x7f0e4c1596c0 2024-08-17T02:28:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e50c2f700 1 --2- 172.21.15.31:0/3676854867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e4c1592f0 0x7f0e4c0cb160 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0cd6d0 tx=0x7f0e40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad18d56dbe6ace6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e4b7fe700 1 -- 172.21.15.31:0/3676854867 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40009e70 con 0x7f0e4c1592f0 2024-08-17T02:28:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e4b7fe700 1 -- 172.21.15.31:0/3676854867 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4000b860 con 0x7f0e4c1592f0 2024-08-17T02:28:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e4b7fe700 1 -- 172.21.15.31:0/3676854867 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000bc00 con 0x7f0e4c1592f0 2024-08-17T02:28:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 -- 172.21.15.31:0/3676854867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e4c1592f0 msgr2=0x7f0e4c0cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 --2- 172.21.15.31:0/3676854867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e4c1592f0 0x7f0e4c0cb160 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0cd6d0 tx=0x7f0e40009250 comp rx=0 tx=0).stop 2024-08-17T02:28:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 -- 172.21.15.31:0/3676854867 shutdown_connections 2024-08-17T02:28:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 --2- 172.21.15.31:0/3676854867 >> v2:172.21.15.92:3300/0 conn(0x7f0e4c0cb6a0 0x7f0e4c0cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 --2- 172.21.15.31:0/3676854867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e4c1592f0 0x7f0e4c0cb160 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 -- 172.21.15.31:0/3676854867 >> 172.21.15.31:0/3676854867 conn(0x7f0e4c067400 msgr2=0x7f0e4c067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 -- 172.21.15.31:0/3676854867 shutdown_connections 2024-08-17T02:28:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.062+0000 7f0e51c31700 1 -- 172.21.15.31:0/3676854867 wait complete. 2024-08-17T02:28:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e51c31700 1 Processor -- start 2024-08-17T02:28:22.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e51c31700 1 -- start start 2024-08-17T02:28:22.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e51c31700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e4c1592f0 0x7f0e4c152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e51c31700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e4c1596c0 0x7f0e4c0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e51c31700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0e4c0b1070 0x7f0e4c1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e51c31700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0b14c0 con 0x7f0e4c1596c0 2024-08-17T02:28:22.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e51c31700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c153060 con 0x7f0e4c1592f0 2024-08-17T02:28:22.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e51c31700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0b2f10 con 0x7f0e4c0b1070 2024-08-17T02:28:22.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e4bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e4c1596c0 0x7f0e4c0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e4bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e4c1596c0 0x7f0e4c0b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50968/0 (socket says 172.21.15.31:50968) 2024-08-17T02:28:22.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e4bfff700 1 -- 172.21.15.31:0/2479643083 learned_addr learned my addr 172.21.15.31:0/2479643083 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:22.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e50c2f700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e4c1592f0 0x7f0e4c152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.066+0000 7f0e51430700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0e4c0b1070 0x7f0e4c1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e4bfff700 1 -- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0e4c0b1070 msgr2=0x7f0e4c1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e4bfff700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0e4c0b1070 0x7f0e4c1560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e4bfff700 1 -- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e4c1592f0 msgr2=0x7f0e4c152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e4bfff700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e4c1592f0 0x7f0e4c152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e4bfff700 1 -- 172.21.15.31:0/2479643083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400094f0 con 0x7f0e4c1596c0 2024-08-17T02:28:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e51430700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0e4c0b1070 0x7f0e4c1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:22.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e4bfff700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e4c1596c0 0x7f0e4c0b0b30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800ec80 tx=0x7f0e380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e48ff9700 1 -- 172.21.15.31:0/2479643083 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800c850 con 0x7f0e4c1596c0 2024-08-17T02:28:22.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e48ff9700 1 -- 172.21.15.31:0/2479643083 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3800c9b0 con 0x7f0e4c1596c0 2024-08-17T02:28:22.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c0b31f0 con 0x7f0e4c1596c0 2024-08-17T02:28:22.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e48ff9700 1 -- 172.21.15.31:0/2479643083 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800cd70 con 0x7f0e4c1596c0 2024-08-17T02:28:22.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c0b37b0 con 0x7f0e4c1596c0 2024-08-17T02:28:22.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e4c0712b0 con 0x7f0e4c1596c0 2024-08-17T02:28:22.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.070+0000 7f0e48ff9700 1 -- 172.21.15.31:0/2479643083 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0e38013680 con 0x7f0e4c1596c0 2024-08-17T02:28:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.074+0000 7f0e48ff9700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0e30060860 0x7f0e30062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.074+0000 7f0e50c2f700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0e30060860 0x7f0e30062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.074+0000 7f0e48ff9700 1 -- 172.21.15.31:0/2479643083 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0e3807cf10 con 0x7f0e4c1596c0 2024-08-17T02:28:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.074+0000 7f0e48ff9700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] conn(0x7f0e30066750 0x7f0e30068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.074+0000 7f0e48ff9700 1 -- 172.21.15.31:0/2479643083 --> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e30069210 con 0x7f0e30066750 2024-08-17T02:28:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.074+0000 7f0e48ff9700 1 -- 172.21.15.31:0/2479643083 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e3807f550 con 0x7f0e4c1596c0 2024-08-17T02:28:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.074+0000 7f0e50c2f700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0e30060860 0x7f0e30062d10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0cd6d0 tx=0x7f0e40017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.074+0000 7f0e51430700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] conn(0x7f0e30066750 0x7f0e30068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.074+0000 7f0e51430700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] conn(0x7f0e30066750 0x7f0e30068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.074+0000 7f0e48ff9700 1 -- 172.21.15.31:0/2479643083 <== osd.4 v2:172.21.15.92:6809/24418 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0e30069210 con 0x7f0e30066750 2024-08-17T02:28:22.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 --> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0e4c0cfe40 con 0x7f0e30066750 2024-08-17T02:28:22.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e48ff9700 1 -- 172.21.15.31:0/2479643083 <== osd.4 v2:172.21.15.92:6809/24418 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0e4c0cfe40 con 0x7f0e30066750 2024-08-17T02:28:22.101 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:28:22.101 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:22.101 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:28:22.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] conn(0x7f0e30066750 msgr2=0x7f0e30068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.92:6809/24418,v1:172.21.15.92:6811/24418] conn(0x7f0e30066750 0x7f0e30068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0e30060860 msgr2=0x7f0e30062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0e30060860 0x7f0e30062d10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0cd6d0 tx=0x7f0e40017000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e4c1596c0 msgr2=0x7f0e4c0b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 --2- 172.21.15.31:0/2479643083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e4c1596c0 0x7f0e4c0b0b30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800ec80 tx=0x7f0e380091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51430700 1 -- 172.21.15.31:0/2479643083 reap_dead start 2024-08-17T02:28:22.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 shutdown_connections 2024-08-17T02:28:22.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 >> 172.21.15.31:0/2479643083 conn(0x7f0e4c067400 msgr2=0x7f0e4c0c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 shutdown_connections 2024-08-17T02:28:22.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.094+0000 7f0e51c31700 1 -- 172.21.15.31:0/2479643083 wait complete. 2024-08-17T02:28:22.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:28:22.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d3261c700 1 Processor -- start 2024-08-17T02:28:22.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d3261c700 1 -- start start 2024-08-17T02:28:22.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d3261c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c15d530 0x7f0d2c06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d3261c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d2c0ade80 0x7f0d2c06a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d3261c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2c0ad9f0 con 0x7f0d2c0af010 2024-08-17T02:28:22.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d3261c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c0acde0 con 0x7f0d2c0ade80 2024-08-17T02:28:22.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d3261c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0ad0c0 con 0x7f0d2c15d530 2024-08-17T02:28:22.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d2bfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c15d530 0x7f0d2c06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d2b7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0d2c0ade80 0x7f0d2c06a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d30bb9700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0d2c0af010 0x7f0d2c0af450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:46862/0 (socket says 172.21.15.31:46862) 2024-08-17T02:28:22.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d2bfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c15d530 0x7f0d2c06a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.31:33384/0 (socket says 172.21.15.31:33384) 2024-08-17T02:28:22.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.222+0000 7f0d30bb9700 1 -- 172.21.15.31:0/3906837736 learned_addr learned my addr 172.21.15.31:0/3906837736 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d2b7fe700 1 -- 172.21.15.31:0/3906837736 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c15d530 msgr2=0x7f0d2c06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d2b7fe700 1 --2- 172.21.15.31:0/3906837736 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c15d530 0x7f0d2c06a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d2b7fe700 1 -- 172.21.15.31:0/3906837736 >> v1:172.21.15.92:6789/0 conn(0x7f0d2c0af010 legacy=0x7f0d2c0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d2b7fe700 1 -- 172.21.15.31:0/3906837736 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c0ad3a0 con 0x7f0d2c0ade80 2024-08-17T02:28:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d2b7fe700 1 --2- 172.21.15.31:0/3906837736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d2c0ade80 0x7f0d2c06a6e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009e60 tx=0x7f0d1c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aaf50130ca8942b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d2affd700 1 -- 172.21.15.31:0/3906837736 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00e070 con 0x7f0d2c0ade80 2024-08-17T02:28:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d2affd700 1 -- 172.21.15.31:0/3906837736 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c00bb60 con 0x7f0d2c0ade80 2024-08-17T02:28:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d2affd700 1 -- 172.21.15.31:0/3906837736 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c012430 con 0x7f0d2c0ade80 2024-08-17T02:28:22.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d3261c700 1 -- 172.21.15.31:0/3906837736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d2c0ade80 msgr2=0x7f0d2c06a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d3261c700 1 --2- 172.21.15.31:0/3906837736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d2c0ade80 0x7f0d2c06a6e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009e60 tx=0x7f0d1c009780 comp rx=0 tx=0).stop 2024-08-17T02:28:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d3261c700 1 -- 172.21.15.31:0/3906837736 shutdown_connections 2024-08-17T02:28:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d3261c700 1 --2- 172.21.15.31:0/3906837736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d2c0ade80 0x7f0d2c06a6e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d3261c700 1 --2- 172.21.15.31:0/3906837736 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c15d530 0x7f0d2c06a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d3261c700 1 -- 172.21.15.31:0/3906837736 >> 172.21.15.31:0/3906837736 conn(0x7f0d2c0cbe50 msgr2=0x7f0d2c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d3261c700 1 -- 172.21.15.31:0/3906837736 shutdown_connections 2024-08-17T02:28:22.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.226+0000 7f0d3261c700 1 -- 172.21.15.31:0/3906837736 wait complete. 2024-08-17T02:28:22.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d3261c700 1 Processor -- start 2024-08-17T02:28:22.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d3261c700 1 -- start start 2024-08-17T02:28:22.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d3261c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0ade80 0x7f0d2c153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d3261c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c0af010 0x7f0d2c16d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d3261c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d2c15d530 0x7f0d2c0ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d3261c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c1575e0 con 0x7f0d2c0ade80 2024-08-17T02:28:22.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d3261c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c157b60 con 0x7f0d2c15d530 2024-08-17T02:28:22.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d3261c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c0cb090 con 0x7f0d2c0af010 2024-08-17T02:28:22.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d2bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0ade80 0x7f0d2c153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d2b7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c0af010 0x7f0d2c16d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d2bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0ade80 0x7f0d2c153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50982/0 (socket says 172.21.15.31:50982) 2024-08-17T02:28:22.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d30bb9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d2c15d530 0x7f0d2c0ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d2bfff700 1 -- 172.21.15.31:0/540248641 learned_addr learned my addr 172.21.15.31:0/540248641 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:22.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d2bfff700 1 -- 172.21.15.31:0/540248641 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c0af010 msgr2=0x7f0d2c16d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d2bfff700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c0af010 0x7f0d2c16d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d2bfff700 1 -- 172.21.15.31:0/540248641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d2c15d530 msgr2=0x7f0d2c0ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d2bfff700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d2c15d530 0x7f0d2c0ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d2bfff700 1 -- 172.21.15.31:0/540248641 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c009a20 con 0x7f0d2c0ade80 2024-08-17T02:28:22.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d2bfff700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0ade80 0x7f0d2c153150 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400e930 tx=0x7f0d140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d23fff700 1 -- 172.21.15.31:0/540248641 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14013680 con 0x7f0d2c0ade80 2024-08-17T02:28:22.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d3261c700 1 -- 172.21.15.31:0/540248641 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c0cb370 con 0x7f0d2c0ade80 2024-08-17T02:28:22.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d23fff700 1 -- 172.21.15.31:0/540248641 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d140137e0 con 0x7f0d2c0ade80 2024-08-17T02:28:22.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d23fff700 1 -- 172.21.15.31:0/540248641 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14013b80 con 0x7f0d2c0ade80 2024-08-17T02:28:22.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.230+0000 7f0d3261c700 1 -- 172.21.15.31:0/540248641 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c06ee90 con 0x7f0d2c0ade80 2024-08-17T02:28:22.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.234+0000 7f0d3261c700 1 -- 172.21.15.31:0/540248641 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c0712b0 con 0x7f0d2c0ade80 2024-08-17T02:28:22.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.234+0000 7f0d23fff700 1 -- 172.21.15.31:0/540248641 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0d1400c3e0 con 0x7f0d2c0ade80 2024-08-17T02:28:22.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.234+0000 7f0d23fff700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0d0c060860 0x7f0d0c062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.234+0000 7f0d23fff700 1 -- 172.21.15.31:0/540248641 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0d1407caf0 con 0x7f0d2c0ade80 2024-08-17T02:28:22.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.234+0000 7f0d2b7fe700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0d0c060860 0x7f0d0c062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.238+0000 7f0d2b7fe700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0d0c060860 0x7f0d0c062d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0ae250 tx=0x7f0d1c019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.242+0000 7f0d23fff700 1 -- 172.21.15.31:0/540248641 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0d1404d140 con 0x7f0d2c0ade80 2024-08-17T02:28:22.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.406+0000 7f0d3261c700 1 -- 172.21.15.31:0/540248641 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d2c157ca0 con 0x7f0d0c060860 2024-08-17T02:28:22.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d23fff700 1 -- 172.21.15.31:0/540248641 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0d1c00be10 con 0x7f0d0c060860 2024-08-17T02:28:22.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 -- 172.21.15.31:0/540248641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0d0c060860 msgr2=0x7f0d0c062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0d0c060860 0x7f0d0c062d10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0ae250 tx=0x7f0d1c019000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 -- 172.21.15.31:0/540248641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0ade80 msgr2=0x7f0d2c153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0ade80 0x7f0d2c153150 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400e930 tx=0x7f0d140091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 -- 172.21.15.31:0/540248641 shutdown_connections 2024-08-17T02:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0d0c060860 0x7f0d0c062d10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d2c15d530 0x7f0d2c0ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d2c0af010 0x7f0d2c16d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 --2- 172.21.15.31:0/540248641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2c0ade80 0x7f0d2c153150 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 -- 172.21.15.31:0/540248641 >> 172.21.15.31:0/540248641 conn(0x7f0d2c0cbe50 msgr2=0x7f0d2c15b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 -- 172.21.15.31:0/540248641 shutdown_connections 2024-08-17T02:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.410+0000 7f0d3261c700 1 -- 172.21.15.31:0/540248641 wait complete. 2024-08-17T02:28:22.419 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:28:22.428 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:28:22.429 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:22.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.538+0000 7f2dfea5a700 1 Processor -- start 2024-08-17T02:28:22.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.538+0000 7f2dfea5a700 1 -- start start 2024-08-17T02:28:22.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2df81596c0 0x7f2df80cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df815a780 con 0x7f2df80cce80 2024-08-17T02:28:22.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df815ac10 con 0x7f2df81592f0 2024-08-17T02:28:22.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df80cb870 con 0x7f2df81596c0 2024-08-17T02:28:22.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfd257700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2df81596c0 0x7f2df80cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfd257700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2df81596c0 0x7f2df80cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50996/0 (socket says 172.21.15.31:50996) 2024-08-17T02:28:22.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfd257700 1 -- 172.21.15.31:0/441341599 learned_addr learned my addr 172.21.15.31:0/441341599 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:22.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfd257700 1 -- 172.21.15.31:0/441341599 >> v1:172.21.15.92:6789/0 conn(0x7f2df81592f0 legacy=0x7f2df80cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfd257700 1 -- 172.21.15.31:0/441341599 >> v1:172.21.15.31:6789/0 conn(0x7f2df80cce80 legacy=0x7f2df80ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfd257700 1 -- 172.21.15.31:0/441341599 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df8159b70 con 0x7f2df81596c0 2024-08-17T02:28:22.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfd257700 1 --2- 172.21.15.31:0/441341599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df81596c0 0x7f2df80cc940 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2de80099b0 tx=0x7f2de8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d927272fd2563c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfca56700 1 -- 172.21.15.31:0/441341599 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800b820 con 0x7f2df81596c0 2024-08-17T02:28:22.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfca56700 1 -- 172.21.15.31:0/441341599 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de800b980 con 0x7f2df81596c0 2024-08-17T02:28:22.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfca56700 1 -- 172.21.15.31:0/441341599 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800bd20 con 0x7f2df81596c0 2024-08-17T02:28:22.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 -- 172.21.15.31:0/441341599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df81596c0 msgr2=0x7f2df80cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 --2- 172.21.15.31:0/441341599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df81596c0 0x7f2df80cc940 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2de80099b0 tx=0x7f2de8009250 comp rx=0 tx=0).stop 2024-08-17T02:28:22.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 -- 172.21.15.31:0/441341599 shutdown_connections 2024-08-17T02:28:22.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 --2- 172.21.15.31:0/441341599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df81596c0 0x7f2df80cc940 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 -- 172.21.15.31:0/441341599 >> 172.21.15.31:0/441341599 conn(0x7f2df8067400 msgr2=0x7f2df8067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 -- 172.21.15.31:0/441341599 shutdown_connections 2024-08-17T02:28:22.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.542+0000 7f2dfea5a700 1 -- 172.21.15.31:0/441341599 wait complete. 2024-08-17T02:28:22.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfea5a700 1 Processor -- start 2024-08-17T02:28:22.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfea5a700 1 -- start start 2024-08-17T02:28:22.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfea5a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2df80cce80 0x7f2df80c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfea5a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df81592f0 0x7f2df8149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfea5a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2df81596c0 0x7f2df80cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfea5a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80c9390 con 0x7f2df81592f0 2024-08-17T02:28:22.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfea5a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df8157100 con 0x7f2df80cce80 2024-08-17T02:28:22.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfea5a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df81573e0 con 0x7f2df81596c0 2024-08-17T02:28:22.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfd257700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df81592f0 0x7f2df8149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfd257700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df81592f0 0x7f2df8149c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51002/0 (socket says 172.21.15.31:51002) 2024-08-17T02:28:22.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfd257700 1 -- 172.21.15.31:0/2700881512 learned_addr learned my addr 172.21.15.31:0/2700881512 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:22.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfda58700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2df80cce80 0x7f2df80c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfe259700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2df81596c0 0x7f2df80cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfd257700 1 -- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2df81596c0 msgr2=0x7f2df80cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfd257700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2df81596c0 0x7f2df80cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfd257700 1 -- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2df80cce80 msgr2=0x7f2df80c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfd257700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2df80cce80 0x7f2df80c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfd257700 1 -- 172.21.15.31:0/2700881512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80094f0 con 0x7f2df81592f0 2024-08-17T02:28:22.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfda58700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2df80cce80 0x7f2df80c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:22.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfe259700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2df81596c0 0x7f2df80cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:22.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfd257700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df81592f0 0x7f2df8149c70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c010 tx=0x7f2de8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dedffb700 1 -- 172.21.15.31:0/2700881512 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de8011e10 con 0x7f2df81592f0 2024-08-17T02:28:22.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dedffb700 1 -- 172.21.15.31:0/2700881512 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de8020070 con 0x7f2df81592f0 2024-08-17T02:28:22.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df81576c0 con 0x7f2df81592f0 2024-08-17T02:28:22.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dedffb700 1 -- 172.21.15.31:0/2700881512 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de801b6a0 con 0x7f2df81592f0 2024-08-17T02:28:22.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.546+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df80b37a0 con 0x7f2df81592f0 2024-08-17T02:28:22.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2df80712b0 con 0x7f2df81592f0 2024-08-17T02:28:22.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dedffb700 1 -- 172.21.15.31:0/2700881512 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2de8022030 con 0x7f2df81592f0 2024-08-17T02:28:22.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dedffb700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ddc060890 0x7f2ddc062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dedffb700 1 -- 172.21.15.31:0/2700881512 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2de807ee70 con 0x7f2df81592f0 2024-08-17T02:28:22.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dfda58700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ddc060890 0x7f2ddc062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dedffb700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] conn(0x7f2ddc066780 0x7f2ddc068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dedffb700 1 -- 172.21.15.31:0/2700881512 --> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ddc069240 con 0x7f2ddc066780 2024-08-17T02:28:22.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dedffb700 1 -- 172.21.15.31:0/2700881512 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2de807f240 con 0x7f2df81592f0 2024-08-17T02:28:22.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dfe259700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] conn(0x7f2ddc066780 0x7f2ddc068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dfda58700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ddc060890 0x7f2ddc062d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2df4002880 tx=0x7f2df4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.550+0000 7f2dfe259700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] conn(0x7f2ddc066780 0x7f2ddc068b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.554+0000 7f2dedffb700 1 -- 172.21.15.31:0/2700881512 <== osd.5 v2:172.21.15.92:6800/24420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2ddc069240 con 0x7f2ddc066780 2024-08-17T02:28:22.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 --> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2df80cfe40 con 0x7f2ddc066780 2024-08-17T02:28:22.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dedffb700 1 -- 172.21.15.31:0/2700881512 <== osd.5 v2:172.21.15.92:6800/24420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2df80cfe40 con 0x7f2ddc066780 2024-08-17T02:28:22.577 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:28:22.578 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:22.578 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:28:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] conn(0x7f2ddc066780 msgr2=0x7f2ddc068b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.92:6800/24420,v1:172.21.15.92:6801/24420] conn(0x7f2ddc066780 0x7f2ddc068b90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ddc060890 msgr2=0x7f2ddc062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f2ddc060890 0x7f2ddc062d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2df4002880 tx=0x7f2df4009040 comp rx=0 tx=0).stop 2024-08-17T02:28:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df81592f0 msgr2=0x7f2df8149c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 --2- 172.21.15.31:0/2700881512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2df81592f0 0x7f2df8149c70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c010 tx=0x7f2de8016000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfe259700 1 -- 172.21.15.31:0/2700881512 reap_dead start 2024-08-17T02:28:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 shutdown_connections 2024-08-17T02:28:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 >> 172.21.15.31:0/2700881512 conn(0x7f2df8067400 msgr2=0x7f2df80c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 shutdown_connections 2024-08-17T02:28:22.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.570+0000 7f2dfea5a700 1 -- 172.21.15.31:0/2700881512 wait complete. 2024-08-17T02:28:22.591 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:28:22.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.698+0000 7fe60ffff700 1 Processor -- start 2024-08-17T02:28:22.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.698+0000 7fe60ffff700 1 -- start start 2024-08-17T02:28:22.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe610156eb0 0x7fe6100cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6100aed40 0x7fe6100af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe610067400 0x7fe610067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6100af700 con 0x7fe6100aed40 2024-08-17T02:28:22.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6100cab20 con 0x7fe610156eb0 2024-08-17T02:28:22.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61006f920 con 0x7fe610067400 2024-08-17T02:28:22.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6100aed40 0x7fe6100af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6100aed40 0x7fe6100af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51012/0 (socket says 172.21.15.31:51012) 2024-08-17T02:28:22.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60e7fc700 1 -- 172.21.15.31:0/1306295240 learned_addr learned my addr 172.21.15.31:0/1306295240 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:22.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60effd700 1 --2- 172.21.15.31:0/1306295240 >> v2:172.21.15.92:3300/0 conn(0x7fe610156eb0 0x7fe6100cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60f7fe700 1 --2- 172.21.15.31:0/1306295240 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe610067400 0x7fe610067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60e7fc700 1 -- 172.21.15.31:0/1306295240 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe610067400 msgr2=0x7fe610067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60e7fc700 1 --2- 172.21.15.31:0/1306295240 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe610067400 0x7fe610067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60e7fc700 1 -- 172.21.15.31:0/1306295240 >> v2:172.21.15.92:3300/0 conn(0x7fe610156eb0 msgr2=0x7fe6100cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60e7fc700 1 --2- 172.21.15.31:0/1306295240 >> v2:172.21.15.92:3300/0 conn(0x7fe610156eb0 0x7fe6100cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60e7fc700 1 -- 172.21.15.31:0/1306295240 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6100cb680 con 0x7fe6100aed40 2024-08-17T02:28:22.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60e7fc700 1 --2- 172.21.15.31:0/1306295240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6100aed40 0x7fe6100af1c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe610069a70 tx=0x7fe600009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3e1a583b7153eb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60dffb700 1 -- 172.21.15.31:0/1306295240 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000b640 con 0x7fe6100aed40 2024-08-17T02:28:22.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60dffb700 1 -- 172.21.15.31:0/1306295240 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60000b7a0 con 0x7fe6100aed40 2024-08-17T02:28:22.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60dffb700 1 -- 172.21.15.31:0/1306295240 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000bb60 con 0x7fe6100aed40 2024-08-17T02:28:22.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 -- 172.21.15.31:0/1306295240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6100aed40 msgr2=0x7fe6100af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 --2- 172.21.15.31:0/1306295240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6100aed40 0x7fe6100af1c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe610069a70 tx=0x7fe600009250 comp rx=0 tx=0).stop 2024-08-17T02:28:22.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 -- 172.21.15.31:0/1306295240 shutdown_connections 2024-08-17T02:28:22.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 --2- 172.21.15.31:0/1306295240 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe610067400 0x7fe610067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 --2- 172.21.15.31:0/1306295240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6100aed40 0x7fe6100af1c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 --2- 172.21.15.31:0/1306295240 >> v2:172.21.15.92:3300/0 conn(0x7fe610156eb0 0x7fe6100cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 -- 172.21.15.31:0/1306295240 >> 172.21.15.31:0/1306295240 conn(0x7fe61006a050 msgr2=0x7fe61006a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 -- 172.21.15.31:0/1306295240 shutdown_connections 2024-08-17T02:28:22.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.702+0000 7fe60ffff700 1 -- 172.21.15.31:0/1306295240 wait complete. 2024-08-17T02:28:22.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60ffff700 1 Processor -- start 2024-08-17T02:28:22.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60ffff700 1 -- start start 2024-08-17T02:28:22.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe610067400 0x7fe610150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6100aed40 0x7fe610155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe610156eb0 0x7fe610156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe610150fc0 con 0x7fe610067400 2024-08-17T02:28:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60ffff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100ab110 con 0x7fe610156eb0 2024-08-17T02:28:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60ffff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100ab3f0 con 0x7fe6100aed40 2024-08-17T02:28:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe610067400 0x7fe610150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe610156eb0 0x7fe610156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe610067400 0x7fe610150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51024/0 (socket says 172.21.15.31:51024) 2024-08-17T02:28:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60effd700 1 -- 172.21.15.31:0/1419840723 learned_addr learned my addr 172.21.15.31:0/1419840723 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60e7fc700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6100aed40 0x7fe610155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60effd700 1 -- 172.21.15.31:0/1419840723 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6100aed40 msgr2=0x7fe610155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60effd700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6100aed40 0x7fe610155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60effd700 1 -- 172.21.15.31:0/1419840723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe610156eb0 msgr2=0x7fe610156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60effd700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe610156eb0 0x7fe610156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60effd700 1 -- 172.21.15.31:0/1419840723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000094f0 con 0x7fe610067400 2024-08-17T02:28:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60e7fc700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6100aed40 0x7fe610155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.706+0000 7fe60effd700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe610067400 0x7fe610150a80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800e930 tx=0x7fe5f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.710+0000 7fe606ffd700 1 -- 172.21.15.31:0/1419840723 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8013680 con 0x7fe610067400 2024-08-17T02:28:22.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.710+0000 7fe606ffd700 1 -- 172.21.15.31:0/1419840723 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80137e0 con 0x7fe610067400 2024-08-17T02:28:22.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.710+0000 7fe60ffff700 1 -- 172.21.15.31:0/1419840723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6100ab6d0 con 0x7fe610067400 2024-08-17T02:28:22.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.710+0000 7fe606ffd700 1 -- 172.21.15.31:0/1419840723 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8013b80 con 0x7fe610067400 2024-08-17T02:28:22.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.710+0000 7fe60ffff700 1 -- 172.21.15.31:0/1419840723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6100abc90 con 0x7fe610067400 2024-08-17T02:28:22.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.710+0000 7fe60ffff700 1 -- 172.21.15.31:0/1419840723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6100712b0 con 0x7fe610067400 2024-08-17T02:28:22.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.710+0000 7fe606ffd700 1 -- 172.21.15.31:0/1419840723 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7fe5f800c460 con 0x7fe610067400 2024-08-17T02:28:22.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.714+0000 7fe606ffd700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe5f0060860 0x7fe5f0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.714+0000 7fe606ffd700 1 -- 172.21.15.31:0/1419840723 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe5f807ca40 con 0x7fe610067400 2024-08-17T02:28:22.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.714+0000 7fe60e7fc700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe5f0060860 0x7fe5f0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.714+0000 7fe60e7fc700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe5f0060860 0x7fe5f0062d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe610069a70 tx=0x7fe600017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.718+0000 7fe606ffd700 1 -- 172.21.15.31:0/1419840723 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7fe5f807ee60 con 0x7fe610067400 2024-08-17T02:28:22.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.882+0000 7fe60ffff700 1 -- 172.21.15.31:0/1419840723 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe61015a630 con 0x7fe5f0060860 2024-08-17T02:28:22.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.882+0000 7fe606ffd700 1 -- 172.21.15.31:0/1419840723 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe61015a630 con 0x7fe5f0060860 2024-08-17T02:28:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 -- 172.21.15.31:0/1419840723 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe5f0060860 msgr2=0x7fe5f0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe5f0060860 0x7fe5f0062d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe610069a70 tx=0x7fe600017000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 -- 172.21.15.31:0/1419840723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe610067400 msgr2=0x7fe610150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe610067400 0x7fe610150a80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800e930 tx=0x7fe5f80091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 -- 172.21.15.31:0/1419840723 shutdown_connections 2024-08-17T02:28:22.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7fe5f0060860 0x7fe5f0062d10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe610156eb0 0x7fe610156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6100aed40 0x7fe610155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 --2- 172.21.15.31:0/1419840723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe610067400 0x7fe610150a80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 -- 172.21.15.31:0/1419840723 >> 172.21.15.31:0/1419840723 conn(0x7fe61006a050 msgr2=0x7fe6100cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 -- 172.21.15.31:0/1419840723 shutdown_connections 2024-08-17T02:28:22.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:22.886+0000 7fe60ffff700 1 -- 172.21.15.31:0/1419840723 wait complete. 2024-08-17T02:28:22.894 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:28:22.904 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:28:22.904 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.006+0000 7f6af0ed2700 1 Processor -- start 2024-08-17T02:28:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.006+0000 7f6af0ed2700 1 -- start start 2024-08-17T02:28:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6aec156f90 0x7f6aec06b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6aec0b1660 0x7f6aec06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec0cbed0 con 0x7f6aec157360 2024-08-17T02:28:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec0b1aa0 con 0x7f6aec156f90 2024-08-17T02:28:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec0b1cc0 con 0x7f6aec0b1660 2024-08-17T02:28:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6aea59c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6aec156f90 0x7f6aec06b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6ae9d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6aec157360 0x7f6aec0b0f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49916/0 (socket says 172.21.15.31:49916) 2024-08-17T02:28:23.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6ae9d9b700 1 -- 172.21.15.31:0/1310543135 learned_addr learned my addr 172.21.15.31:0/1310543135 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:23.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6aead9d700 1 --2- 172.21.15.31:0/1310543135 >> v2:172.21.15.92:3300/0 conn(0x7f6aec0b1660 0x7f6aec06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6aea59c700 1 -- 172.21.15.31:0/1310543135 >> v2:172.21.15.92:3300/0 conn(0x7f6aec0b1660 msgr2=0x7f6aec06bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6aea59c700 1 --2- 172.21.15.31:0/1310543135 >> v2:172.21.15.92:3300/0 conn(0x7f6aec0b1660 0x7f6aec06bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6aea59c700 1 -- 172.21.15.31:0/1310543135 >> v1:172.21.15.31:6789/0 conn(0x7f6aec157360 legacy=0x7f6aec0b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6ae959a700 1 -- 172.21.15.31:0/1310543135 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496362722 0 0) 0x7f6aec0cbed0 con 0x7f6aec157360 2024-08-17T02:28:23.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6aea59c700 1 -- 172.21.15.31:0/1310543135 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec0b1fa0 con 0x7f6aec156f90 2024-08-17T02:28:23.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6aea59c700 1 --2- 172.21.15.31:0/1310543135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec156f90 0x7f6aec06b570 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0cf150 tx=0x7f6ae00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d17be3a8f358d8d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6ae959a700 1 -- 172.21.15.31:0/1310543135 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0011630 con 0x7f6aec156f90 2024-08-17T02:28:23.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6ae959a700 1 -- 172.21.15.31:0/1310543135 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0011790 con 0x7f6aec156f90 2024-08-17T02:28:23.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6ae959a700 1 -- 172.21.15.31:0/1310543135 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0011b30 con 0x7f6aec156f90 2024-08-17T02:28:23.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 -- 172.21.15.31:0/1310543135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec156f90 msgr2=0x7f6aec06b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 --2- 172.21.15.31:0/1310543135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec156f90 0x7f6aec06b570 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0cf150 tx=0x7f6ae00091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 -- 172.21.15.31:0/1310543135 shutdown_connections 2024-08-17T02:28:23.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 --2- 172.21.15.31:0/1310543135 >> v2:172.21.15.92:3300/0 conn(0x7f6aec0b1660 0x7f6aec06bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 --2- 172.21.15.31:0/1310543135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec156f90 0x7f6aec06b570 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 -- 172.21.15.31:0/1310543135 >> 172.21.15.31:0/1310543135 conn(0x7f6aec067e80 msgr2=0x7f6aec0afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 -- 172.21.15.31:0/1310543135 shutdown_connections 2024-08-17T02:28:23.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.010+0000 7f6af0ed2700 1 -- 172.21.15.31:0/1310543135 wait complete. 2024-08-17T02:28:23.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.014+0000 7f6af0ed2700 1 Processor -- start 2024-08-17T02:28:23.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.014+0000 7f6af0ed2700 1 -- start start 2024-08-17T02:28:23.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.014+0000 7f6af0ed2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6aec0b1660 0x7f6aec14d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.014+0000 7f6af0ed2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aec156f90 0x7f6aec16b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6af0ed2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec0ca280 0x7f6aec0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6af0ed2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec158e10 con 0x7f6aec0ca280 2024-08-17T02:28:23.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6af0ed2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec16ad20 con 0x7f6aec156f90 2024-08-17T02:28:23.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6af0ed2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec158850 con 0x7f6aec0b1660 2024-08-17T02:28:23.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6aead9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec0ca280 0x7f6aec0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6aead9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec0ca280 0x7f6aec0af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51044/0 (socket says 172.21.15.31:51044) 2024-08-17T02:28:23.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6aead9d700 1 -- 172.21.15.31:0/2659727206 learned_addr learned my addr 172.21.15.31:0/2659727206 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:23.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6ae9d9b700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aec156f90 0x7f6aec16b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6aea59c700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6aec0b1660 0x7f6aec14d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6aead9d700 1 -- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6aec0b1660 msgr2=0x7f6aec14d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6aead9d700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6aec0b1660 0x7f6aec14d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6aead9d700 1 -- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aec156f90 msgr2=0x7f6aec16b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6aead9d700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6aec156f90 0x7f6aec16b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6aead9d700 1 -- 172.21.15.31:0/2659727206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae0009420 con 0x7f6aec0ca280 2024-08-17T02:28:23.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6aead9d700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec0ca280 0x7f6aec0af5d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009e90 tx=0x7f6ae400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2659727206 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae400cb70 con 0x7f6aec0ca280 2024-08-17T02:28:23.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2659727206 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae400f040 con 0x7f6aec0ca280 2024-08-17T02:28:23.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec158b30 con 0x7f6aec0ca280 2024-08-17T02:28:23.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2659727206 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4014480 con 0x7f6aec0ca280 2024-08-17T02:28:23.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec14da60 con 0x7f6aec0ca280 2024-08-17T02:28:23.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.018+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6aec16abb0 con 0x7f6aec0ca280 2024-08-17T02:28:23.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2659727206 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f6ae4014830 con 0x7f6aec0ca280 2024-08-17T02:28:23.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6ada7fc700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060860 0x7f6acc062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2659727206 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6ae407df00 con 0x7f6aec0ca280 2024-08-17T02:28:23.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6aea59c700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060860 0x7f6acc062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6ada7fc700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] conn(0x7f6acc066750 0x7f6acc068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2659727206 --> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6acc069210 con 0x7f6acc066750 2024-08-17T02:28:23.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2659727206 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ae407e2d0 con 0x7f6aec0ca280 2024-08-17T02:28:23.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6ae9d9b700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] conn(0x7f6acc066750 0x7f6acc068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6aea59c700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060860 0x7f6acc062d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00093f0 tx=0x7f6ae0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6ae9d9b700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] conn(0x7f6acc066750 0x7f6acc068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.022+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2659727206 <== osd.6 v2:172.21.15.92:6808/24419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6acc069210 con 0x7f6acc066750 2024-08-17T02:28:23.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 --> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6aec0712b0 con 0x7f6acc066750 2024-08-17T02:28:23.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2659727206 <== osd.6 v2:172.21.15.92:6808/24419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6aec0712b0 con 0x7f6acc066750 2024-08-17T02:28:23.048 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:28:23.048 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:23.048 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:28:23.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] conn(0x7f6acc066750 msgr2=0x7f6acc068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.92:6808/24419,v1:172.21.15.92:6810/24419] conn(0x7f6acc066750 0x7f6acc068b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060860 msgr2=0x7f6acc062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f6acc060860 0x7f6acc062d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00093f0 tx=0x7f6ae0017000 comp rx=0 tx=0).stop 2024-08-17T02:28:23.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec0ca280 msgr2=0x7f6aec0af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 --2- 172.21.15.31:0/2659727206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6aec0ca280 0x7f6aec0af5d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009e90 tx=0x7f6ae400b040 comp rx=0 tx=0).stop 2024-08-17T02:28:23.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6aead9d700 1 -- 172.21.15.31:0/2659727206 reap_dead start 2024-08-17T02:28:23.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 shutdown_connections 2024-08-17T02:28:23.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 >> 172.21.15.31:0/2659727206 conn(0x7f6aec067e80 msgr2=0x7f6aec1558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 shutdown_connections 2024-08-17T02:28:23.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.042+0000 7f6af0ed2700 1 -- 172.21.15.31:0/2659727206 wait complete. 2024-08-17T02:28:23.061 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:28:23.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.166+0000 7f0c0c1ca700 1 Processor -- start 2024-08-17T02:28:23.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.166+0000 7f0c0c1ca700 1 -- start start 2024-08-17T02:28:23.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c04155e20 0x7f0c0406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c041561f0 0x7f0c0406a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0c040b0160 0x7f0c040b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c040aeec0 con 0x7f0c04155e20 2024-08-17T02:28:23.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c040afed0 con 0x7f0c040b0160 2024-08-17T02:28:23.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040af110 con 0x7f0c041561f0 2024-08-17T02:28:23.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c09f66700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c04155e20 0x7f0c0406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c09f66700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c04155e20 0x7f0c0406a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51046/0 (socket says 172.21.15.31:51046) 2024-08-17T02:28:23.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0a767700 1 --2- 172.21.15.31:0/1289982988 >> v2:172.21.15.92:3300/0 conn(0x7f0c040b0160 0x7f0c040b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c09f66700 1 -- 172.21.15.31:0/1289982988 learned_addr learned my addr 172.21.15.31:0/1289982988 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:23.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c09765700 1 --2- 172.21.15.31:0/1289982988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c041561f0 0x7f0c0406a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c09f66700 1 -- 172.21.15.31:0/1289982988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c041561f0 msgr2=0x7f0c0406a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c09f66700 1 --2- 172.21.15.31:0/1289982988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c041561f0 0x7f0c0406a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c09f66700 1 -- 172.21.15.31:0/1289982988 >> v2:172.21.15.92:3300/0 conn(0x7f0c040b0160 msgr2=0x7f0c040b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c09f66700 1 --2- 172.21.15.31:0/1289982988 >> v2:172.21.15.92:3300/0 conn(0x7f0c040b0160 0x7f0c040b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c09f66700 1 -- 172.21.15.31:0/1289982988 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c040af3f0 con 0x7f0c04155e20 2024-08-17T02:28:23.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c09f66700 1 --2- 172.21.15.31:0/1289982988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c04155e20 0x7f0c0406a1a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0c04156640 tx=0x7f0bf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81100b45846a2285 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c08f64700 1 -- 172.21.15.31:0/1289982988 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800b6d0 con 0x7f0c04155e20 2024-08-17T02:28:23.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c08f64700 1 -- 172.21.15.31:0/1289982988 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf800b830 con 0x7f0c04155e20 2024-08-17T02:28:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c08f64700 1 -- 172.21.15.31:0/1289982988 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800bbf0 con 0x7f0c04155e20 2024-08-17T02:28:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/1289982988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c04155e20 msgr2=0x7f0c0406a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 --2- 172.21.15.31:0/1289982988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c04155e20 0x7f0c0406a1a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0c04156640 tx=0x7f0bf8009250 comp rx=0 tx=0).stop 2024-08-17T02:28:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/1289982988 shutdown_connections 2024-08-17T02:28:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 --2- 172.21.15.31:0/1289982988 >> v2:172.21.15.92:3300/0 conn(0x7f0c040b0160 0x7f0c040b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 --2- 172.21.15.31:0/1289982988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c041561f0 0x7f0c0406a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 --2- 172.21.15.31:0/1289982988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c04155e20 0x7f0c0406a1a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/1289982988 >> 172.21.15.31:0/1289982988 conn(0x7f0c040cbe50 msgr2=0x7f0c040cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/1289982988 shutdown_connections 2024-08-17T02:28:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.170+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/1289982988 wait complete. 2024-08-17T02:28:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0c1ca700 1 Processor -- start 2024-08-17T02:28:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0c1ca700 1 -- start start 2024-08-17T02:28:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0c1ca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c040b0160 0x7f0c040ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0c1ca700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c04155e20 0x7f0c041498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0c1ca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c041561f0 0x7f0c041582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0c1ca700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c04156690 con 0x7f0c040b0160 2024-08-17T02:28:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0c1ca700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c041574f0 con 0x7f0c041561f0 2024-08-17T02:28:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0c1ca700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c040ae8f0 con 0x7f0c04155e20 2024-08-17T02:28:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09f66700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c040b0160 0x7f0c040ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09f66700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c040b0160 0x7f0c040ae3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51062/0 (socket says 172.21.15.31:51062) 2024-08-17T02:28:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09f66700 1 -- 172.21.15.31:0/3779401494 learned_addr learned my addr 172.21.15.31:0/3779401494 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09765700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c04155e20 0x7f0c041498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0a767700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c041561f0 0x7f0c041582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09f66700 1 -- 172.21.15.31:0/3779401494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c04155e20 msgr2=0x7f0c041498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09f66700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c04155e20 0x7f0c041498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09f66700 1 -- 172.21.15.31:0/3779401494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c041561f0 msgr2=0x7f0c041582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09f66700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c041561f0 0x7f0c041582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09f66700 1 -- 172.21.15.31:0/3779401494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80094f0 con 0x7f0c040b0160 2024-08-17T02:28:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09765700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c04155e20 0x7f0c041498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:23.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c09f66700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c040b0160 0x7f0c040ae3b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8006fd0 tx=0x7f0bf8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0bf5ffb700 1 -- 172.21.15.31:0/3779401494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800bbb0 con 0x7f0c040b0160 2024-08-17T02:28:23.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0bf5ffb700 1 -- 172.21.15.31:0/3779401494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf8011420 con 0x7f0c040b0160 2024-08-17T02:28:23.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/3779401494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c041568e0 con 0x7f0c040b0160 2024-08-17T02:28:23.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0bf5ffb700 1 -- 172.21.15.31:0/3779401494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80117c0 con 0x7f0c040b0160 2024-08-17T02:28:23.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.174+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/3779401494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c04156ea0 con 0x7f0c040b0160 2024-08-17T02:28:23.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.178+0000 7f0bf5ffb700 1 -- 172.21.15.31:0/3779401494 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f0bf8011b30 con 0x7f0c040b0160 2024-08-17T02:28:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.178+0000 7f0bf5ffb700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0be8060860 0x7f0be8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.178+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/3779401494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c040712b0 con 0x7f0c040b0160 2024-08-17T02:28:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.178+0000 7f0bf5ffb700 1 -- 172.21.15.31:0/3779401494 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0bf807e170 con 0x7f0c040b0160 2024-08-17T02:28:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.178+0000 7f0c09765700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0be8060860 0x7f0be8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.178+0000 7f0c09765700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0be8060860 0x7f0be8062d10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0c04167140 tx=0x7f0c00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.186+0000 7f0bf5ffb700 1 -- 172.21.15.31:0/3779401494 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f0bf8015070 con 0x7f0c040b0160 2024-08-17T02:28:23.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/3779401494 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c04157630 con 0x7f0be8060860 2024-08-17T02:28:23.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0bf5ffb700 1 -- 172.21.15.31:0/3779401494 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0c00009df0 con 0x7f0be8060860 2024-08-17T02:28:23.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/3779401494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0be8060860 msgr2=0x7f0be8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0be8060860 0x7f0be8062d10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0c04167140 tx=0x7f0c00008040 comp rx=0 tx=0).stop 2024-08-17T02:28:23.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/3779401494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c040b0160 msgr2=0x7f0c040ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c040b0160 0x7f0c040ae3b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8006fd0 tx=0x7f0bf8017000 comp rx=0 tx=0).stop 2024-08-17T02:28:23.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/3779401494 shutdown_connections 2024-08-17T02:28:23.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f0be8060860 0x7f0be8062d10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c041561f0 0x7f0c041582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c04155e20 0x7f0c041498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 --2- 172.21.15.31:0/3779401494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c040b0160 0x7f0c040ae3b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/3779401494 >> 172.21.15.31:0/3779401494 conn(0x7f0c040cbe50 msgr2=0x7f0c040ca9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/3779401494 shutdown_connections 2024-08-17T02:28:23.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.350+0000 7f0c0c1ca700 1 -- 172.21.15.31:0/3779401494 wait complete. 2024-08-17T02:28:23.360 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:28:23.370 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:28:23.370 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:23.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.478+0000 7f4fa359e700 1 Processor -- start 2024-08-17T02:28:23.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.478+0000 7f4fa359e700 1 -- start start 2024-08-17T02:28:23.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fa41592f0 0x7f4fa40cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4fa40cb6a0 0x7f4fa40cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fa41596c0 0x7f4fa40cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa40cd3c0 con 0x7f4fa41596c0 2024-08-17T02:28:23.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa415a780 con 0x7f4fa40cb6a0 2024-08-17T02:28:23.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa415ac10 con 0x7f4fa41592f0 2024-08-17T02:28:23.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa2d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fa41596c0 0x7f4fa40cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa2d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fa41596c0 0x7f4fa40cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51064/0 (socket says 172.21.15.31:51064) 2024-08-17T02:28:23.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa2d9d700 1 -- 172.21.15.31:0/518687318 learned_addr learned my addr 172.21.15.31:0/518687318 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:23.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4f99d9b700 1 --2- 172.21.15.31:0/518687318 >> v2:172.21.15.92:3300/0 conn(0x7f4fa40cb6a0 0x7f4fa40cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa259c700 1 --2- 172.21.15.31:0/518687318 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fa41592f0 0x7f4fa40cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa2d9d700 1 -- 172.21.15.31:0/518687318 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fa41592f0 msgr2=0x7f4fa40cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa2d9d700 1 --2- 172.21.15.31:0/518687318 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fa41592f0 0x7f4fa40cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa2d9d700 1 -- 172.21.15.31:0/518687318 >> v2:172.21.15.92:3300/0 conn(0x7f4fa40cb6a0 msgr2=0x7f4fa40cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa2d9d700 1 --2- 172.21.15.31:0/518687318 >> v2:172.21.15.92:3300/0 conn(0x7f4fa40cb6a0 0x7f4fa40cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa2d9d700 1 -- 172.21.15.31:0/518687318 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa4159b70 con 0x7f4fa41596c0 2024-08-17T02:28:23.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa2d9d700 1 --2- 172.21.15.31:0/518687318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa41596c0 0x7f4fa40cce80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40891d0 tx=0x7f4f9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19c98cb197762d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa1d9b700 1 -- 172.21.15.31:0/518687318 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00e070 con 0x7f4fa41596c0 2024-08-17T02:28:23.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa1d9b700 1 -- 172.21.15.31:0/518687318 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c00ba20 con 0x7f4fa41596c0 2024-08-17T02:28:23.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa1d9b700 1 -- 172.21.15.31:0/518687318 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0092e0 con 0x7f4fa41596c0 2024-08-17T02:28:23.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 -- 172.21.15.31:0/518687318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa41596c0 msgr2=0x7f4fa40cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 --2- 172.21.15.31:0/518687318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa41596c0 0x7f4fa40cce80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40891d0 tx=0x7f4f9c009840 comp rx=0 tx=0).stop 2024-08-17T02:28:23.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 -- 172.21.15.31:0/518687318 shutdown_connections 2024-08-17T02:28:23.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 --2- 172.21.15.31:0/518687318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa41596c0 0x7f4fa40cce80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 --2- 172.21.15.31:0/518687318 >> v2:172.21.15.92:3300/0 conn(0x7f4fa40cb6a0 0x7f4fa40cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 --2- 172.21.15.31:0/518687318 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fa41592f0 0x7f4fa40cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 -- 172.21.15.31:0/518687318 >> 172.21.15.31:0/518687318 conn(0x7f4fa4067400 msgr2=0x7f4fa4067800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 -- 172.21.15.31:0/518687318 shutdown_connections 2024-08-17T02:28:23.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.482+0000 7f4fa359e700 1 -- 172.21.15.31:0/518687318 wait complete. 2024-08-17T02:28:23.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4fa359e700 1 Processor -- start 2024-08-17T02:28:23.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4fa359e700 1 -- start start 2024-08-17T02:28:23.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4fa359e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa41592f0 0x7f4fa415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4fa359e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa41596c0 0x7f4fa415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4fa359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fa4169450 0x7f4fa41527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4fa359e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40b4980 con 0x7f4fa41596c0 2024-08-17T02:28:23.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4fa359e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa415dd30 con 0x7f4fa41592f0 2024-08-17T02:28:23.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4fa359e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40b4050 con 0x7f4fa4169450 2024-08-17T02:28:23.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4f99d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa41596c0 0x7f4fa415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4f99d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa41596c0 0x7f4fa415aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51072/0 (socket says 172.21.15.31:51072) 2024-08-17T02:28:23.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4f99d9b700 1 -- 172.21.15.31:0/3925065666 learned_addr learned my addr 172.21.15.31:0/3925065666 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:23.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4fa259c700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa41592f0 0x7f4fa415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4fa2d9d700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fa4169450 0x7f4fa41527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4f99d9b700 1 -- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fa4169450 msgr2=0x7f4fa41527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4f99d9b700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fa4169450 0x7f4fa41527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4f99d9b700 1 -- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa41592f0 msgr2=0x7f4fa415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4f99d9b700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa41592f0 0x7f4fa415d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.486+0000 7f4f99d9b700 1 -- 172.21.15.31:0/3925065666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c009ae0 con 0x7f4fa41596c0 2024-08-17T02:28:23.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4f99d9b700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa41596c0 0x7f4fa415aed0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400ec80 tx=0x7f4f940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4f9affd700 1 -- 172.21.15.31:0/3925065666 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94009690 con 0x7f4fa41596c0 2024-08-17T02:28:23.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4f9affd700 1 -- 172.21.15.31:0/3925065666 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9400c850 con 0x7f4fa41596c0 2024-08-17T02:28:23.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa40b4330 con 0x7f4fa41596c0 2024-08-17T02:28:23.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4f9affd700 1 -- 172.21.15.31:0/3925065666 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9400cc10 con 0x7f4fa41596c0 2024-08-17T02:28:23.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa415b410 con 0x7f4fa41596c0 2024-08-17T02:28:23.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4fa40712b0 con 0x7f4fa41596c0 2024-08-17T02:28:23.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4f9affd700 1 -- 172.21.15.31:0/3925065666 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f4f94013470 con 0x7f4fa41596c0 2024-08-17T02:28:23.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4f9affd700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4f88060860 0x7f4f88062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4f9affd700 1 -- 172.21.15.31:0/3925065666 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4f9407ca70 con 0x7f4fa41596c0 2024-08-17T02:28:23.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4fa259c700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4f88060860 0x7f4f88062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4f9affd700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] conn(0x7f4f88066750 0x7f4f88068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4f9affd700 1 -- 172.21.15.31:0/3925065666 --> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f88069210 con 0x7f4f88066750 2024-08-17T02:28:23.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4f9affd700 1 -- 172.21.15.31:0/3925065666 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f94081240 con 0x7f4fa41596c0 2024-08-17T02:28:23.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.490+0000 7f4fa2d9d700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] conn(0x7f4f88066750 0x7f4f88068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.494+0000 7f4fa259c700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4f88060860 0x7f4f88062d10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c006fd0 tx=0x7f4f8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.494+0000 7f4fa2d9d700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] conn(0x7f4f88066750 0x7f4f88068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.494+0000 7f4f9affd700 1 -- 172.21.15.31:0/3925065666 <== osd.7 v2:172.21.15.92:6824/24431 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4f88069210 con 0x7f4f88066750 2024-08-17T02:28:23.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.514+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 --> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4fa40b47b0 con 0x7f4f88066750 2024-08-17T02:28:23.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.514+0000 7f4f9affd700 1 -- 172.21.15.31:0/3925065666 <== osd.7 v2:172.21.15.92:6824/24431 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4f9c009940 con 0x7f4f88066750 2024-08-17T02:28:23.522 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-08-17T02:28:23.523 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:23.523 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-08-17T02:28:23.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] conn(0x7f4f88066750 msgr2=0x7f4f88068b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa359e700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.92:6824/24431,v1:172.21.15.92:6825/24431] conn(0x7f4f88066750 0x7f4f88068b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4f88060860 msgr2=0x7f4f88062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa359e700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f4f88060860 0x7f4f88062d10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c006fd0 tx=0x7f4f8c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:23.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa41596c0 msgr2=0x7f4fa415aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa359e700 1 --2- 172.21.15.31:0/3925065666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa41596c0 0x7f4fa415aed0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400ec80 tx=0x7f4f940091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa2d9d700 1 -- 172.21.15.31:0/3925065666 reap_dead start 2024-08-17T02:28:23.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 shutdown_connections 2024-08-17T02:28:23.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 >> 172.21.15.31:0/3925065666 conn(0x7f4fa4067400 msgr2=0x7f4fa4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 shutdown_connections 2024-08-17T02:28:23.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.518+0000 7f4fa359e700 1 -- 172.21.15.31:0/3925065666 wait complete. 2024-08-17T02:28:23.536 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:28:23.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04fd7f3700 1 Processor -- start 2024-08-17T02:28:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04fd7f3700 1 -- start start 2024-08-17T02:28:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04fd7f3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04f80cb0b0 0x7f04f806a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04fd7f3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04f80cc020 0x7f04f81561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04fd7f3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f8156e60 con 0x7f04f8069d90 2024-08-17T02:28:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04fd7f3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f80cb620 con 0x7f04f80cb0b0 2024-08-17T02:28:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04fd7f3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80cb900 con 0x7f04f80cc020 2024-08-17T02:28:23.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04f6ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f04f8069d90 0x7f04f8155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49932/0 (socket says 172.21.15.31:49932) 2024-08-17T02:28:23.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04f6ffd700 1 -- 172.21.15.31:0/1347297352 learned_addr learned my addr 172.21.15.31:0/1347297352 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:23.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04ee7fc700 1 --2- 172.21.15.31:0/1347297352 >> v2:172.21.15.31:3300/0 conn(0x7f04f80cb0b0 0x7f04f806a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04f77fe700 1 --2- 172.21.15.31:0/1347297352 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04f80cc020 0x7f04f81561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04f67fc700 1 -- 172.21.15.31:0/1347297352 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881794033 0 0) 0x7f04f8156e60 con 0x7f04f8069d90 2024-08-17T02:28:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04f67fc700 1 -- 172.21.15.31:0/1347297352 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04e4003570 con 0x7f04f8069d90 2024-08-17T02:28:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04ee7fc700 1 -- 172.21.15.31:0/1347297352 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04f80cc020 msgr2=0x7f04f81561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04ee7fc700 1 --2- 172.21.15.31:0/1347297352 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04f80cc020 0x7f04f81561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04ee7fc700 1 -- 172.21.15.31:0/1347297352 >> v1:172.21.15.31:6789/0 conn(0x7f04f8069d90 legacy=0x7f04f8155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04ee7fc700 1 -- 172.21.15.31:0/1347297352 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8156810 con 0x7f04f80cb0b0 2024-08-17T02:28:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04ee7fc700 1 --2- 172.21.15.31:0/1347297352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f80cb0b0 0x7f04f806a160 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f04e00098e0 tx=0x7f04e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e5661fad929ecf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04f67fc700 1 -- 172.21.15.31:0/1347297352 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0011630 con 0x7f04f80cb0b0 2024-08-17T02:28:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04f67fc700 1 -- 172.21.15.31:0/1347297352 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e0011790 con 0x7f04f80cb0b0 2024-08-17T02:28:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.646+0000 7f04f67fc700 1 -- 172.21.15.31:0/1347297352 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0011b30 con 0x7f04f80cb0b0 2024-08-17T02:28:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.650+0000 7f04fd7f3700 1 -- 172.21.15.31:0/1347297352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f80cb0b0 msgr2=0x7f04f806a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.650+0000 7f04fd7f3700 1 --2- 172.21.15.31:0/1347297352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f80cb0b0 0x7f04f806a160 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f04e00098e0 tx=0x7f04e00091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.650+0000 7f04fd7f3700 1 -- 172.21.15.31:0/1347297352 shutdown_connections 2024-08-17T02:28:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.650+0000 7f04fd7f3700 1 --2- 172.21.15.31:0/1347297352 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04f80cc020 0x7f04f81561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.650+0000 7f04fd7f3700 1 --2- 172.21.15.31:0/1347297352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f80cb0b0 0x7f04f806a160 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.650+0000 7f04fd7f3700 1 -- 172.21.15.31:0/1347297352 >> 172.21.15.31:0/1347297352 conn(0x7f04f8069790 msgr2=0x7f04f80b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.650+0000 7f04fd7f3700 1 -- 172.21.15.31:0/1347297352 shutdown_connections 2024-08-17T02:28:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.650+0000 7f04fd7f3700 1 -- 172.21.15.31:0/1347297352 wait complete. 2024-08-17T02:28:23.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.650+0000 7f04fd7f3700 1 Processor -- start 2024-08-17T02:28:23.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.650+0000 7f04fd7f3700 1 -- start start 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04fd7f3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f8069d90 0x7f04f81430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04fd7f3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04f80cb0b0 0x7f04f8067400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04fd7f3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04f80cc020 0x7f04f8067940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04fd7f3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80c6bb0 con 0x7f04f8069d90 2024-08-17T02:28:23.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04fd7f3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80c6e90 con 0x7f04f80cc020 2024-08-17T02:28:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04fd7f3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80c7170 con 0x7f04f80cb0b0 2024-08-17T02:28:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04f6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f8069d90 0x7f04f81430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04f6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f8069d90 0x7f04f81430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51102/0 (socket says 172.21.15.31:51102) 2024-08-17T02:28:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04f6ffd700 1 -- 172.21.15.31:0/3734537639 learned_addr learned my addr 172.21.15.31:0/3734537639 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04ee7fc700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04f80cb0b0 0x7f04f8067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04f77fe700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04f80cc020 0x7f04f8067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04f6ffd700 1 -- 172.21.15.31:0/3734537639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04f80cb0b0 msgr2=0x7f04f8067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04f6ffd700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04f80cb0b0 0x7f04f8067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04f6ffd700 1 -- 172.21.15.31:0/3734537639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04f80cc020 msgr2=0x7f04f8067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04f6ffd700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04f80cc020 0x7f04f8067940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04f6ffd700 1 -- 172.21.15.31:0/3734537639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0009420 con 0x7f04f8069d90 2024-08-17T02:28:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04f6ffd700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f8069d90 0x7f04f81430c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c7c0 tx=0x7f04e8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04ef7fe700 1 -- 172.21.15.31:0/3734537639 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8005b30 con 0x7f04f8069d90 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04ef7fe700 1 -- 172.21.15.31:0/3734537639 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8005c90 con 0x7f04f8069d90 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04fd7f3700 1 -- 172.21.15.31:0/3734537639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f80c7450 con 0x7f04f8069d90 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04ef7fe700 1 -- 172.21.15.31:0/3734537639 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8007300 con 0x7f04f8069d90 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.654+0000 7f04fd7f3700 1 -- 172.21.15.31:0/3734537639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f8143600 con 0x7f04f8069d90 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.658+0000 7f04fd7f3700 1 -- 172.21.15.31:0/3734537639 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f80c7950 con 0x7f04f8069d90 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.658+0000 7f04ef7fe700 1 -- 172.21.15.31:0/3734537639 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f04e801b3b0 con 0x7f04f8069d90 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.658+0000 7f04ef7fe700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f04d8060860 0x7f04d8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.658+0000 7f04ef7fe700 1 -- 172.21.15.31:0/3734537639 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f04e807be50 con 0x7f04f8069d90 2024-08-17T02:28:23.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.658+0000 7f04ee7fc700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f04d8060860 0x7f04d8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.658+0000 7f04ee7fc700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f04d8060860 0x7f04d8062d10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f04e00091e0 tx=0x7f04e0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.662+0000 7f04ef7fe700 1 -- 172.21.15.31:0/3734537639 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f04e804c540 con 0x7f04f8069d90 2024-08-17T02:28:23.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.822+0000 7f04fd7f3700 1 -- 172.21.15.31:0/3734537639 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f04f80712b0 con 0x7f04d8060860 2024-08-17T02:28:23.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04ef7fe700 1 -- 172.21.15.31:0/3734537639 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f04f80712b0 con 0x7f04d8060860 2024-08-17T02:28:23.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 -- 172.21.15.31:0/3734537639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f04d8060860 msgr2=0x7f04d8062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f04d8060860 0x7f04d8062d10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f04e00091e0 tx=0x7f04e0017000 comp rx=0 tx=0).stop 2024-08-17T02:28:23.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 -- 172.21.15.31:0/3734537639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f8069d90 msgr2=0x7f04f81430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f8069d90 0x7f04f81430c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c7c0 tx=0x7f04e8007e00 comp rx=0 tx=0).stop 2024-08-17T02:28:23.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 -- 172.21.15.31:0/3734537639 shutdown_connections 2024-08-17T02:28:23.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f04d8060860 0x7f04d8062d10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04f80cc020 0x7f04f8067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04f80cb0b0 0x7f04f8067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 --2- 172.21.15.31:0/3734537639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04f8069d90 0x7f04f81430c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 -- 172.21.15.31:0/3734537639 >> 172.21.15.31:0/3734537639 conn(0x7f04f8069790 msgr2=0x7f04f80b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 -- 172.21.15.31:0/3734537639 shutdown_connections 2024-08-17T02:28:23.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.826+0000 7f04fd7f3700 1 -- 172.21.15.31:0/3734537639 wait complete. 2024-08-17T02:28:23.835 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:28:23.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.942+0000 7f3cb18d4700 1 Processor -- start 2024-08-17T02:28:23.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.942+0000 7f3cb18d4700 1 -- start start 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.942+0000 7f3cb18d4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3cac06a8b0 0x7f3cac0b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.942+0000 7f3cb18d4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac0aeec0 con 0x7f3cac1561f0 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.942+0000 7f3cb18d4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac0afed0 con 0x7f3cac155e20 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.942+0000 7f3cb18d4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac0af110 con 0x7f3cac06a8b0 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.942+0000 7f3cab7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3cac1561f0 0x7f3cac0c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49942/0 (socket says 172.21.15.31:49942) 2024-08-17T02:28:23.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.942+0000 7f3cab7fe700 1 -- 172.21.15.31:0/1817572842 learned_addr learned my addr 172.21.15.31:0/1817572842 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:23.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.942+0000 7f3caa7fc700 1 --2- 172.21.15.31:0/1817572842 >> v2:172.21.15.92:3300/0 conn(0x7f3cac06a8b0 0x7f3cac0b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3ca9ffb700 1 -- 172.21.15.31:0/1817572842 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45616515 0 0) 0x7f3cac0aeec0 con 0x7f3cac1561f0 2024-08-17T02:28:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3ca9ffb700 1 -- 172.21.15.31:0/1817572842 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c94003570 con 0x7f3cac1561f0 2024-08-17T02:28:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3ca9ffb700 1 -- 172.21.15.31:0/1817572842 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411509902 0 0) 0x7f3cac0afed0 con 0x7f3cac155e20 2024-08-17T02:28:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3ca9ffb700 1 -- 172.21.15.31:0/1817572842 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cac0aeec0 con 0x7f3cac155e20 2024-08-17T02:28:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3caa7fc700 1 -- 172.21.15.31:0/1817572842 >> v1:172.21.15.92:6789/0 conn(0x7f3cac155e20 legacy=0x7f3cac06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3ca9ffb700 1 -- 172.21.15.31:0/1817572842 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4068477686 0 0) 0x7f3c94003570 con 0x7f3cac1561f0 2024-08-17T02:28:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3caa7fc700 1 -- 172.21.15.31:0/1817572842 >> v1:172.21.15.31:6789/0 conn(0x7f3cac1561f0 legacy=0x7f3cac0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3caa7fc700 1 -- 172.21.15.31:0/1817572842 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac0af3f0 con 0x7f3cac06a8b0 2024-08-17T02:28:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3caa7fc700 1 --2- 172.21.15.31:0/1817572842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac06a8b0 0x7f3cac0b0160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00098e0 tx=0x7f3ca00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de3850928d85f7ed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3ca9ffb700 1 -- 172.21.15.31:0/1817572842 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40017f0 con 0x7f3cac06a8b0 2024-08-17T02:28:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3ca9ffb700 1 -- 172.21.15.31:0/1817572842 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca0011420 con 0x7f3cac06a8b0 2024-08-17T02:28:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3ca9ffb700 1 -- 172.21.15.31:0/1817572842 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00117a0 con 0x7f3cac06a8b0 2024-08-17T02:28:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3cb18d4700 1 -- 172.21.15.31:0/1817572842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac06a8b0 msgr2=0x7f3cac0b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3cb18d4700 1 --2- 172.21.15.31:0/1817572842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac06a8b0 0x7f3cac0b0160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00098e0 tx=0x7f3ca00091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3cb18d4700 1 -- 172.21.15.31:0/1817572842 shutdown_connections 2024-08-17T02:28:23.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3cb18d4700 1 --2- 172.21.15.31:0/1817572842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac06a8b0 0x7f3cac0b0160 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3cb18d4700 1 -- 172.21.15.31:0/1817572842 >> 172.21.15.31:0/1817572842 conn(0x7f3cac0cbe50 msgr2=0x7f3cac0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3cb18d4700 1 -- 172.21.15.31:0/1817572842 shutdown_connections 2024-08-17T02:28:23.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.946+0000 7f3cb18d4700 1 -- 172.21.15.31:0/1817572842 wait complete. 2024-08-17T02:28:23.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cb18d4700 1 Processor -- start 2024-08-17T02:28:23.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cb18d4700 1 -- start start 2024-08-17T02:28:23.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cb18d4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac06a8b0 0x7f3cac0c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cb18d4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3cac155e20 0x7f3cac144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cb18d4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac1561f0 0x7f3cac156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cb18d4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0c9ac0 con 0x7f3cac06a8b0 2024-08-17T02:28:23.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cb18d4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0c8eb0 con 0x7f3cac1561f0 2024-08-17T02:28:23.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cb18d4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0c9190 con 0x7f3cac155e20 2024-08-17T02:28:23.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3caaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac06a8b0 0x7f3cac0c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3caaffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac06a8b0 0x7f3cac0c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51114/0 (socket says 172.21.15.31:51114) 2024-08-17T02:28:23.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3caaffd700 1 -- 172.21.15.31:0/3442663179 learned_addr learned my addr 172.21.15.31:0/3442663179 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:23.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cab7fe700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac1561f0 0x7f3cac156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3caa7fc700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3cac155e20 0x7f3cac144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3caaffd700 1 -- 172.21.15.31:0/3442663179 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3cac155e20 msgr2=0x7f3cac144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3caaffd700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3cac155e20 0x7f3cac144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3caaffd700 1 -- 172.21.15.31:0/3442663179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac1561f0 msgr2=0x7f3cac156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3caaffd700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac1561f0 0x7f3cac156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3caaffd700 1 -- 172.21.15.31:0/3442663179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca0009420 con 0x7f3cac06a8b0 2024-08-17T02:28:23.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3caaffd700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac06a8b0 0x7f3cac0c9f50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00c790 tx=0x7f3c9c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3c92ffd700 1 -- 172.21.15.31:0/3442663179 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c010510 con 0x7f3cac06a8b0 2024-08-17T02:28:23.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3c92ffd700 1 -- 172.21.15.31:0/3442663179 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c010670 con 0x7f3cac06a8b0 2024-08-17T02:28:23.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3c92ffd700 1 -- 172.21.15.31:0/3442663179 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c010a10 con 0x7f3cac06a8b0 2024-08-17T02:28:23.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cb18d4700 1 -- 172.21.15.31:0/3442663179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac0c9470 con 0x7f3cac06a8b0 2024-08-17T02:28:23.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.950+0000 7f3cb18d4700 1 -- 172.21.15.31:0/3442663179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac144db0 con 0x7f3cac06a8b0 2024-08-17T02:28:23.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.954+0000 7f3cb18d4700 1 -- 172.21.15.31:0/3442663179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac0712b0 con 0x7f3cac06a8b0 2024-08-17T02:28:23.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.954+0000 7f3c92ffd700 1 -- 172.21.15.31:0/3442663179 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f3c9c01b3b0 con 0x7f3cac06a8b0 2024-08-17T02:28:23.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.954+0000 7f3c92ffd700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3c98060860 0x7f3c98062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.954+0000 7f3caa7fc700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3c98060860 0x7f3c98062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.954+0000 7f3c92ffd700 1 -- 172.21.15.31:0/3442663179 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3c9c07c1a0 con 0x7f3cac06a8b0 2024-08-17T02:28:23.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.954+0000 7f3caa7fc700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3c98060860 0x7f3c98062d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00098e0 tx=0x7f3ca0016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:23.962+0000 7f3c92ffd700 1 -- 172.21.15.31:0/3442663179 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f3c9c04c890 con 0x7f3cac06a8b0 2024-08-17T02:28:24.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.122+0000 7f3cb18d4700 1 -- 172.21.15.31:0/3442663179 --> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cac0c9c00 con 0x7f3c98060860 2024-08-17T02:28:24.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.126+0000 7f3c92ffd700 1 -- 172.21.15.31:0/3442663179 <== mgr.4103 v2:172.21.15.31:6832/24030 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48708 (secure 0 0 0) 0x7f3ca0011710 con 0x7f3c98060860 2024-08-17T02:28:24.134 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:24.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 -- 172.21.15.31:0/3442663179 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3c98060860 msgr2=0x7f3c98062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3c98060860 0x7f3c98062d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00098e0 tx=0x7f3ca0016000 comp rx=0 tx=0).stop 2024-08-17T02:28:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 -- 172.21.15.31:0/3442663179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac06a8b0 msgr2=0x7f3cac0c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac06a8b0 0x7f3cac0c9f50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00c790 tx=0x7f3c9c007e10 comp rx=0 tx=0).stop 2024-08-17T02:28:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 -- 172.21.15.31:0/3442663179 shutdown_connections 2024-08-17T02:28:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f3c98060860 0x7f3c98062d10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cac1561f0 0x7f3cac156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3cac155e20 0x7f3cac144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 --2- 172.21.15.31:0/3442663179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac06a8b0 0x7f3cac0c9f50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 -- 172.21.15.31:0/3442663179 >> 172.21.15.31:0/3442663179 conn(0x7f3cac0cbe50 msgr2=0x7f3cac0acc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 -- 172.21.15.31:0/3442663179 shutdown_connections 2024-08-17T02:28:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.130+0000 7f3cb18d4700 1 -- 172.21.15.31:0/3442663179 wait complete. 2024-08-17T02:28:24.138 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-08-17T02:28:24.148 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-08-17T02:28:23.663637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388700,"kb_used_data":5672,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586020,"statfs":{"total":773094113280,"available":770648084480,"internally_reserved":0,"allocated":5808128,"data_stored":3130232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.916912"},"pg_stats":[{"pgid":"1.0","version":"49'119","reported_seq":199,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-08-17T02:28:21.795901+0000","last_change":"2024-08-17T02:28:21.795847+0000","last_active":"2024-08-17T02:28:21.795901+0000","last_peered":"2024-08-17T02:28:21.795901+0000","last_clean":"2024-08-17T02:28:21.795901+0000","last_became_active":"2024-08-17T02:24:35.594091+0000","last_became_peered":"2024-08-17T02:24:35.594091+0000","last_unstale":"2024-08-17T02:28:21.795901+0000","last_undegraded":"2024-08-17T02:28:21.795901+0000","last_fullsized":"2024-08-17T02:28:21.795901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'119","last_scrub_stamp":"2024-08-17T02:28:21.795687+0000","last_deep_scrub":"49'119","last_deep_scrub_stamp":"2024-08-17T02:28:21.795687+0000","last_clean_scrub_stamp":"2024-08-17T02:28:21.795687+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:15:05.606838+0000","scrub_duration":0.012254569,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91300000000000003,"15min":0.91700000000000004},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.129,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.91700000000000004,"15min":0.92100000000000004},"min":{"1min":0.67700000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2949999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.83899999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.67300000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2310000000000001,"5min":1.804,"15min":1.804},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.72599999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1299999999999999,"5min":1.236,"15min":1.236},"last":0.71599999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.90000000000000002,"15min":0.89600000000000002},"min":{"1min":0.71099999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1830000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.91100000000000003,"15min":0.90900000000000003},"min":{"1min":0.65000000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1739999999999999,"5min":1.403,"15min":1.403},"last":0.76800000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0149999999999999,"15min":1.034},"min":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.298,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.01,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.75800000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3120000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.873}]},{"osd":4,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.96199999999999997,"15min":0.98099999999999998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.234,"5min":1.502,"15min":1.502},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.115,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2210000000000001,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":1.03}]},{"osd":5,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":1.056,"15min":1.089},"min":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2470000000000001,"5min":1.401,"15min":1.401},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1890000000000001,"15min":1.216},"min":{"1min":0.89600000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.3500000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.119}]},{"osd":6,"last update":"Sat Aug 17 02:27:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1359999999999999,"15min":1.1599999999999999},"min":{"1min":0.82799999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.3049999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.214,"15min":1.2370000000000001},"min":{"1min":0.97999999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.357,"5min":2.073,"15min":2.073},"last":1.147}]}]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.97199999999999998,"15min":0.98099999999999998},"min":{"1min":0.77000000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2529999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.01,"15min":1.026},"min":{"1min":0.81100000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.1459999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.004,"15min":1.0169999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1279999999999999,"5min":1.47,"15min":1.47},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":0.996,"15min":1},"min":{"1min":0.66800000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.202,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.80100000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.89100000000000001,"15min":0.877},"min":{"1min":0.64200000000000002,"5min":0.505,"15min":0.505},"max":{"1min":1.2649999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.92900000000000005,"15min":0.95499999999999996},"min":{"1min":0.66200000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.133,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.89400000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93500000000000005,"15min":0.96499999999999997},"min":{"1min":0.66700000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.1679999999999999,"5min":1.593,"15min":1.593},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.085,"5min":1.089,"15min":1.087},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.292,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.83899999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.91200000000000003,"15min":0.93600000000000005},"min":{"1min":0.59799999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1799999999999999,"5min":1.357,"15min":1.357},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.016,"15min":1.048},"min":{"1min":0.67100000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.26,"5min":1.762,"15min":1.762},"last":1.1080000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":1.014,"15min":1.02},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.1879999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.089},{"interface":"front","average":{"1min":1.131,"5min":1.169,"15min":1.198},"min":{"1min":0.95599999999999996,"5min":0.746,"15min":0.746},"max":{"1min":1.3859999999999999,"5min":1.548,"15min":1.548},"last":1.0409999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:27:41 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.80500000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.25,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.177},{"interface":"front","average":{"1min":1.121,"5min":1.1879999999999999,"15min":1.208},"min":{"1min":0.88,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.48,"5min":1.796,"15min":1.796},"last":1.149}]}]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.83599999999999997},"min":{"1min":0.621,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1930000000000001,"5min":1.371,"15min":1.371},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.86599999999999999,"15min":0.88200000000000001},"min":{"1min":0.61299999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.105,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.69199999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.875,"15min":0.85499999999999998},"min":{"1min":0.67100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.93300000000000005,"15min":0.94599999999999995},"min":{"1min":0.70999999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2509999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.87}]},{"osd":2,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.93899999999999995,"15min":0.94999999999999996},"min":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.198,"5min":1.47,"15min":1.47},"last":1.214},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.71099999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.306,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.95999999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.94899999999999995,"15min":0.96599999999999997},"min":{"1min":0.74099999999999999,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1379999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.04,"5min":1.018,"15min":1.0189999999999999},"min":{"1min":0.86399999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.3380000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1439999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.99199999999999999,"15min":1.0129999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.242,"5min":1.613,"15min":1.613},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0900000000000001,"15min":1.1060000000000001},"min":{"1min":0.66500000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.276,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.069}]},{"osd":6,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.052,"15min":1.0660000000000001},"min":{"1min":0.71999999999999997,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3899999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.999},{"interface":"front","average":{"1min":1.127,"5min":1.107,"15min":1.103},"min":{"1min":0.86299999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.377,"5min":1.589,"15min":1.589},"last":1.101}]},{"osd":7,"last update":"Sat Aug 17 02:27:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0900000000000001,"15min":1.0980000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.3580000000000001,"5min":2.016,"15min":2.016},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1759999999999999,"15min":1.1819999999999999},"min":{"1min":0.997,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.3999999999999999,"5min":1.625,"15min":1.625},"last":1.2689999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297924,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.52600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.73399999999999999,"15min":0.70399999999999996},"min":{"1min":0.59599999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.006}]},{"osd":1,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.55900000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1259999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85399999999999998,"15min":0.85599999999999998},"min":{"1min":0.69999999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":1.73,"15min":1.73},"last":0.86199999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.79800000000000004},"min":{"1min":0.63400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0569999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.876,"15min":0.871},"min":{"1min":0.67100000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.139,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.81999999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0600000000000001,"15min":1.056},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.266},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.089,"15min":1.0800000000000001},"min":{"1min":0.84999999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.613,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.93700000000000006}]},{"osd":5,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1659999999999999,"15min":1.171},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.3640000000000001,"5min":1.599,"15min":1.599},"last":1.069},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1819999999999999,"15min":1.1879999999999999},"min":{"1min":0.89100000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.502,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.2010000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.236,"15min":1.2629999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":1.716,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.234,"15min":1.244},"min":{"1min":1,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.458,"5min":2.427,"15min":2.427},"last":1.153}]},{"osd":7,"last update":"Sat Aug 17 02:27:35 2024","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.2689999999999999,"15min":1.2729999999999999},"min":{"1min":1.0640000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.5760000000000001,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.2749999999999999,"15min":1.2709999999999999},"min":{"1min":1.127,"5min":0.878,"15min":0.878},"max":{"1min":1.629,"5min":2.278,"15min":2.278},"last":1.0960000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297924,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72199999999999998,"15min":0.74199999999999999},"min":{"1min":0.52800000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2709999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79800000000000004,"15min":0.78400000000000003},"min":{"1min":0.60999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0760000000000001,"5min":1.974,"15min":1.974},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.60099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":1.016,"5min":1.423,"15min":1.423},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.84499999999999997,"15min":0.84099999999999997},"min":{"1min":0.58699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1479999999999999,"5min":1.641,"15min":1.641},"last":0.90500000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.621,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.284,"5min":1.347,"15min":1.347},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95899999999999996,"15min":0.97099999999999997},"min":{"1min":0.74399999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1779999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.94299999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.087,"15min":1.091},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.2569999999999999,"5min":2.113,"15min":2.113},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.0329999999999999,"15min":1.0409999999999999},"min":{"1min":0.84399999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3779999999999999,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.1240000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.163,"15min":1.1779999999999999},"min":{"1min":0.80800000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4279999999999999,"5min":2.613,"15min":2.613},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.206,"15min":1.216},"min":{"1min":0.92400000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.3320000000000001,"5min":2.298,"15min":2.298},"last":1.3300000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.1319999999999999,"15min":1.141},"min":{"1min":0.84099999999999997,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.4870000000000001,"5min":1.986,"15min":1.986},"last":1.369},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.226,"15min":1.2390000000000001},"min":{"1min":0.89800000000000002,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.738,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.411}]},{"osd":7,"last update":"Sat Aug 17 02:27:37 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2509999999999999,"15min":1.2549999999999999},"min":{"1min":0.91000000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.46,"5min":2.516,"15min":2.516},"last":1.458},{"interface":"front","average":{"1min":1.27,"5min":1.2090000000000001,"15min":1.1990000000000001},"min":{"1min":1.046,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5669999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.4730000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298504,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073336,"statfs":{"total":96636764160,"available":96331096064,"internally_reserved":0,"allocated":1171456,"data_stored":834055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.502,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0900000000000001,"5min":1.925,"15min":1.925},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76700000000000002,"15min":0.78000000000000003},"min":{"1min":0.56699999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96899999999999997,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84699999999999998,"15min":0.85399999999999998},"min":{"1min":0.53900000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3440000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.81499999999999995,"15min":0.81000000000000005},"min":{"1min":0.63900000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.1160000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.97499999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.73599999999999999,"15min":0.70699999999999996},"min":{"1min":0.68200000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0289999999999999,"5min":1.093,"15min":1.093},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2130000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.165}]},{"osd":4,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.093,"15min":1.127},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.4119999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.012,"15min":0.996},"min":{"1min":0.76400000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0680000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.083,"15min":1.093},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4450000000000001,"5min":1.546,"15min":1.546},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.1779999999999999,"15min":1.2},"min":{"1min":0.95499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.429,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.347}]},{"osd":6,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1539999999999999,"15min":1.1719999999999999},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.4470000000000001,"5min":1.869,"15min":1.869},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.2310000000000001,"15min":1.248},"min":{"1min":1.087,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.512,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.2470000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:34 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1379999999999999,"15min":1.1200000000000001},"min":{"1min":1.0169999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.403,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.218},{"interface":"front","average":{"1min":1.242,"5min":1.252,"15min":1.258},"min":{"1min":0.96799999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.542,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.538}]}]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297928,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":577536,"data_stored":243687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98499999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.76100000000000001},"min":{"1min":0.59499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.621}]},{"osd":2,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.46300000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1279999999999999,"5min":1.304,"15min":1.304},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.79400000000000004,"15min":0.77400000000000002},"min":{"1min":0.59899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.1479999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.84399999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73499999999999999,"15min":0.72099999999999997},"min":{"1min":0.53600000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.002,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91900000000000004,"15min":0.90700000000000003},"min":{"1min":0.68799999999999994,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.242,"5min":1.617,"15min":1.617},"last":0.79200000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0569999999999999,"15min":1.0580000000000001},"min":{"1min":0.80100000000000005,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.3,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.0860000000000001,"15min":1.103},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.357,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.071}]},{"osd":5,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.0600000000000001,"15min":1.0620000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.2969999999999999,"5min":1.53,"15min":1.53},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.177,"15min":1.1830000000000001},"min":{"1min":0.81499999999999995,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5029999999999999,"5min":2.226,"15min":2.226},"last":1.02}]},{"osd":6,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.92800000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4139999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.173},{"interface":"front","average":{"1min":1.228,"5min":1.1919999999999999,"15min":1.1719999999999999},"min":{"1min":0.98499999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.452,"5min":1.752,"15min":1.752},"last":1.2669999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:27:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.266,"15min":1.2569999999999999},"min":{"1min":1.0269999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.518,"5min":2.419,"15min":2.419},"last":1.121},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.222,"15min":1.2170000000000001},"min":{"1min":0.91600000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.478,"5min":2.274,"15min":2.274},"last":1.244}]}]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302660,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069180,"statfs":{"total":96636764160,"available":96326840320,"internally_reserved":0,"allocated":1171456,"data_stored":834055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.72599999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.90800000000000003,"15min":0.91100000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1519999999999999,"5min":2.0089999999999999,"15min":2.0089999999999999},"last":0.97599999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.88100000000000001,"15min":0.877},"min":{"1min":0.626,"5min":0.505,"15min":0.505},"max":{"1min":1.0649999999999999,"5min":1.268,"15min":1.268},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.165,"5min":1.2,"15min":1.2},"last":0.65300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89700000000000002,"15min":0.873},"min":{"1min":0.63200000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.2070000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95699999999999996,"15min":0.97899999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.2070000000000001,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.012}]},{"osd":3,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.94599999999999995,"15min":0.95199999999999996},"min":{"1min":0.74099999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.044},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.997,"15min":0.98699999999999999},"min":{"1min":0.81000000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.242,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":0.89800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.93000000000000005,"15min":0.93500000000000005},"min":{"1min":0.64100000000000001,"5min":0.621,"15min":0.621},"max":{"1min":1.153,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0680000000000001,"15min":1.0720000000000001},"min":{"1min":0.76900000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.1399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0289999999999999,"15min":1.0309999999999999},"min":{"1min":0.67200000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.173,"5min":2.141,"15min":2.141},"last":1.101},{"interface":"front","average":{"1min":1.087,"5min":1.1479999999999999,"15min":1.147},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.2989999999999999,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":1.0780000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:27:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.137,"15min":1.1539999999999999},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.3029999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.226},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.161,"15min":1.157},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.274,"5min":2.226,"15min":2.226},"last":1.1779999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:24.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:28:24.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.258+0000 7f2712a3a700 1 Processor -- start 2024-08-17T02:28:24.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.258+0000 7f2712a3a700 1 -- start start 2024-08-17T02:28:24.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.258+0000 7f2712a3a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270c157080 0x7f270c0b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.258+0000 7f2712a3a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f270c0cc670 0x7f270c0af570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.258+0000 7f2712a3a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270c0af0e0 con 0x7f270c069ec0 2024-08-17T02:28:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.258+0000 7f2712a3a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270c157450 con 0x7f270c0cc670 2024-08-17T02:28:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.258+0000 7f2712a3a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270c0b0e10 con 0x7f270c157080 2024-08-17T02:28:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2711237700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f270c0cc670 0x7f270c0af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2711a38700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270c157080 0x7f270c0b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2712239700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f270c069ec0 0x7f270c0c97f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:46900/0 (socket says 172.21.15.31:46900) 2024-08-17T02:28:24.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2712239700 1 -- 172.21.15.31:0/4130353549 learned_addr learned my addr 172.21.15.31:0/4130353549 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:24.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2711237700 1 -- 172.21.15.31:0/4130353549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270c157080 msgr2=0x7f270c0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2711237700 1 --2- 172.21.15.31:0/4130353549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270c157080 0x7f270c0b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2711237700 1 -- 172.21.15.31:0/4130353549 >> v1:172.21.15.92:6789/0 conn(0x7f270c069ec0 legacy=0x7f270c0c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2710a36700 1 -- 172.21.15.31:0/4130353549 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129742840 0 0) 0x7f270c0af0e0 con 0x7f270c069ec0 2024-08-17T02:28:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2711237700 1 -- 172.21.15.31:0/4130353549 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c0b10f0 con 0x7f270c0cc670 2024-08-17T02:28:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2711237700 1 --2- 172.21.15.31:0/4130353549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f270c0cc670 0x7f270c0af570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f27080098e0 tx=0x7f27080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9f3357254aa2897 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2710a36700 1 -- 172.21.15.31:0/4130353549 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800b640 con 0x7f270c0cc670 2024-08-17T02:28:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2710a36700 1 -- 172.21.15.31:0/4130353549 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270800b7a0 con 0x7f270c0cc670 2024-08-17T02:28:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2710a36700 1 -- 172.21.15.31:0/4130353549 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800bb40 con 0x7f270c0cc670 2024-08-17T02:28:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2712a3a700 1 -- 172.21.15.31:0/4130353549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f270c0cc670 msgr2=0x7f270c0af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2712a3a700 1 --2- 172.21.15.31:0/4130353549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f270c0cc670 0x7f270c0af570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f27080098e0 tx=0x7f27080091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2712a3a700 1 -- 172.21.15.31:0/4130353549 shutdown_connections 2024-08-17T02:28:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2712a3a700 1 --2- 172.21.15.31:0/4130353549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f270c0cc670 0x7f270c0af570 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2712a3a700 1 --2- 172.21.15.31:0/4130353549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270c157080 0x7f270c0b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2712a3a700 1 -- 172.21.15.31:0/4130353549 >> 172.21.15.31:0/4130353549 conn(0x7f270c067e90 msgr2=0x7f270c0cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2712a3a700 1 -- 172.21.15.31:0/4130353549 shutdown_connections 2024-08-17T02:28:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.262+0000 7f2712a3a700 1 -- 172.21.15.31:0/4130353549 wait complete. 2024-08-17T02:28:24.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712a3a700 1 Processor -- start 2024-08-17T02:28:24.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712a3a700 1 -- start start 2024-08-17T02:28:24.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712a3a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270c069ec0 0x7f270c16a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712a3a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f270c0cc670 0x7f270c150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712a3a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f270c157080 0x7f270c148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712a3a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c0a9880 con 0x7f270c157080 2024-08-17T02:28:24.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712a3a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c0aa3c0 con 0x7f270c0cc670 2024-08-17T02:28:24.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712a3a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270c0a9a90 con 0x7f270c069ec0 2024-08-17T02:28:24.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712239700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f270c157080 0x7f270c148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712239700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f270c157080 0x7f270c148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51120/0 (socket says 172.21.15.31:51120) 2024-08-17T02:28:24.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712239700 1 -- 172.21.15.31:0/951489591 learned_addr learned my addr 172.21.15.31:0/951489591 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:24.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2711237700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f270c0cc670 0x7f270c150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2711a38700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270c069ec0 0x7f270c16a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712239700 1 -- 172.21.15.31:0/951489591 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270c069ec0 msgr2=0x7f270c16a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712239700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270c069ec0 0x7f270c16a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712239700 1 -- 172.21.15.31:0/951489591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f270c0cc670 msgr2=0x7f270c150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712239700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f270c0cc670 0x7f270c150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712239700 1 -- 172.21.15.31:0/951489591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708009420 con 0x7f270c157080 2024-08-17T02:28:24.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712239700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f270c157080 0x7f270c148660 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f270400cc10 tx=0x7f2704001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f26fdffb700 1 -- 172.21.15.31:0/951489591 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400a850 con 0x7f270c157080 2024-08-17T02:28:24.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f26fdffb700 1 -- 172.21.15.31:0/951489591 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270400a9d0 con 0x7f270c157080 2024-08-17T02:28:24.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712a3a700 1 -- 172.21.15.31:0/951489591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270c0a9d70 con 0x7f270c157080 2024-08-17T02:28:24.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f26fdffb700 1 -- 172.21.15.31:0/951489591 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400ad90 con 0x7f270c157080 2024-08-17T02:28:24.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.266+0000 7f2712a3a700 1 -- 172.21.15.31:0/951489591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270c14d5a0 con 0x7f270c157080 2024-08-17T02:28:24.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.270+0000 7f2712a3a700 1 -- 172.21.15.31:0/951489591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270c0aa550 con 0x7f270c157080 2024-08-17T02:28:24.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.270+0000 7f26fdffb700 1 -- 172.21.15.31:0/951489591 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f2704007300 con 0x7f270c157080 2024-08-17T02:28:24.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.270+0000 7f26fdffb700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f26f0060860 0x7f26f0062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.270+0000 7f26fdffb700 1 -- 172.21.15.31:0/951489591 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f270407cb70 con 0x7f270c157080 2024-08-17T02:28:24.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.270+0000 7f2711a38700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f26f0060860 0x7f26f0062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.270+0000 7f2711a38700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f26f0060860 0x7f26f0062d10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2700009db0 tx=0x7f27000091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.278+0000 7f26fdffb700 1 -- 172.21.15.31:0/951489591 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f270404d2e0 con 0x7f270c157080 2024-08-17T02:28:24.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.446+0000 7f2712a3a700 1 -- 172.21.15.31:0/951489591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f270c0712b0 con 0x7f270c157080 2024-08-17T02:28:24.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.450+0000 7f26fdffb700 1 -- 172.21.15.31:0/951489591 <== mon.0 v2:172.21.15.31:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f270404d2e0 con 0x7f270c157080 2024-08-17T02:28:24.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.454+0000 7f26fdffb700 1 -- 172.21.15.31:0/951489591 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2704050900 con 0x7f270c157080 2024-08-17T02:28:24.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 -- 172.21.15.31:0/951489591 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f26f0060860 msgr2=0x7f26f0062d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f26f0060860 0x7f26f0062d10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2700009db0 tx=0x7f27000091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 -- 172.21.15.31:0/951489591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f270c157080 msgr2=0x7f270c148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f270c157080 0x7f270c148660 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f270400cc10 tx=0x7f2704001970 comp rx=0 tx=0).stop 2024-08-17T02:28:24.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 -- 172.21.15.31:0/951489591 shutdown_connections 2024-08-17T02:28:24.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f26f0060860 0x7f26f0062d10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f270c157080 0x7f270c148660 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f270c0cc670 0x7f270c150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 --2- 172.21.15.31:0/951489591 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270c069ec0 0x7f270c16a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 -- 172.21.15.31:0/951489591 >> 172.21.15.31:0/951489591 conn(0x7f270c067e90 msgr2=0x7f270c0adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 -- 172.21.15.31:0/951489591 shutdown_connections 2024-08-17T02:28:24.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.458+0000 7f2712a3a700 1 -- 172.21.15.31:0/951489591 wait complete. 2024-08-17T02:28:24.476 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:28:24.476 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:24.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.574+0000 7f27cf59e700 1 Processor -- start 2024-08-17T02:28:24.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cf59e700 1 -- start start 2024-08-17T02:28:24.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cf59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27d006b710 0x7f27d006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cf59e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f27d01405d0 0x7f27d0140a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cf59e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d00ca260 con 0x7f27d00cda20 2024-08-17T02:28:24.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cf59e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00c8ce0 con 0x7f27d01405d0 2024-08-17T02:28:24.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cf59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0140f90 con 0x7f27d006b710 2024-08-17T02:28:24.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27ced9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f27d01405d0 0x7f27d0140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27c5d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f27d00cda20 0x7f27d00c85d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.31:46904/0 (socket says 172.21.15.31:46904) 2024-08-17T02:28:24.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27ced9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f27d01405d0 0x7f27d0140a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.31:41356/0 (socket says 172.21.15.31:41356) 2024-08-17T02:28:24.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27c5d9b700 1 -- 172.21.15.31:0/3253380722 learned_addr learned my addr 172.21.15.31:0/3253380722 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-08-17T02:28:24.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27ce59c700 1 --2- 172.21.15.31:0/3253380722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27d006b710 0x7f27d006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cdd9b700 1 -- 172.21.15.31:0/3253380722 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002226759 0 0) 0x7f27d00ca260 con 0x7f27d00cda20 2024-08-17T02:28:24.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cdd9b700 1 -- 172.21.15.31:0/3253380722 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27bc003570 con 0x7f27d00cda20 2024-08-17T02:28:24.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27ced9d700 1 -- 172.21.15.31:0/3253380722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27d006b710 msgr2=0x7f27d006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27ced9d700 1 --2- 172.21.15.31:0/3253380722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27d006b710 0x7f27d006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27ced9d700 1 -- 172.21.15.31:0/3253380722 >> v1:172.21.15.92:6789/0 conn(0x7f27d00cda20 legacy=0x7f27d00c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27ced9d700 1 -- 172.21.15.31:0/3253380722 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00ae710 con 0x7f27d01405d0 2024-08-17T02:28:24.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27ced9d700 1 --2- 172.21.15.31:0/3253380722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27d01405d0 0x7f27d0140a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009e90 tx=0x7f27c8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6330d89baaf7dd70 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cdd9b700 1 -- 172.21.15.31:0/3253380722 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c800e070 con 0x7f27d01405d0 2024-08-17T02:28:24.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cdd9b700 1 -- 172.21.15.31:0/3253380722 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f27c800bb40 con 0x7f27d01405d0 2024-08-17T02:28:24.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cdd9b700 1 -- 172.21.15.31:0/3253380722 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8012430 con 0x7f27d01405d0 2024-08-17T02:28:24.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cf59e700 1 -- 172.21.15.31:0/3253380722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27d01405d0 msgr2=0x7f27d0140a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.578+0000 7f27cf59e700 1 --2- 172.21.15.31:0/3253380722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27d01405d0 0x7f27d0140a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009e90 tx=0x7f27c8009780 comp rx=0 tx=0).stop 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 -- 172.21.15.31:0/3253380722 shutdown_connections 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 --2- 172.21.15.31:0/3253380722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27d01405d0 0x7f27d0140a50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 --2- 172.21.15.31:0/3253380722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27d006b710 0x7f27d006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 -- 172.21.15.31:0/3253380722 >> 172.21.15.31:0/3253380722 conn(0x7f27d00cdf90 msgr2=0x7f27d00ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 -- 172.21.15.31:0/3253380722 shutdown_connections 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 -- 172.21.15.31:0/3253380722 wait complete. 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 Processor -- start 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 -- start start 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27d006b710 0x7f27d00c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d00cda20 0x7f27d013d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27d01405d0 0x7f27d00b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00b3c60 con 0x7f27d00cda20 2024-08-17T02:28:24.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0068740 con 0x7f27d01405d0 2024-08-17T02:28:24.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27cf59e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00b33c0 con 0x7f27d006b710 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27c5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d00cda20 0x7f27d013d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27c5d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d00cda20 0x7f27d013d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51132/0 (socket says 172.21.15.31:51132) 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27c5d9b700 1 -- 172.21.15.31:0/2964993249 learned_addr learned my addr 172.21.15.31:0/2964993249 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27ce59c700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27d006b710 0x7f27d00c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.582+0000 7f27ced9d700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27d01405d0 0x7f27d00b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27c5d9b700 1 -- 172.21.15.31:0/2964993249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27d006b710 msgr2=0x7f27d00c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27c5d9b700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27d006b710 0x7f27d00c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27c5d9b700 1 -- 172.21.15.31:0/2964993249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27d01405d0 msgr2=0x7f27d00b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27c5d9b700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27d01405d0 0x7f27d00b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27c5d9b700 1 -- 172.21.15.31:0/2964993249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c8009a20 con 0x7f27d00cda20 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27c5d9b700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d00cda20 0x7f27d013d300 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f27b800c7c0 tx=0x7f27b8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27c6ffd700 1 -- 172.21.15.31:0/2964993249 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8005cd0 con 0x7f27d00cda20 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27c6ffd700 1 -- 172.21.15.31:0/2964993249 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f27b8005e30 con 0x7f27d00cda20 2024-08-17T02:28:24.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27cf59e700 1 -- 172.21.15.31:0/2964993249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d00b36a0 con 0x7f27d00cda20 2024-08-17T02:28:24.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27c6ffd700 1 -- 172.21.15.31:0/2964993249 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8007340 con 0x7f27d00cda20 2024-08-17T02:28:24.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27cf59e700 1 -- 172.21.15.31:0/2964993249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d00b30b0 con 0x7f27d00cda20 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27cf59e700 1 -- 172.21.15.31:0/2964993249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d0068510 con 0x7f27d00cda20 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.586+0000 7f27c6ffd700 1 -- 172.21.15.31:0/2964993249 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 80143+0+0 (secure 0 0 0) 0x7f27b801b3b0 con 0x7f27d00cda20 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.590+0000 7f27c6ffd700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f27b0060890 0x7f27b0062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.590+0000 7f27ce59c700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f27b0060890 0x7f27b0062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.590+0000 7f27c6ffd700 1 -- 172.21.15.31:0/2964993249 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f27b807bf80 con 0x7f27d00cda20 2024-08-17T02:28:24.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.590+0000 7f27ce59c700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f27b0060890 0x7f27b0062d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009d10 tx=0x7f27c00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.594+0000 7f27c6ffd700 1 -- 172.21.15.31:0/2964993249 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169067 (secure 0 0 0) 0x7f27d0068510 con 0x7f27d00cda20 2024-08-17T02:28:24.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.798+0000 7f27cf59e700 1 -- 172.21.15.31:0/2964993249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27d0068510 con 0x7f27d00cda20 2024-08-17T02:28:24.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.798+0000 7f27c6ffd700 1 -- 172.21.15.31:0/2964993249 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3528 (secure 0 0 0) 0x7f27d0068510 con 0x7f27d00cda20 2024-08-17T02:28:24.805 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-08-17T02:28:24.805 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1920530016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1920530016},{"type":"v1","addr":"172.21.15.92:6833","nonce":1920530016}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3381009547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3381009547},{"type":"v1","addr":"172.21.15.92:6835","nonce":3381009547}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5406,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1337392645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1337392645},{"type":"v1","addr":"172.21.15.31:6837","nonce":1337392645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5487,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/4010463645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":4010463645},{"type":"v1","addr":"172.21.15.31:6836","nonce":4010463645}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2024-08-17T02:28:24.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 -- 172.21.15.31:0/2964993249 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f27b0060890 msgr2=0x7f27b0062d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f27b0060890 0x7f27b0062d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009d10 tx=0x7f27c00091a0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 -- 172.21.15.31:0/2964993249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d00cda20 msgr2=0x7f27d013d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d00cda20 0x7f27d013d300 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f27b800c7c0 tx=0x7f27b8007e00 comp rx=0 tx=0).stop 2024-08-17T02:28:24.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 -- 172.21.15.31:0/2964993249 shutdown_connections 2024-08-17T02:28:24.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.31:6832/24030,v1:172.21.15.31:6833/24030] conn(0x7f27b0060890 0x7f27b0062d40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27d01405d0 0x7f27d00b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d00cda20 0x7f27d013d300 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 --2- 172.21.15.31:0/2964993249 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f27d006b710 0x7f27d00c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 -- 172.21.15.31:0/2964993249 >> 172.21.15.31:0/2964993249 conn(0x7f27d00cdf90 msgr2=0x7f27d00ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 -- 172.21.15.31:0/2964993249 shutdown_connections 2024-08-17T02:28:24.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-08-17T02:28:24.802+0000 7f27cf59e700 1 -- 172.21.15.31:0/2964993249 wait complete. 2024-08-17T02:28:24.810 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 21 2024-08-17T02:28:24.820 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:28:24.820 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:28:24.821 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:28:24.821 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:24.831 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:28:24.832 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:28:24.832 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:24.848 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:28:24.849 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:28:24.849 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:24.864 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:28:24.864 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:28:24.864 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:24.924 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:28:24.925 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:28:24.925 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:28:24.925 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.007 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:28:25.007 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:28:25.007 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.076 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:28:25.077 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.136 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:28:25.136 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:28:25.136 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:25.205 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:28:25.205 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:28:25.206 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:30.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-08-17T02:28:31.308 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:28:31.308 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:28:31.309 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:31.366 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:28:31.366 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:28:31.366 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:31.464 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:28:31.465 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:28:31.465 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:31.537 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:28:31.537 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:28:31.537 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:28:31.537 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:31.568 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:28:31.568 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:28:31.568 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:31.599 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:28:31.599 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:28:31.599 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:28:31.599 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:31.631 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:28:31.631 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:28:31.632 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:31.650 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:28:31.650 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:28:31.651 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:31.711 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:28:31.711 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:28:31.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:28:31.736 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:28:31.736 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:28:32.158 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:28:32.159 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:28:32.353 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:28:32.353 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:28:32.511 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:28:32.512 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:28:32.795 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:28:32.795 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:28:33.186 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:28:33.187 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:28:33.406 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:28:33.406 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:28:33.567 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:28:33.567 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:28:33.768 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:28:33.769 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255/data/mon.a.tgz 2024-08-17T02:28:33.769 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-08-17T02:28:33.776 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.pFti75DniH 2024-08-17T02:28:33.776 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.pFti75DniH 2024-08-17T02:28:33.906 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.pFti75DniH 2024-08-17T02:28:33.924 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.pFti75DniH is 324KB 2024-08-17T02:28:33.985 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.pFti75DniH 2024-08-17T02:28:33.991 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255/data/mon.b.tgz 2024-08-17T02:28:33.992 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-08-17T02:28:33.999 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.a0c2qLnv1W 2024-08-17T02:28:33.999 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.a0c2qLnv1W 2024-08-17T02:28:34.106 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.a0c2qLnv1W 2024-08-17T02:28:34.167 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.a0c2qLnv1W is 427KB 2024-08-17T02:28:34.231 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.a0c2qLnv1W 2024-08-17T02:28:34.238 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255/data/mon.c.tgz 2024-08-17T02:28:34.238 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-08-17T02:28:34.245 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.oXf2FdLpAC 2024-08-17T02:28:34.245 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.oXf2FdLpAC 2024-08-17T02:28:34.349 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.oXf2FdLpAC 2024-08-17T02:28:34.372 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.oXf2FdLpAC is 426KB 2024-08-17T02:28:34.435 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.oXf2FdLpAC 2024-08-17T02:28:34.442 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:28:34.442 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:28:34.444 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:28:34.458 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:28:34.458 DEBUG:teuthology.orchestra.run.smithi031:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:28:34.504 DEBUG:teuthology.orchestra.run.smithi092:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:28:34.540 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:28:34.541 INFO:teuthology.orchestra.run.smithi092.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:28:34.548 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:28:34.550 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255/remote/smithi031/crash 2024-08-17T02:28:34.551 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:28:34.567 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255/remote/smithi092/crash 2024-08-17T02:28:34.567 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:28:34.584 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:28:34.584 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:34.587 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:34.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:34.729 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:34.744 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:28:34.745 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:28:34.747 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:28:34.770 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35104.log 2024-08-17T02:28:34.770 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33418.log 2024-08-17T02:28:34.771 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30323.log 2024-08-17T02:28:34.771 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35104.log.gz 2024-08-17T02:28:34.772 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33839.log 2024-08-17T02:28:34.772 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33418.log: /var/log/ceph/ceph-client.admin.30323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31322.log 2024-08-17T02:28:34.773 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33418.log.gz 2024-08-17T02:28:34.773 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35681.log 2024-08-17T02:28:34.774 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30323.log.gz 2024-08-17T02:28:34.774 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33839.log: /var/log/ceph/ceph-client.admin.31322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32867.log 2024-08-17T02:28:34.774 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34134.log 2024-08-17T02:28:34.774 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35681.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33839.log.gz 2024-08-17T02:28:34.774 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31322.log.gz 2024-08-17T02:28:34.776 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34254.log 2024-08-17T02:28:34.776 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35681.log.gz 2024-08-17T02:28:34.776 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34915.log 2024-08-17T02:28:34.776 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34134.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32867.log.gz 2024-08-17T02:28:34.776 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30404.log 2024-08-17T02:28:34.776 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34134.log.gz 2024-08-17T02:28:34.777 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34254.log.gz 2024-08-17T02:28:34.777 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32894.log 2024-08-17T02:28:34.778 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32921.log 2024-08-17T02:28:34.778 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30404.log: /var/log/ceph/ceph-client.admin.32894.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34915.log.gz 2024-08-17T02:28:34.778 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33619.log 2024-08-17T02:28:34.778 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32894.log.gz 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30404.log.gz 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30064.log 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:28:34.780 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24298.log 2024-08-17T02:28:34.782 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33619.log: gzip 88.6%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.32921.log.gz/var/log/ceph/ceph-client.admin.32583.log 2024-08-17T02:28:34.782 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-08-17T02:28:34.782 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35708.log 2024-08-17T02:28:34.783 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mon.a.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33619.log.gz 2024-08-17T02:28:34.783 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30673.log 2024-08-17T02:28:34.783 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30064.log.gz 2024-08-17T02:28:34.783 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32583.log.gz 2024-08-17T02:28:34.783 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31376.log 2024-08-17T02:28:34.783 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29814.log 2024-08-17T02:28:34.783 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33812.log 2024-08-17T02:28:34.784 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35708.log.gz 2024-08-17T02:28:34.784 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31376.log: /var/log/ceph/ceph-client.admin.29814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30669.log 2024-08-17T02:28:34.784 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30673.log.gz 2024-08-17T02:28:34.784 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29814.log.gz 2024-08-17T02:28:34.784 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31376.log.gz 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24243.log 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.24298.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi092.stderr:gzip /var/log/ceph/ceph-client.admin.24243.log: -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi092.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24298.log.gz 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi092.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24243.log.gz 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24326.log 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24193.log 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.24326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24271.log 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.24193.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24326.log.gz 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24379.log 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi092.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24193.log.gz 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.24271.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 92.6% 2024-08-17T02:28:34.793 INFO:teuthology.orchestra.run.smithi092.stderr: -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:28:34.793 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.24379.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24271.log.gz 2024-08-17T02:28:34.793 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.30344.log 2024-08-17T02:28:34.793 INFO:teuthology.orchestra.run.smithi092.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.24379.log.gz 2024-08-17T02:28:34.793 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:28:34.793 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.1.30344.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mon.c.log: 95.4% -- replaced with /var/log/ceph/ceph-client.1.30344.log.gz 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24218.log 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.30198.log 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.24218.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.24218.log.gz 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi092.stderr: 93.3% 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi092.stderr: -- replaced with /var/log/ceph/ceph-mgr.x.log.gz/var/log/ceph/ceph-client.3.30198.log: 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mds.b.log: 88.7% -- replaced with /var/log/ceph/ceph-client.3.30198.log.gz 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.30083.log 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24353.log 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.1.30083.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:28:34.802 INFO:teuthology.orchestra.run.smithi092.stderr: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:28:34.802 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.24353.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.24353.log.gz 2024-08-17T02:28:34.802 INFO:teuthology.orchestra.run.smithi092.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.1.30083.log.gz 2024-08-17T02:28:34.809 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33812.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33812.log.gz 2024-08-17T02:28:34.809 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35627.log 2024-08-17T02:28:34.810 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35438.log 2024-08-17T02:28:34.810 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30669.log.gz 2024-08-17T02:28:34.810 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30485.log 2024-08-17T02:28:34.810 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35627.log.gz 2024-08-17T02:28:34.810 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:28:34.810 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35438.log: /var/log/ceph/ceph-client.admin.30485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35600.log 2024-08-17T02:28:34.810 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.admin.30485.log.gz 2024-08-17T02:28:34.811 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35438.log.gz 2024-08-17T02:28:34.811 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32394.log 2024-08-17T02:28:34.811 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35600.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35600.log.gz 2024-08-17T02:28:34.811 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33731.log 2024-08-17T02:28:34.811 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32691.log 2024-08-17T02:28:34.811 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35303.log 2024-08-17T02:28:34.811 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32394.log.gz 2024-08-17T02:28:34.811 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30620.log 2024-08-17T02:28:34.812 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33731.log.gz 2024-08-17T02:28:34.812 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32691.log.gz 2024-08-17T02:28:34.812 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35303.log: /var/log/ceph/ceph-client.admin.30458.log 2024-08-17T02:28:34.812 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32610.log 2024-08-17T02:28:34.812 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35303.log.gz 2024-08-17T02:28:34.812 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:28:34.812 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30620.log.gz 2024-08-17T02:28:34.812 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34572.log 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32610.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30458.log.gz 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34996.log 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32610.log.gz 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29982.log 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34572.log.gz 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32975.log 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34996.log: /var/log/ceph/ceph-client.admin.29982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34599.log 2024-08-17T02:28:34.814 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34996.log.gz 2024-08-17T02:28:34.814 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32475.log 2024-08-17T02:28:34.814 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29982.log.gz 2024-08-17T02:28:34.814 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31102.log 2024-08-17T02:28:34.814 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34599.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32975.log.gz 2024-08-17T02:28:34.814 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 /var/log/ceph/ceph-client.admin.32475.log: --verbose -- /var/log/ceph/ceph-client.admin.30890.log 2024-08-17T02:28:34.814 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34599.log.gz 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29882.log 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31102.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32475.log.gz 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30890.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31102.log.gz 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34383.log 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30890.log.gz 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.29882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30240.log 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32637.log 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34383.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29882.log.gz 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33002.log 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30240.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34383.log.gz 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30512.log 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32637.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30240.log.gz 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30671.log 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33002.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32637.log.gz 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32813.log 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30512.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33002.log.gz 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30674.log 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30671.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30512.log.gz 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32813.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30671.log.gz 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32813.log.gz 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32367.log 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31430.log 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34491.log 2024-08-17T02:28:34.818 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32367.log: 88.1%/var/log/ceph/ceph-client.admin.31430.log: -- replaced with /var/log/ceph/ceph-client.admin.30674.log.gz 2024-08-17T02:28:34.818 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32367.log.gz 2024-08-17T02:28:34.818 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31430.log.gz 2024-08-17T02:28:34.818 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:28:34.818 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32529.log 2024-08-17T02:28:34.818 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mgr.y.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34491.log.gz 2024-08-17T02:28:34.818 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30891.log 2024-08-17T02:28:34.818 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35357.log 2024-08-17T02:28:34.819 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32529.log: /var/log/ceph/ceph-client.admin.30891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35895.log 2024-08-17T02:28:34.819 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32529.log.gz 2024-08-17T02:28:34.819 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35357.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30891.log.gz 2024-08-17T02:28:34.819 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35357.log.gz 2024-08-17T02:28:34.819 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34161.log 2024-08-17T02:28:34.819 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35895.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35895.log.gz 2024-08-17T02:28:34.819 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30037.log 2024-08-17T02:28:34.819 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34161.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34161.log.gz 2024-08-17T02:28:34.820 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32061.log 2024-08-17T02:28:34.820 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30205.log 2024-08-17T02:28:34.820 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30037.log: /var/log/ceph/ceph-client.admin.32061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35276.log 2024-08-17T02:28:34.820 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30037.log.gz 2024-08-17T02:28:34.820 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31703.log 2024-08-17T02:28:34.820 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32061.log.gz 2024-08-17T02:28:34.820 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30670.log 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35276.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30205.log.gz 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31703.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35276.log.gz 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi031.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.31703.log.gz 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35573.log 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31457.log 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30670.log.gz 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33920.log 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1%/var/log/ceph/ceph-client.admin.31457.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.35573.log.gz 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi031.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.31920.log 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31457.log.gz 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33920.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33920.log.gz 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi031.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:28:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34281.log 2024-08-17T02:28:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34807.log 2024-08-17T02:28:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31920.log: /var/log/ceph/ceph-client.admin.34281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34437.log 2024-08-17T02:28:34.837 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31920.log.gz 2024-08-17T02:28:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34807.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34281.log.gz 2024-08-17T02:28:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35868.log 2024-08-17T02:28:34.837 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34807.log.gz 2024-08-17T02:28:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32759.log 2024-08-17T02:28:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34437.log: /var/log/ceph/ceph-client.admin.35868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33530.log 2024-08-17T02:28:34.838 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34437.log.gz 2024-08-17T02:28:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32759.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35868.log.gz 2024-08-17T02:28:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33175.log 2024-08-17T02:28:34.838 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32759.log.gzgzip 2024-08-17T02:28:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.32259.log 2024-08-17T02:28:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33530.log: /var/log/ceph/ceph-client.admin.33175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35023.log 2024-08-17T02:28:34.839 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1%/var/log/ceph/ceph-client.admin.32259.log: gzip 88.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.33530.log.gz--verbose 2024-08-17T02:28:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.30883.log 2024-08-17T02:28:34.839 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33175.log.gz 2024-08-17T02:28:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31676.log 2024-08-17T02:28:34.839 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32259.log.gz 2024-08-17T02:28:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- 88.2%/var/log/ceph/ceph-client.admin.31484.log -- replaced with /var/log/ceph/ceph-client.admin.35023.log.gz 2024-08-17T02:28:34.839 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-08-17T02:28:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30883.log: /var/log/ceph/ceph-client.admin.31676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33337.log 2024-08-17T02:28:34.840 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30883.log.gz 2024-08-17T02:28:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31484.log: gzip -5 --verbose 88.2%-- -- replaced with /var/log/ceph/ceph-client.admin.31676.log.gz 2024-08-17T02:28:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30176.log 2024-08-17T02:28:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30884.log 2024-08-17T02:28:34.840 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31484.log.gz 2024-08-17T02:28:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:28:34.840 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33337.log.gz 2024-08-17T02:28:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30176.log: /var/log/ceph/ceph-client.admin.30884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34056.log 2024-08-17T02:28:34.841 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30176.log.gz 2024-08-17T02:28:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30884.log.gzgzip 2024-08-17T02:28:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.33445.log 2024-08-17T02:28:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.0.34056.log: -- /var/log/ceph/ceph-client.admin.30091.log 2024-08-17T02:28:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33229.log 2024-08-17T02:28:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33445.log: /var/log/ceph/ceph-client.admin.30091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35546.log 2024-08-17T02:28:34.841 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33445.log.gz 2024-08-17T02:28:34.841 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30091.log.gz 2024-08-17T02:28:34.841 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33229.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33229.log.gz 2024-08-17T02:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.34056.log.gz 2024-08-17T02:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34518.log 2024-08-17T02:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33391.log 2024-08-17T02:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:gzip /var/log/ceph/ceph-client.admin.34518.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24029.log 2024-08-17T02:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35546.log.gz 2024-08-17T02:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31870.log 2024-08-17T02:28:34.842 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34518.log.gz 2024-08-17T02:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33391.log: /var/log/ceph/ceph-client.admin.24029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30431.log 2024-08-17T02:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33391.log.gz 2024-08-17T02:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33102.log 2024-08-17T02:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.31870.log: 92.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35519.log 2024-08-17T02:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30431.log: -- replaced with /var/log/ceph/ceph-client.admin.24029.log.gz 2024-08-17T02:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31565.log 2024-08-17T02:28:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33102.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30431.log.gz 2024-08-17T02:28:34.844 INFO:teuthology.orchestra.run.smithi031.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.31870.log.gz 2024-08-17T02:28:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35519.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33102.log.gz 2024-08-17T02:28:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31087.log 2024-08-17T02:28:34.844 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35519.log.gz 2024-08-17T02:28:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30118.log 2024-08-17T02:28:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32732.log 2024-08-17T02:28:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31087.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31565.log.gz 2024-08-17T02:28:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30377.log 2024-08-17T02:28:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30118.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31087.log.gz 2024-08-17T02:28:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30593.log 2024-08-17T02:28:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32732.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30118.log.gz 2024-08-17T02:28:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33364.log 2024-08-17T02:28:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30377.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32732.log.gz 2024-08-17T02:28:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35465.log 2024-08-17T02:28:34.845 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30377.log.gz 2024-08-17T02:28:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32088.log 2024-08-17T02:28:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33364.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30593.log.gz 2024-08-17T02:28:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31295.log 2024-08-17T02:28:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35465.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33364.log.gz 2024-08-17T02:28:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33893.log 2024-08-17T02:28:34.846 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35465.log.gz 2024-08-17T02:28:34.846 INFO:teuthology.orchestra.run.smithi031.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.32088.log.gz 2024-08-17T02:28:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31099.log 2024-08-17T02:28:34.847 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31295.log: /var/log/ceph/ceph-client.admin.33893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32448.log 2024-08-17T02:28:34.847 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31099.log: 89.1%gzip -5 --verbose -- 89.0%/var/log/ceph/ceph-client.admin.31100.log 2024-08-17T02:28:34.847 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33893.log.gz 2024-08-17T02:28:34.847 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31295.log.gz 2024-08-17T02:28:34.847 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35411.log 2024-08-17T02:28:34.847 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31099.log.gz 2024-08-17T02:28:34.847 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31100.log: /var/log/ceph/ceph-client.admin.32232.log 2024-08-17T02:28:34.847 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32448.log.gz 2024-08-17T02:28:34.848 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:28:34.848 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35411.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31100.log.gz 2024-08-17T02:28:34.848 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35411.log.gz 2024-08-17T02:28:34.848 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30889.log 2024-08-17T02:28:34.848 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33592.log 2024-08-17T02:28:34.848 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32232.log.gz 2024-08-17T02:28:34.848 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32786.log 2024-08-17T02:28:34.849 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30350.log 2024-08-17T02:28:34.849 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33592.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30889.log.gz 2024-08-17T02:28:34.849 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32786.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33592.log.gz 2024-08-17T02:28:34.849 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32786.log.gz 2024-08-17T02:28:34.849 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34734.log 2024-08-17T02:28:34.849 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35206.log 2024-08-17T02:28:34.849 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30539.log 2024-08-17T02:28:34.849 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34734.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30350.log.gz 2024-08-17T02:28:34.850 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35206.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34734.log.gz 2024-08-17T02:28:34.850 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35206.log.gz 2024-08-17T02:28:34.876 INFO:teuthology.orchestra.run.smithi031.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:28:34.876 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35789.log 2024-08-17T02:28:34.876 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34410.log 2024-08-17T02:28:34.876 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30539.log: /var/log/ceph/ceph-client.admin.35789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31649.log 2024-08-17T02:28:34.877 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30539.log.gz 2024-08-17T02:28:34.877 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35735.log 2024-08-17T02:28:34.877 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35789.log.gz 2024-08-17T02:28:34.877 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34410.log: /var/log/ceph/ceph-client.admin.31649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35152.log 2024-08-17T02:28:34.877 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34410.log.gz 2024-08-17T02:28:34.877 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33758.log 2024-08-17T02:28:34.877 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31649.log.gz 2024-08-17T02:28:34.878 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35735.log: /var/log/ceph/ceph-client.admin.35152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30672.log 2024-08-17T02:28:34.878 INFO:teuthology.orchestra.run.smithi031.stderr:gzip 87.8%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.35735.log.gz-- 2024-08-17T02:28:34.878 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33947.log 2024-08-17T02:28:34.878 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35152.log.gz 2024-08-17T02:28:34.878 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33758.log: /var/log/ceph/ceph-client.admin.30672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24157.log 2024-08-17T02:28:34.878 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33758.log.gz 2024-08-17T02:28:34.878 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.30672.log.gz 2024-08-17T02:28:34.879 INFO:teuthology.orchestra.run.smithi031.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.34626.log 2024-08-17T02:28:34.879 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31622.log 2024-08-17T02:28:34.879 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.24157.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.19174.log 2024-08-17T02:28:34.879 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34626.log: 91.2% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.24157.log.gz 2024-08-17T02:28:34.879 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33947.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30886.log /var/log/ceph/ceph-client.admin.31622.log: 2024-08-17T02:28:34.879 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-08-17T02:28:34.879 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31622.log.gz 2024-08-17T02:28:34.879 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35843.log 2024-08-17T02:28:34.880 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.tmp-client.admin.19174.log: -- replaced with /var/log/ceph/ceph-client.admin.34626.log.gz 2024-08-17T02:28:34.880 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.19174.log.gz 2024-08-17T02:28:34.880 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31086.log 2024-08-17T02:28:34.880 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30886.log: /var/log/ceph/ceph-client.admin.35843.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30886.log.gz 2024-08-17T02:28:34.880 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35330.log 2024-08-17T02:28:34.880 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35843.log.gz 2024-08-17T02:28:34.880 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33202.log 2024-08-17T02:28:34.881 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35330.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31086.log.gz 2024-08-17T02:28:34.881 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30294.log 2024-08-17T02:28:34.881 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35330.log.gz 2024-08-17T02:28:34.881 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32664.log 2024-08-17T02:28:34.881 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31403.log 2024-08-17T02:28:34.881 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30294.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33202.log.gz 2024-08-17T02:28:34.881 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34707.log 2024-08-17T02:28:34.881 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30294.log.gz 2024-08-17T02:28:34.882 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33866.log 2024-08-17T02:28:34.882 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31403.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32664.log.gz 2024-08-17T02:28:34.882 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35077.log 2024-08-17T02:28:34.882 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34707.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31403.log.gz 2024-08-17T02:28:34.882 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33648.log 2024-08-17T02:28:34.882 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34707.log.gz 2024-08-17T02:28:34.882 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33866.log.gz 2024-08-17T02:28:34.882 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32421.log 2024-08-17T02:28:34.883 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33565.log 2024-08-17T02:28:34.883 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35077.log.gz 2024-08-17T02:28:34.883 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33075.log 2024-08-17T02:28:34.883 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32421.log: /var/log/ceph/ceph-client.admin.33565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35050.log 2024-08-17T02:28:34.883 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33648.log.gz 2024-08-17T02:28:34.883 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33075.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32421.log.gz 2024-08-17T02:28:34.883 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33565.log.gz 2024-08-17T02:28:34.883 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33075.log.gz 2024-08-17T02:28:34.884 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29916.log 2024-08-17T02:28:34.884 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32340.log 2024-08-17T02:28:34.884 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34680.log 2024-08-17T02:28:34.884 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.29916.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35050.log.gz 2024-08-17T02:28:34.884 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32840.log 2024-08-17T02:28:34.884 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32340.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29916.log.gz 2024-08-17T02:28:34.884 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32151.log 2024-08-17T02:28:34.884 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34680.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:28:34.884 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32340.log.gz 2024-08-17T02:28:34.885 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34780.log 2024-08-17T02:28:34.885 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34680.log.gz 2024-08-17T02:28:34.885 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.32151.log: -- /var/log/ceph/ceph-client.admin.33047.log 2024-08-17T02:28:34.885 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32840.log.gz 2024-08-17T02:28:34.885 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34215.log 2024-08-17T02:28:34.885 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32151.log.gz 2024-08-17T02:28:34.885 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34188.log 2024-08-17T02:28:34.886 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5%/var/log/ceph/ceph-client.admin.33047.log: -- replaced with /var/log/ceph/ceph-client.admin.34780.log.gz 2024-08-17T02:28:34.886 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34215.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:28:34.886 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33047.log.gz 2024-08-17T02:28:34.886 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34942.log 2024-08-17T02:28:34.886 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34188.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34215.log.gz 2024-08-17T02:28:34.886 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35492.log 2024-08-17T02:28:34.886 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34188.log.gz 2024-08-17T02:28:34.886 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32286.log 2024-08-17T02:28:34.887 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30887.log 2024-08-17T02:28:34.887 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35492.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30566.log 2024-08-17T02:28:34.887 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32286.log: -- replaced with /var/log/ceph/ceph-client.admin.34942.log.gz 2024-08-17T02:28:34.887 INFO:teuthology.orchestra.run.smithi031.stderr: 85.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:28:34.887 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:28:34.887 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30887.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35492.log.gz 2024-08-17T02:28:34.887 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32286.log.gz 2024-08-17T02:28:34.888 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35384.log 2024-08-17T02:28:34.888 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30887.log.gz 2024-08-17T02:28:34.888 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31106.log 2024-08-17T02:28:34.888 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3%/var/log/ceph/ceph-osd.0.log: -- replaced with /var/log/ceph/ceph-client.admin.30566.log.gz 2024-08-17T02:28:34.888 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31083.log 2024-08-17T02:28:34.888 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35384.log: /var/log/ceph/ceph-client.admin.31106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32948.log 2024-08-17T02:28:34.888 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35384.log.gz 2024-08-17T02:28:34.888 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31106.log.gz 2024-08-17T02:28:34.889 INFO:teuthology.orchestra.run.smithi031.stderr:gzip /var/log/ceph/ceph-client.admin.31083.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32124.log 2024-08-17T02:28:34.889 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33785.log 2024-08-17T02:28:34.889 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32948.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31083.log.gz 2024-08-17T02:28:34.889 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35762.log 2024-08-17T02:28:34.889 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32948.log.gz 2024-08-17T02:28:34.889 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32124.log.gz 2024-08-17T02:28:34.889 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30675.log 2024-08-17T02:28:34.889 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33472.log 2024-08-17T02:28:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35762.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33785.log.gz 2024-08-17T02:28:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24288.log 2024-08-17T02:28:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30675.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35762.log.gz 2024-08-17T02:28:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:gzip /var/log/ceph/ceph-client.admin.33472.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34861.log 2024-08-17T02:28:34.890 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30675.log.gz 2024-08-17T02:28:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:gzip /var/log/ceph/ceph-client.admin.24288.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32178.log 2024-08-17T02:28:34.890 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33472.log.gz 2024-08-17T02:28:34.890 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.24288.log.gz 2024-08-17T02:28:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33998.log 2024-08-17T02:28:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33256.log 2024-08-17T02:28:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32178.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34861.log.gz 2024-08-17T02:28:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33998.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32178.log.gz 2024-08-17T02:28:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31538.log 2024-08-17T02:28:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35816.log 2024-08-17T02:28:34.891 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33998.log.gz 2024-08-17T02:28:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31511.log 2024-08-17T02:28:34.892 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31538.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33256.log.gz 2024-08-17T02:28:34.892 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32205.log 2024-08-17T02:28:34.892 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31538.log.gz 2024-08-17T02:28:34.892 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35233.log 2024-08-17T02:28:34.892 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31511.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35816.log.gz 2024-08-17T02:28:34.892 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33501.log 2024-08-17T02:28:34.892 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32205.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31511.log.gz 2024-08-17T02:28:34.892 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33677.log 2024-08-17T02:28:34.893 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35233.log: /var/log/ceph/ceph-client.admin.33501.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32205.log.gz 2024-08-17T02:28:34.893 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34107.log 2024-08-17T02:28:34.893 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35233.log.gz 2024-08-17T02:28:34.893 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35654.log 2024-08-17T02:28:34.893 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33501.log.gz 2024-08-17T02:28:34.893 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34969.log 2024-08-17T02:28:34.893 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34107.log: 88.2%/var/log/ceph/ceph-client.admin.35654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34545.log 2024-08-17T02:28:34.893 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33677.log.gz 2024-08-17T02:28:34.894 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34107.log.gz 2024-08-17T02:28:34.894 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:28:34.894 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34969.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35654.log.gz 2024-08-17T02:28:34.894 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33283.log 2024-08-17T02:28:34.894 INFO:teuthology.orchestra.run.smithi031.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34969.log.gz 2024-08-17T02:28:34.894 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31759.log 2024-08-17T02:28:34.894 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.3.log: 88.3%/var/log/ceph/ceph-client.admin.33283.log: -- replaced with /var/log/ceph/ceph-client.admin.34545.log.gz 2024-08-17T02:28:34.895 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33704.log 2024-08-17T02:28:34.895 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33283.log.gz 2024-08-17T02:28:34.895 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33310.log 2024-08-17T02:28:34.895 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34310.log 2024-08-17T02:28:34.895 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33704.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31759.log.gz 2024-08-17T02:28:34.895 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34464.log 2024-08-17T02:28:34.895 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33310.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33704.log.gz 2024-08-17T02:28:34.895 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31595.log 2024-08-17T02:28:34.896 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34310.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33310.log.gz 2024-08-17T02:28:34.896 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34464.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34310.log.gz 2024-08-17T02:28:34.896 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30658.log 2024-08-17T02:28:34.896 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34464.log.gz 2024-08-17T02:28:34.896 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32313.log 2024-08-17T02:28:34.896 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31595.log.gz 2024-08-17T02:28:34.896 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30658.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30658.log.gz 2024-08-17T02:28:34.896 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32502.log 2024-08-17T02:28:34.897 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32556.log 2024-08-17T02:28:34.897 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.32313.log: /var/log/ceph/ceph-client.admin.32502.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32313.log.gz 2024-08-17T02:28:34.897 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32502.log.gz 2024-08-17T02:28:34.897 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30267.log 2024-08-17T02:28:34.897 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32556.log: /var/log/ceph/ceph-client.admin.30147.log 2024-08-17T02:28:34.897 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35179.log 2024-08-17T02:28:34.897 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30267.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32556.log.gz 2024-08-17T02:28:34.897 INFO:teuthology.orchestra.run.smithi031.stderr:gzip /var/log/ceph/ceph-client.admin.30147.log: -5 --verbose -- /var/log/ceph/ceph-client.2.32013.log 2024-08-17T02:28:34.898 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30267.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30009.log 2024-08-17T02:28:34.898 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-08-17T02:28:34.898 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30147.log.gz 2024-08-17T02:28:34.898 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35179.log: /var/log/ceph/ceph-client.2.32013.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35179.log.gz 2024-08-17T02:28:34.898 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34834.log 2024-08-17T02:28:34.898 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31349.log 2024-08-17T02:28:34.898 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.30009.log: /var/log/ceph/ceph-client.admin.34834.log: 90.3% 88.5% -- replaced with /var/log/ceph/ceph-client.2.32013.log.gz -- replaced with /var/log/ceph/ceph-client.admin.30009.log.gz 2024-08-17T02:28:34.899 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-08-17T02:28:34.899 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34834.log.gz 2024-08-17T02:28:34.899 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30888.log 2024-08-17T02:28:34.899 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34653.log 2024-08-17T02:28:34.899 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31349.log: /var/log/ceph/ceph-client.admin.30888.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31349.log.gz 2024-08-17T02:28:34.899 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:28:34.899 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34653.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30888.log.gz 2024-08-17T02:28:34.899 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34337.log 2024-08-17T02:28:34.900 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34888.log 2024-08-17T02:28:34.900 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34653.log.gz 2024-08-17T02:28:34.900 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.34337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31107.log 2024-08-17T02:28:34.900 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34337.log.gz 2024-08-17T02:28:34.900 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34888.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34888.log.gz 2024-08-17T02:28:34.901 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.31107.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31107.log.gz 2024-08-17T02:28:34.926 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.7.log: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:28:34.997 INFO:teuthology.orchestra.run.smithi092.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:28:34.997 INFO:teuthology.orchestra.run.smithi092.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:28:34.997 INFO:teuthology.orchestra.run.smithi092.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:28:35.023 INFO:teuthology.orchestra.run.smithi092.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:28:35.027 INFO:teuthology.orchestra.run.smithi031.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:28:35.044 INFO:teuthology.orchestra.run.smithi092.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:28:35.046 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-08-17T02:28:35.046 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m0.294s 2024-08-17T02:28:35.046 INFO:teuthology.orchestra.run.smithi092.stderr:user 0m1.174s 2024-08-17T02:28:35.046 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m0.053s 2024-08-17T02:28:35.060 INFO:teuthology.orchestra.run.smithi031.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:28:35.078 INFO:teuthology.orchestra.run.smithi031.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:28:35.082 INFO:teuthology.orchestra.run.smithi031.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:28:35.097 INFO:teuthology.orchestra.run.smithi031.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:28:35.098 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-08-17T02:28:35.099 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m0.349s 2024-08-17T02:28:35.099 INFO:teuthology.orchestra.run.smithi031.stderr:user 0m1.451s 2024-08-17T02:28:35.099 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m0.120s 2024-08-17T02:28:35.099 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:28:35.099 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255/remote/smithi031/log 2024-08-17T02:28:35.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:28:35.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-08-17T02:28:35.472 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255/remote/smithi092/log 2024-08-17T02:28:35.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:28:35.628 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:28:35.648 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:28:35.649 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:28:35.651 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:28:35.715 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:28:35.723 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:28:35.724 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:28:35.726 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:28:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:28:35.749 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2024-08-17T02:28:35.749 INFO:teuthology.orchestra.run.smithi031.stdout:*hv01.front.sepi 67.205.162.81 3 u 1 64 377 0.062 0.807 0.418 2024-08-17T02:28:35.749 INFO:teuthology.orchestra.run.smithi031.stdout:+hv02.front.sepi 63.231.80.2 3 u 63 64 177 0.083 0.699 0.488 2024-08-17T02:28:35.749 INFO:teuthology.orchestra.run.smithi031.stdout:+hv03.front.sepi 74.6.168.72 3 u 1 64 377 0.091 0.051 0.674 2024-08-17T02:28:35.749 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:28:35.751 INFO:teuthology.orchestra.run.smithi092.stdout: remote refid st t when poll reach delay offset jitter 2024-08-17T02:28:35.752 INFO:teuthology.orchestra.run.smithi092.stdout:============================================================================== 2024-08-17T02:28:35.752 INFO:teuthology.orchestra.run.smithi092.stdout:*hv01.front.sepi 67.205.162.81 3 u 65 64 177 0.082 -0.404 0.283 2024-08-17T02:28:35.752 INFO:teuthology.orchestra.run.smithi092.stdout:+hv02.front.sepi 63.231.80.2 3 u 60 64 177 0.068 -0.306 0.271 2024-08-17T02:28:35.752 INFO:teuthology.orchestra.run.smithi092.stdout:+hv03.front.sepi 74.6.168.72 3 u 61 64 177 0.116 -0.627 0.229 2024-08-17T02:28:35.752 INFO:teuthology.orchestra.run.smithi092.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-08-17T02:28:35.753 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:28:35.783 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:28:35.784 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:28:35.792 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:28:35.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:28:35.809 INFO:teuthology.task.internal:Duration was 808.695948 seconds 2024-08-17T02:28:35.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:28:35.818 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:28:35.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:28:35.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:28:35.876 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:28:35.876 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-08-17T02:28:35.877 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:28:35.887 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2024-08-17T02:28:35.887 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:28:35.899 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:28:35.899 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:28:35.901 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:28:35.979 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:28:35.979 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:28:35.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:28:36.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:28:36.066 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:28:36.067 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:28:36.083 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:28:36.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:28:36.108 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:28:36.111 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:28:36.123 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-08-17T02:28:36.155 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2024-08-17T02:28:36.167 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:28:36.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:36.191 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:28:36.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:36.197 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:28:36.207 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:28:36.208 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255/remote/smithi031 2024-08-17T02:28:36.208 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:28:36.234 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858255/remote/smithi092 2024-08-17T02:28:36.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:28:36.265 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:28:36.265 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:28:36.272 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:28:36.278 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:28:36.288 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:28:36.288 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:28:36.297 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:28:36.297 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:28:36.299 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:28:36.305 INFO:teuthology.orchestra.run.smithi031.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:28 /home/ubuntu/cephtest 2024-08-17T02:28:36.307 INFO:teuthology.orchestra.run.smithi092.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:28 /home/ubuntu/cephtest 2024-08-17T02:28:36.309 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:28:36.319 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:28:36.340 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 808.6959483623505 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b151d7cdc7fc4dd4a293273aadf51cd0 status: fail success: false 2024-08-17T02:28:36.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:28:36.413 INFO:teuthology.run:FAIL